2023-12-19T15:57:12.948 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:57:12.948 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} --verbose --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085 -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/orig.config.yaml 2023-12-19T15:57:12.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:57:13.082 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} email: vshankar@redhat.com first_in_suite: false job_id: '7497085' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInDLi1AFFTt3MoUz8HB1H03wHVWr3R8Ptq8tUF5pl9TNvdp8tSsW5kO1j+yiA3X9JWfS1DBTbfv/aYV41/wuM0= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPFLXSm6+i1LOeP5iPKcIiRuNcrfZzkykShcP7JpKo5zy4wU5MSBjoDIqe6dgc1t7ynLPQO+ib6nTonicoy9aw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_openfiletable teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_13:22:41 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T15:57:13.083 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-19T15:57:13.083 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-19T15:57:13.084 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T15:57:13.085 INFO:teuthology.task.internal:Checking packages... 2023-12-19T15:57:13.112 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-19T15:57:13.113 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T15:57:13.113 INFO:teuthology.packaging:ref: None 2023-12-19T15:57:13.113 INFO:teuthology.packaging:tag: None 2023-12-19T15:57:13.113 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:57:13.113 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T15:57:13.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T15:57:13.434 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132-g568df92b-1jammy 2023-12-19T15:57:13.436 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T15:57:13.444 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T15:57:13.444 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T15:57:13.461 INFO:teuthology.task.internal:Saving configuration 2023-12-19T15:57:13.478 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T15:57:13.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:57:13.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:51:29.076250', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINkQ/RB+FgRWse4WUk4jQCEZUx66roz0NY7lqfILTBXR'} 2023-12-19T15:57:13.536 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:51:29.077568', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMHiBtjDHbv28GKR7bJOzwDulrKR3LZImbb0flpSNMXE'} 2023-12-19T15:57:13.536 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T15:57:13.546 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-19T15:57:13.546 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-19T15:57:13.546 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T15:57:13.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5645b5cb80>, signals=[15]) 2023-12-19T15:57:13.637 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T15:57:13.648 INFO:teuthology.task.internal:Opening connections... 2023-12-19T15:57:13.648 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T15:57:13.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:57:13.727 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T15:57:13.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:57:13.802 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T15:57:13.813 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-12-19T15:57:13.819 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-12-19T15:57:13.819 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-12-19T15:57:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T15:57:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2023-12-19T15:57:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2023-12-19T15:57:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T15:57:13.866 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T15:57:13.867 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2023-12-19T15:57:13.868 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-12-19T15:57:13.886 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-12-19T15:57:13.892 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-12-19T15:57:13.893 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-12-19T15:57:13.939 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T15:57:13.939 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T15:57:13.940 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-12-19T15:57:13.940 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-12-19T15:57:13.961 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T15:57:13.973 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T15:57:13.983 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T15:57:13.983 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:57:13.986 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2023-12-19T15:57:13.990 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T15:57:14.001 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T15:57:14.001 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:57:14.031 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2023-12-19T15:57:14.044 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T15:57:14.107 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T15:57:14.125 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T15:57:14.125 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-19T15:57:14.125 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-19T15:57:14.126 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:57:14.126 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T15:57:14.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:57:14.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T15:57:14.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-19T15:57:14.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-19T15:57:14.307 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:14.308 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T15:57:14.308 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-19T15:57:14.313 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2023-12-19T15:57:14.313 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:14.314 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T15:57:14.315 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-19T15:57:14.315 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T15:57:14.317 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:14.317 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T15:57:14.317 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2023-12-19T15:57:14.323 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-56-generic 2023-12-19T15:57:14.323 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:57:14.323 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T15:57:14.323 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-19T15:57:14.323 DEBUG:teuthology.orchestra.run.smithi162:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T15:57:14.375 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T15:57:14.378 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: git config --global init.defaultBranch 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: 2023-12-19T15:57:14.526 INFO:teuthology.orchestra.run.smithi162.stderr:hint: git branch -m 2023-12-19T15:57:14.527 INFO:teuthology.orchestra.run.smithi162.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: git config --global init.defaultBranch 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: 2023-12-19T15:57:14.528 INFO:teuthology.orchestra.run.smithi073.stderr:hint: git branch -m 2023-12-19T15:57:14.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T15:57:14.530 INFO:teuthology.orchestra.run.smithi073.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T15:57:14.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T15:57:14.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T15:57:14.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T15:57:14.655 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T15:57:14.657 DEBUG:teuthology.orchestra.run.smithi162:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T15:59:26.596 INFO:teuthology.orchestra.run.smithi162.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T15:59:26.596 INFO:teuthology.orchestra.run.smithi162.stderr: * [new branch] main -> origin/main 2023-12-19T15:59:26.620 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T15:59:26.620 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T15:59:26.621 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T15:59:26.623 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T15:59:26.623 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T15:59:26.624 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T15:59:26.625 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T15:59:26.627 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T15:59:26.628 INFO:teuthology.orchestra.run.smithi162.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T15:59:30.621 INFO:teuthology.orchestra.run.smithi162.stderr:Updating files: 51% (1667/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 64% (2116/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2653/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T15:59:30.629 INFO:teuthology.orchestra.run.smithi162.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T15:59:30.647 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T15:59:30.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T15:59:30.789 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T15:59:30.789 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T15:59:30.792 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi162.front.sepia.ceph.com to complete... 2023-12-19T15:59:32.731 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19 15:59:33 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T15:59:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:FINISHED --2023-12-19 15:59:33-- 2023-12-19T15:59:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:Total wall clock time: 1.9s 2023-12-19T15:59:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:Downloaded: 1 files, 37M in 1.6s (23.6 MB/s) 2023-12-19T15:59:32.736 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T15:59:32.736 DEBUG:teuthology.orchestra.run.smithi162:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T15:59:32.944 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T15:59:34.879 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T15:59:34.884 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T15:59:34.990 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T15:59:38.268 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T15:59:38.382 INFO:teuthology.orchestra.run.smithi162.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T15:59:58.696 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2023-12-19T15:59:58.711 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T15:59:58.729 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2023-12-19T15:59:59.068 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T15:59:59.083 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T15:59:59.370 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T15:59:59.386 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T15:59:59.450 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T15:59:59.456 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T15:59:59.608 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T15:59:59.608 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T15:59:59.608 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T15:59:59.650 INFO:teuthology.orchestra.run.smithi162.stderr:done 2023-12-19T15:59:59.815 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T15:59:59.866 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T15:59:59.866 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T15:59:59.866 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T15:59:59.877 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T15:59:59.878 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T15:59:59.896 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T15:59:59.897 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T15:59:59.899 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T15:59:59.899 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T15:59:59.899 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T15:59:59.899 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T15:59:59.899 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T15:59:59.900 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T15:59:59.901 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T15:59:59.902 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T15:59:59.917 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T15:59:59.918 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T15:59:59.919 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T15:59:59.920 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T15:59:59.921 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T15:59:59.922 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T15:59:59.923 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T15:59:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T15:59:59.925 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T15:59:59.926 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T15:59:59.927 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T15:59:59.928 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T15:59:59.929 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T15:59:59.930 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T15:59:59.931 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T15:59:59.995 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T15:59:59.995 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T15:59:59.995 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T15:59:59.996 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T15:59:59.997 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T15:59:59.998 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T15:59:59.999 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T16:00:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T16:00:00.001 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T16:00:00.002 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T16:00:00.003 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T16:00:00.004 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T16:00:00.005 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T16:00:00.006 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T16:00:00.007 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T16:00:00.008 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T16:00:00.009 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T16:00:00.010 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T16:00:00.011 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T16:00:00.012 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T16:00:00.013 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T16:00:00.014 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T16:00:00.015 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T16:00:00.016 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T16:00:00.017 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T16:00:00.018 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T16:00:00.019 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T16:00:00.020 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T16:00:00.021 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T16:00:00.022 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T16:00:00.023 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T16:00:00.024 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T16:00:00.025 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T16:00:00.026 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T16:00:00.027 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T16:00:00.028 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T16:00:00.029 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T16:00:00.030 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T16:00:00.031 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T16:00:00.032 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T16:00:00.033 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T16:00:00.034 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T16:00:00.035 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T16:00:00.036 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T16:00:00.037 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T16:00:00.038 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T16:00:00.039 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T16:00:00.040 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T16:00:00.041 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T16:00:00.042 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T16:00:00.043 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T16:00:00.044 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T16:00:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T16:00:00.046 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T16:00:00.047 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T16:00:00.048 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T16:00:00.049 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T16:00:00.050 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T16:00:00.051 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T16:00:00.052 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T16:00:00.053 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T16:00:00.054 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T16:00:00.055 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T16:00:00.056 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T16:00:00.056 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T16:00:00.056 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T16:00:00.200 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T16:00:00.201 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T16:00:00.202 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T16:00:00.203 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T16:00:00.204 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T16:00:00.205 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T16:00:00.206 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T16:00:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T16:00:00.208 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T16:00:00.209 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T16:00:00.210 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T16:00:00.211 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T16:00:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T16:00:00.213 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T16:00:00.214 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T16:00:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T16:00:00.216 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T16:00:00.217 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T16:00:00.218 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T16:00:00.219 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T16:00:00.220 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T16:00:00.221 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T16:00:00.222 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T16:00:00.223 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T16:00:00.224 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T16:00:00.225 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T16:00:00.226 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T16:00:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T16:00:00.228 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T16:00:00.229 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T16:00:00.230 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T16:00:00.231 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T16:00:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T16:00:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T16:00:00.234 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T16:00:00.235 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T16:00:00.236 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T16:00:00.237 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T16:00:00.238 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T16:00:00.239 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T16:00:00.240 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T16:00:00.241 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T16:00:00.242 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T16:00:00.243 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T16:00:00.244 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T16:00:00.245 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T16:00:00.246 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T16:00:00.247 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T16:00:00.248 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T16:00:00.249 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T16:00:00.250 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T16:00:00.251 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T16:00:00.252 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T16:00:00.253 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T16:00:00.254 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T16:00:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T16:00:00.256 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T16:00:00.257 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T16:00:00.258 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T16:00:00.259 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T16:00:00.260 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T16:00:00.261 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T16:00:00.262 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T16:00:00.263 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T16:00:00.264 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T16:00:00.265 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T16:00:00.266 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T16:00:00.267 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T16:00:00.268 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T16:00:00.269 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T16:00:00.270 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T16:00:00.271 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T16:00:00.272 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T16:00:00.273 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T16:00:00.274 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T16:00:00.275 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T16:00:00.276 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T16:00:00.277 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T16:00:00.278 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T16:00:00.279 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T16:00:00.280 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T16:00:00.281 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T16:00:00.282 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T16:00:00.283 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T16:00:00.284 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T16:00:00.285 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T16:00:00.286 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T16:00:00.287 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T16:00:00.288 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T16:00:00.289 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T16:00:00.290 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T16:00:00.291 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T16:00:00.292 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T16:00:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T16:00:00.294 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T16:00:00.295 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T16:00:00.296 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T16:00:00.297 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T16:00:00.298 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T16:00:00.299 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T16:00:00.300 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T16:00:00.301 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T16:00:00.301 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T16:00:00.301 DEBUG:teuthology.orchestra.run.smithi162:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T16:00:00.308 INFO:teuthology.orchestra.run.smithi162.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:00.308 INFO:teuthology.orchestra.run.smithi162.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:00.309 INFO:teuthology.orchestra.run.smithi162.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:00.309 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T16:00:00.309 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T16:00:00.309 DEBUG:teuthology.orchestra.run.smithi162:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T16:00:00.352 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi162.front.sepia.ceph.com to complete... 2023-12-19T16:00:00.729 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:00.730 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:00.753 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2023-12-19T16:00:00.936 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:00.942 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:01.159 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:01.165 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:01.209 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:01.214 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:01.345 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:01.345 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:01.345 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:01.362 INFO:teuthology.orchestra.run.smithi162.stderr:done 2023-12-19T16:00:16.540 INFO:teuthology.orchestra.run.smithi073.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T16:00:16.540 INFO:teuthology.orchestra.run.smithi073.stderr: * [new branch] main -> origin/main 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T16:00:16.572 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T16:00:16.574 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T16:00:16.574 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T16:00:16.574 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T16:00:16.574 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T16:00:16.574 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T16:00:16.575 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T16:00:16.581 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T16:00:16.581 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T16:00:16.581 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T16:00:16.581 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T16:00:16.582 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T16:00:16.583 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T16:00:16.583 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T16:00:16.583 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T16:00:16.583 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T16:00:20.566 INFO:teuthology.orchestra.run.smithi073.stderr:Updating files: 51% (1673/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2119/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2658/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T16:00:20.571 INFO:teuthology.orchestra.run.smithi073.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T16:00:20.591 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T16:00:20.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T16:00:20.822 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:20.822 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T16:00:20.825 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2023-12-19T16:00:29.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19 16:00:29 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T16:00:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2023-12-19 16:00:29-- 2023-12-19T16:00:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 8.8s 2023-12-19T16:00:29.745 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 37M in 8.6s (4.33 MB/s) 2023-12-19T16:00:29.749 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T16:00:29.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T16:00:29.973 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T16:00:31.982 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T16:00:31.986 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T16:00:32.118 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:32.502 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-19T16:00:32.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:00:32.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:00:35.452 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T16:00:35.565 INFO:teuthology.orchestra.run.smithi073.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:50.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-12-19T16:00:56.313 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:56.327 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-12-19T16:00:56.753 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:56.771 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.176 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:57.183 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:57.244 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:57.249 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:57.386 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:57.422 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-12-19T16:00:57.635 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T16:00:57.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T16:00:57.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T16:00:57.675 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T16:00:57.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T16:00:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T16:00:57.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T16:00:57.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T16:00:57.695 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T16:00:57.696 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T16:00:57.697 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T16:00:57.698 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T16:00:57.699 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T16:00:57.700 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T16:00:57.701 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T16:00:57.702 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T16:00:57.703 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T16:00:57.704 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T16:00:57.705 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T16:00:57.759 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T16:00:57.760 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T16:00:57.761 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T16:00:57.762 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T16:00:57.763 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T16:00:57.764 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T16:00:57.765 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T16:00:57.766 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T16:00:57.767 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T16:00:57.768 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T16:00:57.769 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T16:00:57.770 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T16:00:57.771 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T16:00:57.772 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T16:00:57.773 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T16:00:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T16:00:57.775 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T16:00:57.776 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T16:00:57.777 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T16:00:57.778 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T16:00:57.779 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T16:00:57.780 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T16:00:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T16:00:57.782 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T16:00:57.783 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T16:00:57.784 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T16:00:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T16:00:57.786 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T16:00:57.787 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T16:00:57.788 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T16:00:57.789 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T16:00:57.790 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T16:00:57.791 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T16:00:57.792 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T16:00:57.793 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T16:00:57.794 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T16:00:57.795 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T16:00:57.796 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T16:00:57.797 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T16:00:57.798 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T16:00:57.799 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T16:00:57.800 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T16:00:57.801 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T16:00:57.802 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T16:00:57.803 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T16:00:57.804 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T16:00:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T16:00:57.806 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T16:00:57.807 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T16:00:57.808 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T16:00:57.809 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T16:00:57.810 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T16:00:57.872 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T16:00:57.872 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T16:00:57.872 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T16:00:57.873 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T16:00:57.874 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T16:00:57.875 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T16:00:57.876 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T16:00:57.877 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T16:00:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T16:00:57.879 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T16:00:57.880 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T16:00:57.881 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T16:00:57.882 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T16:00:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T16:00:57.884 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T16:00:57.885 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T16:00:57.886 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T16:00:57.887 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T16:00:57.888 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T16:00:57.889 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T16:00:57.890 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T16:00:57.891 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T16:00:57.892 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T16:00:57.893 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T16:00:57.894 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T16:00:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T16:00:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T16:00:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T16:00:57.898 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T16:00:57.899 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T16:00:57.900 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T16:00:57.901 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T16:00:57.902 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T16:00:57.903 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T16:00:57.904 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T16:00:57.905 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T16:00:57.906 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T16:00:57.907 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T16:00:57.908 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T16:00:57.909 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T16:00:57.910 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T16:00:57.911 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T16:00:57.912 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T16:00:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T16:00:57.914 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T16:00:57.915 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T16:00:57.916 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T16:00:57.917 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T16:00:57.918 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T16:00:57.919 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T16:00:57.920 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T16:00:57.921 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T16:00:57.922 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T16:00:57.923 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T16:00:57.924 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T16:00:57.925 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T16:00:57.926 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T16:00:57.927 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T16:00:57.928 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T16:00:57.929 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T16:00:57.930 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T16:00:57.931 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T16:00:57.932 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T16:00:57.933 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T16:00:57.974 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T16:00:57.975 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T16:00:57.976 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T16:00:57.977 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T16:00:57.978 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T16:00:57.979 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T16:00:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T16:00:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T16:00:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T16:00:57.983 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T16:00:57.984 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T16:00:57.985 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T16:00:57.986 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T16:00:57.987 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T16:00:57.988 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T16:00:57.989 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T16:00:57.990 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T16:00:57.991 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T16:00:57.992 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T16:00:57.993 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T16:00:57.994 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T16:00:57.995 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T16:00:57.996 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T16:00:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T16:00:57.998 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T16:00:57.999 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T16:00:58.000 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T16:00:58.001 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T16:00:58.002 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T16:00:58.003 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T16:00:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T16:00:58.005 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T16:00:58.006 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T16:00:58.007 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T16:00:58.008 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T16:00:58.009 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T16:00:58.010 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T16:00:58.011 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T16:00:58.012 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T16:00:58.013 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T16:00:58.014 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T16:00:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T16:00:58.016 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T16:00:58.017 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T16:00:58.018 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T16:00:58.019 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.019 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.020 DEBUG:teuthology.orchestra.run.smithi073:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T16:00:58.026 INFO:teuthology.orchestra.run.smithi073.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:58.026 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:58.026 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T16:00:58.027 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T16:00:58.027 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.027 DEBUG:teuthology.orchestra.run.smithi073:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T16:00:58.072 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi073.front.sepia.ceph.com to complete... 2023-12-19T16:00:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2023-12-19T16:00:58.530 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T16:00:58.554 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-12-19T16:00:58.796 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T16:00:58.802 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T16:00:59.098 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T16:00:59.104 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T16:00:59.149 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T16:00:59.155 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T16:00:59.279 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T16:00:59.279 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T16:00:59.279 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T16:00:59.295 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-12-19T16:00:59.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:00:59.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:01:03.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-12-19T16:01:15.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:01:15.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:01:30.405 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T16:01:30.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:01:30.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:04.950 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-19T16:02:13.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:02:13.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:15.041 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T16:02:30.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:02:30.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:30.263 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-12-19T16:02:30.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:02:30.986 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-19T16:02:30.986 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2023-12-19T16:02:31.036 INFO:teuthology.orchestra.run.smithi162.stdout:6.6.0-gcd68252d7b4d 2023-12-19T16:02:31.036 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T16:02:31.036 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T16:02:31.036 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T16:02:32.038 DEBUG:teuthology.parallel:result is None 2023-12-19T16:02:32.337 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-19T16:02:44.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:02:44.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:02:44.947 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-19T16:02:45.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:02:45.948 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T16:02:45.948 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-19T16:02:45.957 INFO:teuthology.orchestra.run.smithi073.stdout:6.6.0-gcd68252d7b4d 2023-12-19T16:02:45.957 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T16:02:45.957 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T16:02:45.957 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T16:02:46.959 DEBUG:teuthology.parallel:result is None 2023-12-19T16:02:46.959 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T16:02:46.966 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T16:02:46.967 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T16:02:46.970 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T16:02:46.980 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T16:02:46.990 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T16:02:46.995 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T16:02:46.996 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T16:02:47.022 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T16:02:47.106 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T16:02:47.113 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T16:02:47.113 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T16:02:47.116 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T16:02:47.198 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:47.226 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:47.482 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:47.500 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T16:02:47.503 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T16:02:47.510 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T16:02:47.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T16:02:47.514 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T16:02:47.537 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T16:02:47.548 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T16:02:47.548 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T16:02:47.581 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T16:02:47.590 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T16:02:47.642 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T16:02:47.699 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:02:47.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T16:02:47.772 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T16:02:47.782 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T16:02:47.833 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:02:47.833 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T16:02:47.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-12-19T16:02:47.915 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2023-12-19T16:02:48.053 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T16:02:48.061 INFO:teuthology.task.internal:Starting timer... 2023-12-19T16:02:48.061 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T16:02:48.075 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T16:02:48.085 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2023-12-19T16:02:48.085 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2023-12-19T16:02:48.085 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T16:02:48.086 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-19T16:02:48.086 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T16:02:48.086 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T16:02:48.095 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T16:02:48.095 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T16:02:48.116 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T16:02:48.117 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T16:11:34.710 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2023-12-19T16:11:34.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:11:34.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:34.788 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-19T16:11:34.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T16:11:34.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:11:34.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T16:11:35.004 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-12-19T16:11:35.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-12-19T16:11:35.133 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T16:11:35.149 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T16:11:35.149 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:11:35.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:11:35.154 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T16:11:35.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:11:35.189 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Command line: ntpd -gq 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: ---------------------------------------------------- 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: corporation. Support and training for ntp-4 are 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: available at https://www.nwtime.org/support 2023-12-19T16:11:35.190 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: ---------------------------------------------------- 2023-12-19T16:11:35.191 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: proto: precision = 0.041 usec (-24) 2023-12-19T16:11:35.191 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: basedate set to 2022-02-04 2023-12-19T16:11:35.191 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: gps base set to 2022-02-06 (week 2196) 2023-12-19T16:11:35.191 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:35.191 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:35.192 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:35.192 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen normally on 4 lo [::1]:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2023-12-19T16:11:35.193 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:35 ntpd[27956]: Listening on routing socket on fd #22 for interface updates 2023-12-19T16:11:35.211 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Command line: ntpd -gq 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: ---------------------------------------------------- 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: corporation. Support and training for ntp-4 are 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: available at https://www.nwtime.org/support 2023-12-19T16:11:35.212 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: ---------------------------------------------------- 2023-12-19T16:11:35.213 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: proto: precision = 0.042 usec (-24) 2023-12-19T16:11:35.213 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: basedate set to 2022-02-04 2023-12-19T16:11:35.213 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: gps base set to 2022-02-06 (week 2196) 2023-12-19T16:11:35.213 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:35.214 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T16:11:35.214 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:35.214 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen normally on 4 lo [::1]:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2023-12-19T16:11:35.215 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:35 ntpd[27991]: Listening on routing socket on fd #22 for interface updates 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:36.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:36 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:37.190 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:37 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:37.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:37.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:37.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:37.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:37 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:38 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:38.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:38.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:38 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:39.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:39 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:39.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:39.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:39.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:39 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:40.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:40 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:40.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:40.214 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:40 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:41.190 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:41.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:41.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:41.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:41.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:41.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:41 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:41.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:41.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:41.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:41.212 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:41.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:41.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:41 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:42.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:42 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:42.213 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:42.214 INFO:teuthology.orchestra.run.smithi162.stdout:19 Dec 16:11:42 ntpd[27991]: ntpd: time slew -0.002186 s 2023-12-19T16:11:42.214 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew -0.002186s 2023-12-19T16:11:42.214 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T16:11:42.214 INFO:teuthology.orchestra.run.smithi162.stderr:19 Dec 16:11:42 ntpd[27991]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T16:11:42.309 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:11:42.310 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2023-12-19T16:11:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:42.310 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:43.190 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:43.190 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 16:11:43 ntpd[27956]: ntpd: time slew -0.000928 s 2023-12-19T16:11:43.191 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.000928s 2023-12-19T16:11:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T16:11:43.192 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 16:11:43 ntpd[27956]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T16:11:43.288 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:11:43.289 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-12-19T16:11:43.289 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:43.289 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:43.289 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:43.289 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:11:43.290 INFO:teuthology.run_tasks:Running task install... 2023-12-19T16:11:43.299 DEBUG:teuthology.task.install:project ceph 2023-12-19T16:11:43.299 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-19T16:11:43.299 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-19T16:11:43.300 INFO:teuthology.task.install:Using flavor: default 2023-12-19T16:11:43.305 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T16:11:43.305 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T16:11:43.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2023-12-19T16:11:43.306 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2023-12-19T16:11:43.415 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T16:11:43.439 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T16:11:43.468 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T16:11:43.468 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T16:11:43.469 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T16:11:43.469 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T16:11:43.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:11:43.492 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T16:11:43.492 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T16:11:43.493 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T16:11:43.493 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T16:11:43.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:11:43.696 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default/ 2023-12-19T16:11:43.696 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:43.704 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default/ 2023-12-19T16:11:43.704 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:43.949 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:11:43.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T16:11:43.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2023-12-19T16:11:44.035 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:11:44.035 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T16:11:44.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2023-12-19T16:11:44.175 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-19T16:11:44.250 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T16:11:44.259 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-19T16:11:44.277 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T16:11:44.279 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T16:11:44.361 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-19T16:11:44.364 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-19T16:11:44.443 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T16:11:44.463 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T16:11:44.518 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T16:11:44.519 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T16:11:44.581 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T16:11:44.583 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T16:11:44.647 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T16:11:44.648 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2023-12-19T16:11:44.712 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2023-12-19T16:11:44.726 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T16:11:44.791 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T16:11:44.834 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 28.5 kB in 1s (44.6 kB/s) 2023-12-19T16:11:44.967 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.5 kB in 1s (41.7 kB/s) 2023-12-19T16:11:45.763 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-12-19T16:11:45.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1jammy cephadm=18.2.1-132-g568df92b-1jammy ceph-mds=18.2.1-132-g568df92b-1jammy ceph-mgr=18.2.1-132-g568df92b-1jammy ceph-common=18.2.1-132-g568df92b-1jammy ceph-fuse=18.2.1-132-g568df92b-1jammy ceph-test=18.2.1-132-g568df92b-1jammy ceph-volume=18.2.1-132-g568df92b-1jammy radosgw=18.2.1-132-g568df92b-1jammy python3-rados=18.2.1-132-g568df92b-1jammy python3-rgw=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy python3-rbd=18.2.1-132-g568df92b-1jammy libcephfs2=18.2.1-132-g568df92b-1jammy libcephfs-dev=18.2.1-132-g568df92b-1jammy librados2=18.2.1-132-g568df92b-1jammy librbd1=18.2.1-132-g568df92b-1jammy rbd-fuse=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy cephfs-shell=18.2.1-132-g568df92b-1jammy cephfs-top=18.2.1-132-g568df92b-1jammy cephfs-mirror=18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:45.852 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-12-19T16:11:45.905 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T16:11:45.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1jammy cephadm=18.2.1-132-g568df92b-1jammy ceph-mds=18.2.1-132-g568df92b-1jammy ceph-mgr=18.2.1-132-g568df92b-1jammy ceph-common=18.2.1-132-g568df92b-1jammy ceph-fuse=18.2.1-132-g568df92b-1jammy ceph-test=18.2.1-132-g568df92b-1jammy ceph-volume=18.2.1-132-g568df92b-1jammy radosgw=18.2.1-132-g568df92b-1jammy python3-rados=18.2.1-132-g568df92b-1jammy python3-rgw=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy python3-rbd=18.2.1-132-g568df92b-1jammy libcephfs2=18.2.1-132-g568df92b-1jammy libcephfs-dev=18.2.1-132-g568df92b-1jammy librados2=18.2.1-132-g568df92b-1jammy librbd1=18.2.1-132-g568df92b-1jammy rbd-fuse=18.2.1-132-g568df92b-1jammy python3-cephfs=18.2.1-132-g568df92b-1jammy cephfs-shell=18.2.1-132-g568df92b-1jammy cephfs-top=18.2.1-132-g568df92b-1jammy cephfs-mirror=18.2.1-132-g568df92b-1jammy 2023-12-19T16:11:45.995 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T16:11:46.019 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-12-19T16:11:46.020 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-12-19T16:11:46.161 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-12-19T16:11:46.162 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:11:46.177 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T16:11:46.179 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T16:11:46.180 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2023-12-19T16:11:46.181 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-19T16:11:46.182 INFO:teuthology.orchestra.run.smithi162.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: python3-watchdog 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2023-12-19T16:11:46.183 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2023-12-19T16:11:46.314 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:11:46.315 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:11:46.316 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-12-19T16:11:46.316 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T16:11:46.317 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T16:11:46.318 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: python3-watchdog 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2023-12-19T16:11:46.319 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2023-12-19T16:11:46.326 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2023-12-19T16:11:46.326 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T16:11:46.326 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T16:11:46.327 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T16:11:46.327 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T16:11:46.328 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T16:11:46.329 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T16:11:46.330 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T16:11:46.330 INFO:teuthology.orchestra.run.smithi162.stdout: socat xmlstarlet 2023-12-19T16:11:46.394 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T16:11:46.395 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 181 MB of archives. 2023-12-19T16:11:46.395 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-19T16:11:46.395 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T16:11:46.412 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T16:11:46.421 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T16:11:46.460 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-12-19T16:11:46.460 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T16:11:46.460 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T16:11:46.460 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T16:11:46.460 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T16:11:46.461 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-12-19T16:11:46.461 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T16:11:46.461 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T16:11:46.462 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi073.stdout: socat xmlstarlet 2023-12-19T16:11:46.463 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-19T16:11:46.473 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T16:11:46.491 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T16:11:46.494 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T16:11:46.503 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T16:11:46.527 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 115 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T16:11:46.527 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 181 MB of archives. 2023-12-19T16:11:46.527 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 812 MB of additional disk space will be used. 2023-12-19T16:11:46.527 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T16:11:46.541 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T16:11:46.543 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T16:11:46.544 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T16:11:46.550 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T16:11:46.553 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T16:11:46.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T16:11:46.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T16:11:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T16:11:46.560 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T16:11:46.561 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T16:11:46.561 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T16:11:46.562 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T16:11:46.577 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T16:11:46.577 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T16:11:46.577 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T16:11:46.578 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T16:11:46.593 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T16:11:46.596 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T16:11:46.596 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T16:11:46.597 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-12-19T16:11:46.598 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T16:11:46.598 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T16:11:46.598 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T16:11:46.604 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T16:11:46.610 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T16:11:46.610 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T16:11:46.611 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T16:11:46.612 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T16:11:46.620 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T16:11:46.623 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T16:11:46.627 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T16:11:46.631 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T16:11:46.631 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T16:11:46.632 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T16:11:46.632 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T16:11:46.633 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T16:11:46.633 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T16:11:46.643 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T16:11:46.644 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T16:11:46.645 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T16:11:46.646 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T16:11:46.660 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T16:11:46.661 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T16:11:46.663 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T16:11:46.669 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T16:11:46.671 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T16:11:46.678 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T16:11:46.681 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T16:11:46.682 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T16:11:46.688 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T16:11:46.688 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T16:11:46.689 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T16:11:46.690 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T16:11:46.690 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T16:11:46.706 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T16:11:46.706 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T16:11:46.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T16:11:46.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T16:11:46.708 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T16:11:46.708 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T16:11:46.708 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T16:11:46.710 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T16:11:46.710 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T16:11:46.711 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T16:11:46.712 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T16:11:46.712 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T16:11:46.712 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T16:11:46.715 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T16:11:46.723 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T16:11:46.723 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T16:11:46.724 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T16:11:46.724 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T16:11:46.725 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T16:11:46.726 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T16:11:46.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T16:11:46.742 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T16:11:46.742 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T16:11:46.744 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T16:11:46.744 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T16:11:46.744 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T16:11:46.751 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T16:11:46.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T16:11:46.753 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T16:11:46.760 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T16:11:46.760 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T16:11:46.761 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T16:11:46.761 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T16:11:46.762 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T16:11:46.770 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T16:11:46.770 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T16:11:46.770 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T16:11:46.771 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T16:11:46.771 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T16:11:46.772 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T16:11:46.776 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T16:11:46.777 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T16:11:46.778 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T16:11:46.778 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T16:11:46.779 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T16:11:46.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T16:11:46.781 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T16:11:46.782 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T16:11:46.793 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T16:11:46.795 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T16:11:46.795 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T16:11:46.797 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T16:11:46.797 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T16:11:46.801 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T16:11:46.804 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T16:11:46.804 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T16:11:46.808 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T16:11:46.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T16:11:46.813 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T16:11:46.815 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T16:11:46.829 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T16:11:46.830 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T16:11:46.831 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T16:11:46.833 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-132-g568df92b-1jammy [3,418 kB] 2023-12-19T16:11:46.840 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T16:11:46.841 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T16:11:46.842 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T16:11:46.842 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T16:11:46.843 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T16:11:46.844 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T16:11:46.844 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T16:11:46.845 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T16:11:46.847 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T16:11:46.860 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T16:11:46.864 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T16:11:46.885 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T16:11:46.886 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T16:11:46.886 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T16:11:46.903 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T16:11:46.903 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T16:11:46.904 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T16:11:46.904 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T16:11:46.905 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T16:11:46.905 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T16:11:46.908 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T16:11:46.908 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T16:11:46.912 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T16:11:46.924 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T16:11:46.927 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T16:11:46.928 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T16:11:46.934 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T16:11:46.940 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.1-132-g568df92b-1jammy [3,418 kB] 2023-12-19T16:11:46.942 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T16:11:46.942 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T16:11:46.946 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T16:11:46.951 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T16:11:46.952 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T16:11:46.954 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T16:11:46.964 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T16:11:46.964 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T16:11:46.965 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T16:11:48.455 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1jammy [3,104 kB] 2023-12-19T16:11:49.490 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1jammy [3,104 kB] 2023-12-19T16:11:49.818 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1jammy [670 kB] 2023-12-19T16:11:50.064 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1jammy [356 kB] 2023-12-19T16:11:50.195 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1jammy [32.8 kB] 2023-12-19T16:11:50.208 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1jammy [180 kB] 2023-12-19T16:11:50.302 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1jammy [61.5 kB] 2023-12-19T16:11:50.348 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1jammy [330 kB] 2023-12-19T16:11:50.485 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1jammy [5,884 kB] 2023-12-19T16:11:50.735 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1jammy [670 kB] 2023-12-19T16:11:51.040 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1jammy [356 kB] 2023-12-19T16:11:51.209 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1jammy [32.8 kB] 2023-12-19T16:11:51.246 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1jammy [180 kB] 2023-12-19T16:11:51.298 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1jammy [61.5 kB] 2023-12-19T16:11:51.307 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1jammy [330 kB] 2023-12-19T16:11:51.419 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1jammy [5,884 kB] 2023-12-19T16:11:53.467 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1jammy [112 kB] 2023-12-19T16:11:53.519 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1jammy [442 kB] 2023-12-19T16:11:53.725 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1jammy [22.0 MB] 2023-12-19T16:11:54.849 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1jammy [112 kB] 2023-12-19T16:11:54.895 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1jammy [442 kB] 2023-12-19T16:11:55.077 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1jammy [22.0 MB] 2023-12-19T16:12:00.122 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1jammy [6,835 kB] 2023-12-19T16:12:01.617 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1jammy [6,835 kB] 2023-12-19T16:12:01.690 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1jammy [237 kB] 2023-12-19T16:12:01.744 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1jammy [130 kB] 2023-12-19T16:12:01.761 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1jammy [1,484 kB] 2023-12-19T16:12:02.064 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1jammy [9,877 kB] 2023-12-19T16:12:03.062 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1jammy [237 kB] 2023-12-19T16:12:03.099 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1jammy [130 kB] 2023-12-19T16:12:03.134 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1jammy [1,484 kB] 2023-12-19T16:12:03.420 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1jammy [9,877 kB] 2023-12-19T16:12:03.870 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1jammy [31.5 MB] 2023-12-19T16:12:05.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1jammy [31.5 MB] 2023-12-19T16:12:08.281 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-132-g568df92b-1jammy [14.1 kB] 2023-12-19T16:12:08.281 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1jammy [824 kB] 2023-12-19T16:12:08.367 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1jammy [2,173 kB] 2023-12-19T16:12:08.619 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-132-g568df92b-1jammy [235 kB] 2023-12-19T16:12:08.652 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1jammy [138 kB] 2023-12-19T16:12:08.678 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1jammy [1,898 kB] 2023-12-19T16:12:08.897 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1jammy [8,625 kB] 2023-12-19T16:12:09.411 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.1-132-g568df92b-1jammy [14.1 kB] 2023-12-19T16:12:09.411 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1jammy [824 kB] 2023-12-19T16:12:09.513 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1jammy [2,173 kB] 2023-12-19T16:12:09.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.1-132-g568df92b-1jammy [235 kB] 2023-12-19T16:12:09.819 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1jammy [138 kB] 2023-12-19T16:12:09.829 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1jammy [1,898 kB] 2023-12-19T16:12:09.900 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1jammy [14.2 kB] 2023-12-19T16:12:09.900 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1jammy [46.4 MB] 2023-12-19T16:12:10.046 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1jammy [8,625 kB] 2023-12-19T16:12:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1jammy [14.2 kB] 2023-12-19T16:12:11.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1jammy [46.4 MB] 2023-12-19T16:12:14.235 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-132-g568df92b-1jammy [121 kB] 2023-12-19T16:12:14.245 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1jammy [228 kB] 2023-12-19T16:12:14.262 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1jammy [34.0 kB] 2023-12-19T16:12:14.263 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-132-g568df92b-1jammy [23.3 kB] 2023-12-19T16:12:14.264 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1jammy [38.3 kB] 2023-12-19T16:12:14.266 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-132-g568df92b-1jammy [11.6 MB] 2023-12-19T16:12:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.1-132-g568df92b-1jammy [121 kB] 2023-12-19T16:12:15.559 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1jammy [228 kB] 2023-12-19T16:12:15.602 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1jammy [34.0 kB] 2023-12-19T16:12:15.602 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.1-132-g568df92b-1jammy [23.3 kB] 2023-12-19T16:12:15.616 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1jammy [38.3 kB] 2023-12-19T16:12:15.617 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.1-132-g568df92b-1jammy [11.6 MB] 2023-12-19T16:12:15.840 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1jammy [92.9 kB] 2023-12-19T16:12:16.414 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 181 MB in 30s (6,131 kB/s) 2023-12-19T16:12:16.562 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T16:12:16.631 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T16:12:16.635 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T16:12:16.677 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T16:12:16.791 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1jammy [92.9 kB] 2023-12-19T16:12:16.972 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T16:12:16.985 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T16:12:17.022 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:12:17.316 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T16:12:17.330 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T16:12:17.366 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 181 MB in 30s (5,964 kB/s) 2023-12-19T16:12:17.375 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T16:12:17.524 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T16:12:17.593 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T16:12:17.597 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T16:12:17.640 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T16:12:17.678 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-19T16:12:17.691 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-19T16:12:17.778 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:12:17.968 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T16:12:17.981 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T16:12:18.029 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:12:18.106 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T16:12:18.120 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T16:12:18.287 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T16:12:18.301 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T16:12:18.337 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T16:12:18.598 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfmt8:amd64. 2023-12-19T16:12:18.612 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-12-19T16:12:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:12:18.798 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:12:19.043 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T16:12:19.058 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T16:12:19.101 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:12:19.135 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T16:12:19.150 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T16:12:19.336 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:12:19.638 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T16:12:19.653 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T16:12:19.688 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:12:20.122 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T16:12:20.133 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T16:12:20.137 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T16:12:20.149 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:20.180 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:12:20.200 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:20.546 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T16:12:20.561 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T16:12:20.600 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:12:20.612 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T16:12:20.626 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:20.670 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:20.965 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T16:12:20.980 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:21.015 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:21.037 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T16:12:21.052 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:21.103 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:21.360 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T16:12:21.375 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T16:12:21.427 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:12:21.524 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T16:12:21.538 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:21.582 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2023-12-19T16:12:21.761 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:21.805 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:21.902 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T16:12:21.917 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T16:12:21.951 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:12:22.224 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2023-12-19T16:12:22.239 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-librbd1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:22.282 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:22.463 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T16:12:22.478 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T16:12:22.521 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:12:22.627 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T16:12:22.641 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:22.677 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:22.849 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2023-12-19T16:12:22.864 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:22.907 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:22.938 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2023-12-19T16:12:22.953 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-rados_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:22.988 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.307 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T16:12:23.322 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:23.366 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.368 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2023-12-19T16:12:23.383 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-librbd1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:23.418 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.610 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T16:12:23.625 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:23.668 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.805 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T16:12:23.819 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-libcephfs2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:23.862 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:23.965 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T16:12:23.977 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:24.013 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.165 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2023-12-19T16:12:24.180 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-rados_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:24.223 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.332 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T16:12:24.347 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T16:12:24.391 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T16:12:24.545 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T16:12:24.560 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:24.595 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.810 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T16:12:24.825 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:24.842 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T16:12:24.857 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-cephfs_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:24.869 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:24.897 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:25.217 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T16:12:25.222 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T16:12:25.232 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:25.236 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T16:12:25.275 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:25.280 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:12:25.612 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T16:12:25.616 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2023-12-19T16:12:25.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T16:12:25.631 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-librgw2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:25.666 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:25.670 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T16:12:25.931 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T16:12:25.946 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-python3-rbd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:25.989 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:26.119 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T16:12:26.134 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:26.177 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:26.292 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T16:12:26.307 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T16:12:26.350 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:12:26.522 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T16:12:26.537 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T16:12:26.580 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:26.678 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2023-12-19T16:12:26.693 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-librgw2_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:26.745 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:26.900 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T16:12:26.915 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:26.949 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:27.206 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T16:12:27.220 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-python3-rgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:27.264 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:27.337 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2023-12-19T16:12:27.351 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-ceph-common_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:27.395 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:27.583 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T16:12:27.598 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T16:12:27.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:12:27.928 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T16:12:27.943 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-libradosstriper1_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:27.986 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:28.415 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2023-12-19T16:12:28.429 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-ceph-common_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:28.473 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:28.501 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2023-12-19T16:12:28.516 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-ceph-base_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:28.568 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:29.247 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T16:12:29.260 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T16:12:29.305 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:29.571 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2023-12-19T16:12:29.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-ceph-base_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:29.633 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T16:12:29.638 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:29.646 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T16:12:29.824 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:12:30.111 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T16:12:30.125 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T16:12:30.161 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T16:12:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T16:12:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:12:30.456 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T16:12:30.470 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T16:12:30.514 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:12:30.686 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T16:12:30.699 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T16:12:30.744 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:12:30.825 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T16:12:30.839 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T16:12:30.900 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:12:31.056 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T16:12:31.069 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T16:12:31.114 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:12:31.162 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T16:12:31.176 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T16:12:31.212 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T16:12:31.392 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T16:12:31.406 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T16:12:31.450 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:12:31.498 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2023-12-19T16:12:31.513 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-19T16:12:31.556 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T16:12:31.762 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T16:12:31.777 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T16:12:31.830 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:12:31.860 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T16:12:31.875 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T16:12:31.918 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T16:12:32.131 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T16:12:32.149 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T16:12:32.190 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T16:12:32.229 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T16:12:32.244 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T16:12:32.279 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:12:32.451 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2023-12-19T16:12:32.465 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-12-19T16:12:32.509 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T16:12:32.600 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T16:12:32.613 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T16:12:32.658 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T16:12:32.971 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T16:12:32.983 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T16:12:32.987 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T16:12:33.003 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T16:12:33.027 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T16:12:33.046 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T16:12:33.330 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T16:12:33.345 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T16:12:33.348 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T16:12:33.363 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T16:12:33.389 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:33.407 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:12:33.717 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2023-12-19T16:12:33.731 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T16:12:33.766 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:12:33.777 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T16:12:33.792 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T16:12:33.835 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T16:12:34.087 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T16:12:34.102 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T16:12:34.145 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:12:34.147 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T16:12:34.162 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T16:12:34.205 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T16:12:34.473 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T16:12:34.488 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T16:12:34.531 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:12:34.584 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T16:12:34.599 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T16:12:34.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:12:34.820 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2023-12-19T16:12:34.835 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T16:12:34.892 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:12:34.903 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2023-12-19T16:12:34.918 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T16:12:34.961 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:12:35.206 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T16:12:35.221 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T16:12:35.267 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:35.340 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T16:12:35.355 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T16:12:35.398 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:12:35.576 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T16:12:35.590 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T16:12:35.634 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:35.701 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T16:12:35.716 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T16:12:35.759 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:12:35.920 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2023-12-19T16:12:35.935 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T16:12:35.978 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:12:36.046 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2023-12-19T16:12:36.061 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T16:12:36.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:12:36.340 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T16:12:36.355 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T16:12:36.398 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:36.415 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T16:12:36.430 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T16:12:36.476 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:12:36.684 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T16:12:36.699 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T16:12:36.743 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:12:36.777 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T16:12:36.791 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T16:12:36.835 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:12:37.030 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T16:12:37.045 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T16:12:37.079 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T16:12:37.180 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2023-12-19T16:12:37.195 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T16:12:37.238 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:12:37.357 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T16:12:37.372 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T16:12:37.415 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:12:37.550 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T16:12:37.564 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T16:12:37.608 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:12:37.796 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T16:12:37.810 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T16:12:37.845 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T16:12:38.052 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T16:12:38.067 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T16:12:38.110 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:12:38.148 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2023-12-19T16:12:38.162 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-19T16:12:38.206 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T16:12:38.422 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T16:12:38.437 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T16:12:38.480 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T16:12:38.501 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T16:12:38.515 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T16:12:38.559 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:12:38.792 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T16:12:38.807 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T16:12:38.842 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:12:38.880 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2023-12-19T16:12:38.894 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T16:12:38.954 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:12:39.172 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T16:12:39.187 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T16:12:39.230 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T16:12:39.250 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T16:12:39.264 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T16:12:39.307 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:12:39.602 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T16:12:39.617 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:39.660 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:39.683 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2023-12-19T16:12:39.698 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-12-19T16:12:39.741 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T16:12:40.016 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T16:12:40.030 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:40.052 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T16:12:40.066 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:40.067 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T16:12:40.111 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:12:40.402 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T16:12:40.416 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T16:12:40.459 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2023-12-19T16:12:40.460 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T16:12:40.474 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T16:12:40.522 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:12:40.805 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T16:12:40.817 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T16:12:40.820 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:40.832 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T16:12:40.863 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:40.875 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:12:41.162 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T16:12:41.176 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:41.183 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T16:12:41.198 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:41.220 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:41.233 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:41.617 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T16:12:41.632 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:41.675 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:41.987 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T16:12:42.003 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T16:12:42.029 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T16:12:42.044 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:42.044 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T16:12:42.087 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:42.390 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T16:12:42.405 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-ceph-mgr_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:42.439 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:42.818 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T16:12:42.832 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mon_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:42.876 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.324 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2023-12-19T16:12:43.339 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:43.390 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.651 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T16:12:43.666 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:43.696 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T16:12:43.712 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-ceph-osd_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:43.754 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:43.907 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:44.063 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T16:12:44.078 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:44.121 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:44.516 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2023-12-19T16:12:44.531 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-cephadm_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:44.575 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:44.819 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T16:12:44.835 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T16:12:44.877 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T16:12:44.966 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2023-12-19T16:12:44.981 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-ceph_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:45.016 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:45.180 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T16:12:45.196 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:45.239 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:45.327 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T16:12:45.342 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-ceph-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:45.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:45.722 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T16:12:45.737 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-ceph-mds_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:45.806 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:46.167 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2023-12-19T16:12:46.182 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-cephadm_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:46.217 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:46.369 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2023-12-19T16:12:46.384 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:46.436 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:46.503 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T16:12:46.519 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T16:12:46.561 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T16:12:46.747 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T16:12:46.761 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T16:12:46.806 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T16:12:46.873 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T16:12:46.888 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:46.931 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:47.176 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T16:12:47.190 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:47.234 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:47.579 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T16:12:47.594 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T16:12:47.637 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:47.870 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2023-12-19T16:12:47.884 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T16:12:47.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:12:47.940 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T16:12:47.955 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T16:12:47.999 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:12:48.277 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2023-12-19T16:12:48.292 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-19T16:12:48.326 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T16:12:48.431 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T16:12:48.446 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T16:12:48.490 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T16:12:48.664 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T16:12:48.679 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T16:12:48.722 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:48.834 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T16:12:48.849 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:48.893 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:49.025 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2023-12-19T16:12:49.040 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-19T16:12:49.083 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T16:12:49.256 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T16:12:49.271 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T16:12:49.313 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:12:49.403 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T16:12:49.418 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T16:12:49.461 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:12:49.616 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T16:12:49.631 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T16:12:49.674 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:12:49.815 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T16:12:49.830 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T16:12:49.873 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:49.944 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2023-12-19T16:12:49.960 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-12-19T16:12:49.994 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T16:12:50.143 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2023-12-19T16:12:50.158 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T16:12:50.193 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:50.323 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T16:12:50.338 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T16:12:50.373 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T16:12:50.505 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T16:12:50.520 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:50.563 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:50.684 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2023-12-19T16:12:50.699 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-12-19T16:12:50.742 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T16:12:50.966 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T16:12:50.981 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T16:12:51.017 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:51.062 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T16:12:51.077 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T16:12:51.120 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:12:51.449 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T16:12:51.464 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T16:12:51.503 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T16:12:51.507 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T16:12:51.518 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T16:12:51.587 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:51.810 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2023-12-19T16:12:51.825 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T16:12:51.894 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:12:51.940 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T16:12:51.955 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T16:12:51.998 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:52.239 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T16:12:52.254 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:52.285 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T16:12:52.297 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:52.299 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T16:12:52.334 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:12:52.675 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T16:12:52.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T16:12:52.759 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:12:53.096 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T16:12:53.110 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:53.154 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:53.379 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T16:12:53.393 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T16:12:53.437 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:12:53.832 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T16:12:53.846 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T16:12:53.893 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:12:54.082 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T16:12:54.098 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T16:12:54.140 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:54.160 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T16:12:54.174 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T16:12:54.210 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:12:54.444 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T16:12:54.460 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T16:12:54.502 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:12:54.822 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T16:12:54.838 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T16:12:54.872 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:12:55.037 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T16:12:55.051 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:55.096 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:55.175 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T16:12:55.190 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-19T16:12:55.233 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T16:12:55.579 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T16:12:55.595 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T16:12:55.637 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T16:12:55.941 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T16:12:55.956 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T16:12:55.998 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:12:56.066 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T16:12:56.081 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T16:12:56.124 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T16:12:56.285 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T16:12:56.300 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T16:12:56.334 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T16:12:56.427 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T16:12:56.442 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T16:12:56.485 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:12:56.647 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T16:12:56.663 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T16:12:56.705 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:12:56.797 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T16:12:56.812 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T16:12:56.855 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:12:57.185 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T16:12:57.199 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-12-19T16:12:57.241 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T16:12:57.369 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T16:12:57.383 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:57.427 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:57.562 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T16:12:57.577 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T16:12:57.620 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T16:12:57.738 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T16:12:57.753 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T16:12:57.788 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:12:57.965 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T16:12:57.981 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T16:12:58.015 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:12:58.117 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T16:12:58.131 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:58.175 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:12:58.293 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T16:12:58.308 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T16:12:58.351 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T16:12:58.419 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2023-12-19T16:12:58.434 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:12:58.486 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T16:12:58.671 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T16:12:58.687 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T16:12:58.730 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:12:58.738 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2023-12-19T16:12:58.753 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T16:12:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:12:59.100 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T16:12:59.116 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T16:12:59.186 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:12:59.394 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T16:12:59.408 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:12:59.452 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:59.538 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2023-12-19T16:12:59.553 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-ceph-test_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:12:59.596 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:12:59.796 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T16:12:59.811 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T16:12:59.854 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:13:00.158 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T16:13:00.172 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:13:00.208 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:13:00.444 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2023-12-19T16:13:00.458 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T16:13:00.523 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T16:13:00.780 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2023-12-19T16:13:00.794 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T16:13:00.838 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:13:01.143 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T16:13:01.158 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T16:13:01.193 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:13:01.564 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2023-12-19T16:13:01.578 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-ceph-test_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:01.622 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:01.692 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T16:13:01.707 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:01.750 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:02.155 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T16:13:02.170 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:02.213 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:02.491 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T16:13:02.507 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T16:13:02.549 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T16:13:02.794 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T16:13:02.809 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:02.852 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:03.113 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T16:13:03.129 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:03.171 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:03.443 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T16:13:03.449 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T16:13:03.463 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-ceph-volume_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:03.465 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:03.507 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:03.693 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:03.878 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T16:13:03.893 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T16:13:03.936 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:13:04.030 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T16:13:04.046 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:04.080 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:04.274 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T16:13:04.290 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T16:13:04.332 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:13:04.400 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T16:13:04.416 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T16:13:04.458 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T16:13:04.702 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T16:13:04.718 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-cephfs-shell_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:04.761 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:04.794 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T16:13:04.810 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T16:13:04.852 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:05.072 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T16:13:05.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-cephfs-top_18.2.1-132-g568df92b-1jammy_all.deb ... 2023-12-19T16:13:05.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:05.122 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T16:13:05.137 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T16:13:05.172 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T16:13:05.341 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T16:13:05.356 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:05.408 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:05.625 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T16:13:05.641 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T16:13:05.683 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:13:05.769 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T16:13:05.784 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T16:13:05.852 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:13:06.171 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T16:13:06.185 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T16:13:06.190 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T16:13:06.205 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T16:13:06.229 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:13:06.248 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:13:06.499 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T16:13:06.513 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T16:13:06.557 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:13:06.652 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T16:13:06.667 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T16:13:06.727 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:06.843 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T16:13:06.858 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T16:13:06.901 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:13:07.041 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T16:13:07.053 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T16:13:07.088 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T16:13:07.432 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T16:13:07.448 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T16:13:07.491 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:13:07.605 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2023-12-19T16:13:07.619 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-radosgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:07.664 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:07.961 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T16:13:07.976 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T16:13:08.019 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:13:08.233 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T16:13:08.248 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:08.292 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:08.306 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T16:13:08.321 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T16:13:08.355 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:13:08.585 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T16:13:08.641 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T16:13:08.656 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T16:13:08.699 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:13:08.838 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:13:08.939 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:13:09.196 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T16:13:09.454 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2023-12-19T16:13:09.468 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-radosgw_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:09.511 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:09.621 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T16:13:10.073 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T16:13:10.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-rbd-fuse_18.2.1-132-g568df92b-1jammy_amd64.deb ... 2023-12-19T16:13:10.131 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:10.238 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T16:13:10.281 INFO:teuthology.orchestra.run.smithi162.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T16:13:10.324 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:10.456 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T16:13:10.702 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T16:13:10.820 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T16:13:10.862 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2023-12-19T16:13:11.014 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:13:11.076 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T16:13:11.307 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:13:11.473 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T16:13:11.575 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:13:11.701 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:13:11.961 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T16:13:12.088 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T16:13:12.103 INFO:teuthology.orchestra.run.smithi073.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T16:13:12.146 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:12.254 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:13:12.371 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T16:13:12.665 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:13:12.700 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2023-12-19T16:13:12.877 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T16:13:13.034 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T16:13:13.154 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T16:13:13.302 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T16:13:13.430 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T16:13:13.556 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T16:13:13.588 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T16:13:13.840 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T16:13:13.856 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:13:14.108 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T16:13:14.132 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:13:14.226 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T16:13:14.400 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:13:14.519 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T16:13:14.734 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:14.896 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T16:13:15.010 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:13:15.136 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T16:13:15.164 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T16:13:15.421 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:13:15.432 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T16:13:15.672 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:13:15.733 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T16:13:15.798 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T16:13:15.984 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T16:13:16.157 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:16.280 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T16:13:16.283 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T16:13:16.560 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:13:16.628 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:16.886 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:13:16.896 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T16:13:17.022 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T16:13:17.315 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T16:13:17.337 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:13:17.582 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T16:13:17.708 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T16:13:18.039 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:13:18.077 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:18.194 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T16:13:18.317 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:13:18.441 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:13:18.462 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T16:13:18.567 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:13:18.738 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T16:13:18.893 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T16:13:19.114 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T16:13:19.303 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T16:13:19.612 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:13:19.808 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T16:13:19.989 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:13:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T16:13:20.193 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T16:13:20.290 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T16:13:20.310 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T16:13:20.608 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:13:20.628 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T16:13:20.993 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:13:21.029 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T16:13:21.269 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:13:21.289 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T16:13:21.428 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:21.682 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T16:13:21.738 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T16:13:21.984 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T16:13:22.081 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:13:22.327 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T16:13:22.661 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T16:13:22.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T16:13:23.046 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:23.336 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:23.380 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T16:13:23.471 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T16:13:23.722 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:13:23.731 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T16:13:23.823 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:13:23.949 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:13:24.250 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:13:24.518 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T16:13:24.786 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:24.920 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:13:24.946 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:25.038 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:13:25.080 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T16:13:25.339 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:13:25.356 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T16:13:25.482 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T16:13:25.590 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T16:13:25.608 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T16:13:25.858 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T16:13:25.910 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T16:13:26.129 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:13:26.186 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T16:13:26.385 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T16:13:26.445 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:26.571 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-12-19T16:13:26.653 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:13:26.714 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T16:13:26.771 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T16:13:27.032 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T16:13:27.038 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:13:27.164 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:13:27.308 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T16:13:27.466 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:13:27.567 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T16:13:27.775 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:13:27.819 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T16:13:28.043 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:28.078 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T16:13:28.370 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T16:13:28.469 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T16:13:28.496 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T16:13:28.739 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:13:28.797 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T16:13:28.863 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:13:28.924 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T16:13:29.233 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T16:13:29.257 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:13:29.532 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T16:13:29.534 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T16:13:29.777 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T16:13:29.792 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:29.918 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T16:13:30.165 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T16:13:30.252 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:13:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T16:13:30.554 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:13:30.564 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T16:13:30.830 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T16:13:30.956 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T16:13:30.965 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T16:13:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T16:13:31.232 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T16:13:31.468 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T16:13:31.516 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:13:31.594 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T16:13:31.784 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:13:31.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T16:13:32.168 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:32.246 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T16:13:32.470 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:13:32.530 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T16:13:32.681 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T16:13:32.814 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:13:32.940 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:32.966 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T16:13:33.066 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:33.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T16:13:33.269 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:33.379 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:33.488 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:33.527 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T16:13:33.589 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T16:13:33.882 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:33.919 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T16:13:34.008 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:34.151 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:34.363 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:34.363 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:34.512 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T16:13:34.873 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T16:13:34.978 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:34.998 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.095 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.133 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.205 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.306 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:13:35.374 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.504 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.630 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:35.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T16:13:36.049 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.167 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.293 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.504 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:36.504 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T16:13:36.568 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.703 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.862 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:36.988 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.115 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.187 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.240 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:37.803 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2023-12-19T16:13:37.882 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T16:13:38.204 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2023-12-19T16:13:38.390 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2023-12-19T16:13:38.408 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T16:13:38.551 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T16:13:38.958 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T16:13:39.203 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.329 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.455 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.581 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.633 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.732 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:39.824 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:39.824 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:39.858 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:40.371 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2023-12-19T16:13:40.434 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:40.569 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:40.787 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2023-12-19T16:13:40.974 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2023-12-19T16:13:40.991 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T16:13:41.102 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:41.102 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:41.133 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T16:13:41.528 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T16:13:41.712 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:42.068 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T16:13:42.201 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:42.436 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:42.436 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T16:13:43.044 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:43.178 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:43.262 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:43.492 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:43.493 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:43.714 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:43.714 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T16:13:44.123 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:44.337 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:44.337 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:44.347 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:44.739 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T16:13:44.949 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:45.266 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:45.266 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:45.399 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:45.638 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:45.638 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T16:13:45.892 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:46.018 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:46.136 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:46.267 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:46.363 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:46.364 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:46.472 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:46.472 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T16:13:46.996 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:47.127 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:47.138 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:47.264 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:47.399 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:47.426 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:47.426 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T16:13:47.760 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:13:48.028 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:48.154 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:48.297 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:48.531 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:48.532 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T16:13:48.877 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:13:49.140 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:49.308 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:49.363 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:13:49.369 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T16:13:49.417 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:49.444 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2023-12-19T16:13:49.543 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1jammy) ... 2023-12-19T16:13:49.613 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2023-12-19T16:13:49.614 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T16:13:49.768 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:13:49.769 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:13:49.770 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T16:13:49.771 INFO:teuthology.orchestra.run.smithi162.stdout: libengine-pkcs11-openssl 2023-12-19T16:13:49.821 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T16:13:49.822 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T16:13:49.823 INFO:teuthology.orchestra.run.smithi162.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:49.823 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2023-12-19T16:13:49.824 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 2023-12-19T16:13:49.880 INFO:teuthology.orchestra.run.smithi162.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T16:13:49.880 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 54.6 MB of archives. 2023-12-19T16:13:49.880 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T16:13:49.880 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T16:13:49.896 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:13:49.983 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T16:13:50.039 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T16:13:50.047 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T16:13:50.048 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T16:13:50.049 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T16:13:50.050 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T16:13:50.051 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T16:13:50.052 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T16:13:50.053 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T16:13:50.053 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T16:13:50.058 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T16:13:50.071 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T16:13:50.279 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T16:13:50.281 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T16:13:50.281 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T16:13:50.284 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T16:13:50.285 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T16:13:50.289 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T16:13:50.291 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T16:13:50.297 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T16:13:50.298 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T16:13:50.319 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T16:13:50.319 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T16:13:50.329 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T16:13:50.349 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T16:13:50.352 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T16:13:50.353 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T16:13:50.354 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T16:13:50.354 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T16:13:50.365 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T16:13:50.367 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T16:13:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T16:13:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T16:13:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T16:13:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T16:13:50.509 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T16:13:50.510 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T16:13:50.522 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T16:13:50.523 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T16:13:50.898 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2023-12-19T16:13:51.059 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 54.6 MB in 1s (79.0 MB/s) 2023-12-19T16:13:51.130 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:13:51.200 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2023-12-19T16:13:51.273 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-19T16:13:51.277 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:51.324 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T16:13:51.632 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:13:51.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T16:13:51.711 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T16:13:51.878 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-12-19T16:13:51.879 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-12-19T16:13:51.902 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T16:13:52.033 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T16:13:52.034 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T16:13:52.034 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T16:13:52.034 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T16:13:52.034 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-12-19T16:13:52.035 INFO:teuthology.orchestra.run.smithi073.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T16:13:52.035 INFO:teuthology.orchestra.run.smithi073.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T16:13:52.035 INFO:teuthology.orchestra.run.smithi073.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T16:13:52.035 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T16:13:52.035 INFO:teuthology.orchestra.run.smithi073.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:52.036 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-12-19T16:13:52.036 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T16:13:52.036 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T16:13:52.036 INFO:teuthology.orchestra.run.smithi073.stdout: libengine-pkcs11-openssl 2023-12-19T16:13:52.080 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T16:13:52.085 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-12-19T16:13:52.085 INFO:teuthology.orchestra.run.smithi073.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T16:13:52.085 INFO:teuthology.orchestra.run.smithi073.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T16:13:52.086 INFO:teuthology.orchestra.run.smithi073.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T16:13:52.086 INFO:teuthology.orchestra.run.smithi073.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T16:13:52.086 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T16:13:52.086 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T16:13:52.086 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T16:13:52.087 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-12-19T16:13:52.088 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 2023-12-19T16:13:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T16:13:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 54.6 MB of archives. 2023-12-19T16:13:52.142 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T16:13:52.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T16:13:52.245 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T16:13:52.301 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T16:13:52.309 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T16:13:52.309 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T16:13:52.311 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T16:13:52.312 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T16:13:52.313 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T16:13:52.314 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T16:13:52.315 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T16:13:52.315 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T16:13:52.320 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T16:13:52.333 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T16:13:52.460 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:52.561 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T16:13:52.563 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T16:13:52.563 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T16:13:52.567 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T16:13:52.567 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T16:13:52.571 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T16:13:52.573 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T16:13:52.580 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T16:13:52.580 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T16:13:52.603 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T16:13:52.603 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T16:13:52.613 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T16:13:52.636 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T16:13:52.640 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T16:13:52.640 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T16:13:52.641 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T16:13:52.642 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T16:13:52.654 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T16:13:52.656 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T16:13:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T16:13:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T16:13:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T16:13:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T16:13:52.810 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T16:13:52.811 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T16:13:52.823 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T16:13:52.823 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T16:13:53.039 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2023-12-19T16:13:53.111 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-19T16:13:53.114 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:53.166 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:13:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2023-12-19T16:13:53.354 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 54.6 MB in 1s (74.9 MB/s) 2023-12-19T16:13:53.470 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2023-12-19T16:13:53.543 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-12-19T16:13:53.546 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:53.584 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T16:13:53.597 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T16:13:53.610 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T16:13:53.642 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:53.953 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package dump. 2023-12-19T16:13:53.967 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T16:13:54.003 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T16:13:54.163 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:13:54.315 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package indent. 2023-12-19T16:13:54.329 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:54.341 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T16:13:54.373 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:13:54.634 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T16:13:54.648 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T16:13:54.693 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:54.765 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:13:55.021 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T16:13:55.035 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T16:13:55.079 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:55.299 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T16:13:55.313 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T16:13:55.343 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2023-12-19T16:13:55.357 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:55.415 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-12-19T16:13:55.419 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T16:13:55.478 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:13:55.727 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T16:13:55.741 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:55.785 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:55.988 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T16:13:56.003 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T16:13:56.038 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T16:13:56.038 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:13:56.052 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:56.096 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:56.340 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T16:13:56.355 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T16:13:56.390 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T16:13:56.393 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2023-12-19T16:13:56.409 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T16:13:56.452 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T16:13:56.660 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T16:13:56.675 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T16:13:56.718 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:56.739 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2023-12-19T16:13:56.754 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:13:56.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:13:57.032 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T16:13:57.048 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T16:13:57.100 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:13:57.586 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T16:13:57.602 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T16:13:57.645 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:13:57.897 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T16:13:57.913 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T16:13:57.972 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:13:58.096 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T16:13:58.111 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:58.154 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:58.317 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T16:13:58.332 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:58.375 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:58.440 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T16:13:58.455 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:13:58.498 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:13:58.619 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T16:13:58.635 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T16:13:58.669 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:13:58.792 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T16:13:58.808 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:13:58.851 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:13:58.922 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T16:13:58.938 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T16:13:58.980 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T16:13:59.195 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T16:13:59.210 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T16:13:59.253 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:13:59.300 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T16:13:59.315 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T16:13:59.358 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:13:59.564 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T16:13:59.580 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:13:59.622 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:13:59.950 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T16:13:59.966 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:00.000 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:00.303 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T16:14:00.319 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:00.361 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:00.664 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T16:14:00.680 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:00.722 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:00.735 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T16:14:00.751 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:14:00.841 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:00.966 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T16:14:00.981 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:14:01.041 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:14:01.071 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T16:14:01.087 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T16:14:01.122 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:01.449 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T16:14:01.464 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:14:01.499 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:01.561 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T16:14:01.577 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T16:14:01.619 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:14:01.818 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T16:14:01.834 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T16:14:01.877 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:14:01.947 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package modemmanager. 2023-12-19T16:14:01.963 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:14:01.997 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:02.204 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T16:14:02.220 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:14:02.288 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:14:02.603 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager. 2023-12-19T16:14:02.619 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:14:02.632 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T16:14:02.647 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:02.669 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:14:02.690 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:03.029 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T16:14:03.042 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:03.076 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:03.285 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ppp. 2023-12-19T16:14:03.301 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T16:14:03.379 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T16:14:03.394 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:03.437 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:03.672 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:14:03.681 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T16:14:03.696 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T16:14:03.731 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:14:03.998 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T16:14:04.012 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T16:14:04.057 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T16:14:04.301 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T16:14:04.309 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T16:14:04.315 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T16:14:04.323 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T16:14:04.359 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:14:04.376 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T16:14:04.662 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package modemmanager. 2023-12-19T16:14:04.676 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T16:14:04.679 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T16:14:04.693 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T16:14:04.712 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:04.737 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T16:14:05.025 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T16:14:05.040 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:05.082 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:05.318 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager. 2023-12-19T16:14:05.332 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T16:14:05.384 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:14:05.672 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T16:14:05.688 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T16:14:05.749 INFO:teuthology.orchestra.run.smithi162.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T16:14:05.780 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-common (238) ... 2023-12-19T16:14:06.238 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T16:14:06.254 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:06.290 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:06.409 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ppp. 2023-12-19T16:14:06.424 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T16:14:06.768 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:14:07.072 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T16:14:07.086 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T16:14:07.130 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T16:14:07.365 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql. 2023-12-19T16:14:07.374 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T16:14:07.380 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T16:14:07.389 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T16:14:07.423 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql (14+238) ... 2023-12-19T16:14:07.466 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T16:14:07.659 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T16:14:07.673 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T16:14:07.717 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T16:14:07.777 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T16:14:07.791 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T16:14:07.836 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T16:14:07.961 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T16:14:07.975 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T16:14:08.019 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T16:14:08.139 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T16:14:08.153 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:08.197 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:08.347 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T16:14:08.362 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T16:14:08.405 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:14:08.699 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl. 2023-12-19T16:14:08.715 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T16:14:08.762 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T16:14:08.794 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T16:14:08.808 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T16:14:08.861 INFO:teuthology.orchestra.run.smithi073.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T16:14:08.892 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-common (238) ... 2023-12-19T16:14:09.110 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T16:14:09.126 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T16:14:09.160 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:14:09.367 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T16:14:09.382 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T16:14:09.429 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:09.498 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T16:14:09.513 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T16:14:09.556 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T16:14:09.934 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T16:14:09.950 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T16:14:10.000 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:14:10.285 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T16:14:10.548 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T16:14:10.570 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql. 2023-12-19T16:14:10.585 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T16:14:10.620 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql (14+238) ... 2023-12-19T16:14:10.674 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:14:10.817 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:10.822 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T16:14:10.837 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T16:14:10.881 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T16:14:10.942 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:14:11.068 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:14:11.149 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T16:14:11.164 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T16:14:11.203 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:11.208 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T16:14:11.671 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T16:14:11.685 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T16:14:11.720 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:14:12.015 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package tcl. 2023-12-19T16:14:12.029 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T16:14:12.078 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T16:14:12.207 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T16:14:12.300 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:14:12.426 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T16:14:12.441 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T16:14:12.484 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:14:12.679 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:14:12.679 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:14:12.863 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T16:14:12.879 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T16:14:12.922 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T16:14:13.283 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T16:14:13.299 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T16:14:13.342 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:14:13.361 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:14:13.479 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:14:13.585 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T16:14:13.634 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T16:14:13.822 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T16:14:13.949 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T16:14:14.064 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:14:14.074 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:14.190 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:14:14.200 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T16:14:14.316 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:14:14.326 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T16:14:14.442 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:14:14.474 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:15.105 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:14:15.231 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T16:14:15.326 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T16:14:15.391 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:15.478 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T16:14:15.517 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:14:15.575 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T16:14:15.643 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T16:14:15.769 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T16:14:15.928 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:14:15.963 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:14:15.964 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T16:14:16.018 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T16:14:16.080 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:14:16.197 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:14:16.374 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:14:16.500 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:16.626 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T16:14:16.662 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T16:14:16.779 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T16:14:16.785 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T16:14:16.886 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:14:16.888 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T16:14:17.081 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T16:14:17.249 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T16:14:17.400 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T16:14:17.462 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:17.462 INFO:teuthology.orchestra.run.smithi162.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T16:14:17.463 INFO:teuthology.orchestra.run.smithi162.stdout:which means they are currently configured by ifupdown: 2023-12-19T16:14:17.463 INFO:teuthology.orchestra.run.smithi162.stdout:- enp3s0f1 2023-12-19T16:14:17.463 INFO:teuthology.orchestra.run.smithi162.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T16:14:17.463 INFO:teuthology.orchestra.run.smithi162.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T16:14:17.463 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:17.551 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T16:14:17.595 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T16:14:18.017 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T16:14:18.418 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T16:14:18.900 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T16:14:19.097 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:19.139 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T16:14:19.231 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:14:19.318 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T16:14:19.357 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T16:14:19.425 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:19.484 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-common (238) ... 2023-12-19T16:14:19.702 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T16:14:19.820 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T16:14:19.921 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T16:14:20.039 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T16:14:20.129 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T16:14:20.199 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T16:14:20.325 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T16:14:20.415 INFO:teuthology.orchestra.run.smithi162.stdout:Adding user postgres to group ssl-cert 2023-12-19T16:14:20.501 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T16:14:20.669 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:20.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:20.714 INFO:teuthology.orchestra.run.smithi162.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T16:14:20.803 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T16:14:20.972 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T16:14:20.978 INFO:teuthology.orchestra.run.smithi162.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T16:14:20.978 INFO:teuthology.orchestra.run.smithi162.stdout:Removing obsolete dictionary files: 2023-12-19T16:14:21.123 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T16:14:21.659 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T16:14:21.867 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:21.867 INFO:teuthology.orchestra.run.smithi073.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T16:14:21.867 INFO:teuthology.orchestra.run.smithi073.stdout:which means they are currently configured by ifupdown: 2023-12-19T16:14:21.867 INFO:teuthology.orchestra.run.smithi073.stdout:- enp3s0f1 2023-12-19T16:14:21.867 INFO:teuthology.orchestra.run.smithi073.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T16:14:21.868 INFO:teuthology.orchestra.run.smithi073.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T16:14:21.868 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:22.001 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T16:14:22.137 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:22.406 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T16:14:22.464 INFO:teuthology.orchestra.run.smithi162.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T16:14:22.503 INFO:teuthology.orchestra.run.smithi162.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:This user must also own the server process. 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:The default text search configuration will be set to "english". 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout:Data page checksums are disabled. 2023-12-19T16:14:22.581 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:22.582 INFO:teuthology.orchestra.run.smithi162.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T16:14:22.582 INFO:teuthology.orchestra.run.smithi162.stdout:creating subdirectories ... ok 2023-12-19T16:14:22.582 INFO:teuthology.orchestra.run.smithi162.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T16:14:22.606 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default max_connections ... 100 2023-12-19T16:14:22.642 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default shared_buffers ... 128MB 2023-12-19T16:14:22.656 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default time zone ... Etc/UTC 2023-12-19T16:14:22.657 INFO:teuthology.orchestra.run.smithi162.stdout:creating configuration files ... ok 2023-12-19T16:14:22.810 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T16:14:22.828 INFO:teuthology.orchestra.run.smithi162.stdout:running bootstrap script ... ok 2023-12-19T16:14:23.460 INFO:teuthology.orchestra.run.smithi162.stdout:performing post-bootstrap initialization ... ok 2023-12-19T16:14:23.484 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T16:14:23.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T16:14:23.803 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T16:14:23.929 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-common (238) ... 2023-12-19T16:14:24.032 INFO:teuthology.orchestra.run.smithi162.stdout:syncing data to disk ... ok 2023-12-19T16:14:24.563 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T16:14:24.955 INFO:teuthology.orchestra.run.smithi073.stdout:Adding user postgres to group ssl-cert 2023-12-19T16:14:25.289 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:25.289 INFO:teuthology.orchestra.run.smithi073.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T16:14:25.556 INFO:teuthology.orchestra.run.smithi073.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T16:14:25.556 INFO:teuthology.orchestra.run.smithi073.stdout:Removing obsolete dictionary files: 2023-12-19T16:14:26.258 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T16:14:26.714 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T16:14:27.077 INFO:teuthology.orchestra.run.smithi073.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T16:14:27.097 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout:This user must also own the server process. 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T16:14:27.146 INFO:teuthology.orchestra.run.smithi073.stdout:The default text search configuration will be set to "english". 2023-12-19T16:14:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:27.147 INFO:teuthology.orchestra.run.smithi073.stdout:Data page checksums are disabled. 2023-12-19T16:14:27.147 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:27.147 INFO:teuthology.orchestra.run.smithi073.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T16:14:27.148 INFO:teuthology.orchestra.run.smithi073.stdout:creating subdirectories ... ok 2023-12-19T16:14:27.148 INFO:teuthology.orchestra.run.smithi073.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T16:14:27.172 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default max_connections ... 100 2023-12-19T16:14:27.207 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default shared_buffers ... 128MB 2023-12-19T16:14:27.221 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default time zone ... Etc/UTC 2023-12-19T16:14:27.221 INFO:teuthology.orchestra.run.smithi073.stdout:creating configuration files ... ok 2023-12-19T16:14:27.390 INFO:teuthology.orchestra.run.smithi073.stdout:running bootstrap script ... ok 2023-12-19T16:14:28.033 INFO:teuthology.orchestra.run.smithi073.stdout:performing post-bootstrap initialization ... ok 2023-12-19T16:14:28.058 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:28.184 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T16:14:28.310 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql (14+238) ... 2023-12-19T16:14:28.420 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:28.521 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:28.570 INFO:teuthology.orchestra.run.smithi073.stdout:syncing data to disk ... ok 2023-12-19T16:14:28.764 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:28.765 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:29.081 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T16:14:29.498 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T16:14:29.825 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:14:29.976 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:14:30.735 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T16:14:30.844 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T16:14:31.513 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:14:31.520 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:32.114 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:32.265 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T16:14:32.416 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql (14+238) ... 2023-12-19T16:14:32.567 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T16:14:32.734 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T16:14:33.020 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:33.020 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T16:14:33.770 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T16:14:34.089 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T16:14:34.257 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T16:14:35.499 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T16:14:35.608 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T16:14:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T16:14:36.303 DEBUG:teuthology.parallel:result is None 2023-12-19T16:14:36.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:14:36.662 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2023-12-19T16:14:36.685 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:36.686 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:36.686 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1jammy is installed. 2023-12-19T16:14:36.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T16:14:36.986 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2023-12-19T16:14:37.010 INFO:teuthology.orchestra.run.smithi162.stdout:18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:37.011 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1jammy 2023-12-19T16:14:37.011 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1jammy is installed. 2023-12-19T16:14:37.012 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T16:14:37.012 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:37.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:14:37.034 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:37.034 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T16:14:37.075 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T16:14:37.075 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:37.075 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:14:37.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:14:37.157 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:37.157 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T16:14:37.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T16:14:37.242 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T16:14:37.242 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:37.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:14:37.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:14:37.328 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:37.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T16:14:37.350 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T16:14:37.415 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T16:14:37.415 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:37.415 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:14:37.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:14:37.496 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:37.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T16:14:37.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T16:14:37.587 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T16:14:37.650 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T16:14:37.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-12-19T16:14:37.654 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2023-12-19T16:14:37.675 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T16:14:37.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:14:37.716 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T16:14:37.738 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T16:14:37.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:14:37.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T16:14:37.809 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T16:14:37.809 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T16:14:37.809 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T16:14:37.810 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:37.810 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:14:37.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:37.947 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:37.947 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T16:14:37.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:38.053 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T16:14:38.053 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T16:14:38.053 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497085', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInDLi1AFFTt3MoUz8HB1H03wHVWr3R8Ptq8tUF5pl9TNvdp8tSsW5kO1j+yiA3X9JWfS1DBTbfv/aYV41/wuM0=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPFLXSm6+i1LOeP5iPKcIiRuNcrfZzkykShcP7JpKo5zy4wU5MSBjoDIqe6dgc1t7ynLPQO+ib6nTonicoy9aw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_openfiletable']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_13:22:41', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T16:14:38.054 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:14:38.058 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T16:14:38.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:14:38.112 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T16:14:38.134 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:38.134 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:14:38.178 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:14:38.178 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-12-19T16:14:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:14:38.233 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:38.233 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 890 Links: 1 2023-12-19T16:14:38.234 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:38.234 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 16:08:01.145431225 +0000 2023-12-19T16:14:38.234 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 16:08:00.749434763 +0000 2023-12-19T16:14:38.234 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 16:08:00.749434763 +0000 2023-12-19T16:14:38.234 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-19 16:08:00.749434763 +0000 2023-12-19T16:14:38.234 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:14:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:14:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:14:38.295 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000352071 s, 1.5 MB/s 2023-12-19T16:14:38.297 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:14:38.349 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-12-19T16:14:38.397 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:14:38.397 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 16:08:01.845424973 +0000 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 16:08:01.433428653 +0000 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 16:08:01.433428653 +0000 2023-12-19T16:14:38.398 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-19 16:08:01.433428653 +0000 2023-12-19T16:14:38.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:14:38.458 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:14:38.458 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:14:38.458 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000349953 s, 1.5 MB/s 2023-12-19T16:14:38.460 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:14:38.511 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 925 Links: 1 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 16:08:02.621418041 +0000 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 16:08:02.237421471 +0000 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 16:08:02.237421471 +0000 2023-12-19T16:14:38.566 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-19 16:08:02.237421471 +0000 2023-12-19T16:14:38.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:14:38.627 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:14:38.627 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:14:38.627 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000346492 s, 1.5 MB/s 2023-12-19T16:14:38.628 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:14:38.679 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 16:08:02.893415612 +0000 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 16:08:02.889415648 +0000 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 16:08:02.889415648 +0000 2023-12-19T16:14:38.735 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2023-12-19 16:08:02.889415648 +0000 2023-12-19T16:14:38.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:14:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:14:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:14:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000359881 s, 1.4 MB/s 2023-12-19T16:14:38.797 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:14:38.847 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:38.847 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:38.848 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T16:14:38.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T16:14:38.857 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2023-12-19T16:14:38.906 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 890 Links: 1 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-12-19 16:08:01.175624679 +0000 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-12-19 16:08:00.775628252 +0000 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-12-19 16:08:00.775628252 +0000 2023-12-19T16:14:38.907 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-12-19 16:08:00.775628252 +0000 2023-12-19T16:14:38.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T16:14:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-12-19T16:14:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-12-19T16:14:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000381323 s, 1.3 MB/s 2023-12-19T16:14:38.975 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T16:14:39.028 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2023-12-19T16:14:39.078 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T16:14:39.078 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 909 Links: 1 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-12-19 16:08:01.471622034 +0000 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-12-19 16:08:01.467622070 +0000 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-12-19 16:08:01.467622070 +0000 2023-12-19T16:14:39.079 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-12-19 16:08:01.467622070 +0000 2023-12-19T16:14:39.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-12-19T16:14:39.145 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000385951 s, 1.3 MB/s 2023-12-19T16:14:39.147 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T16:14:39.204 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2023-12-19T16:14:39.259 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T16:14:39.259 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:39.259 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 923 Links: 1 2023-12-19T16:14:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-12-19 16:08:02.167615818 +0000 2023-12-19T16:14:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-12-19 16:08:02.163615854 +0000 2023-12-19T16:14:39.260 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-12-19 16:08:02.163615854 +0000 2023-12-19T16:14:39.261 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-12-19 16:08:02.163615854 +0000 2023-12-19T16:14:39.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T16:14:39.321 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-12-19T16:14:39.321 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-12-19T16:14:39.321 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000382377 s, 1.3 MB/s 2023-12-19T16:14:39.323 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T16:14:39.380 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2023-12-19T16:14:39.435 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T16:14:39.435 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 943 Links: 1 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2023-12-19 16:08:03.235606277 +0000 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2023-12-19 16:08:02.843609780 +0000 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2023-12-19 16:08:02.843609780 +0000 2023-12-19T16:14:39.436 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2023-12-19 16:08:02.843609780 +0000 2023-12-19T16:14:39.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T16:14:39.501 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2023-12-19T16:14:39.501 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2023-12-19T16:14:39.501 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000404081 s, 1.3 MB/s 2023-12-19T16:14:39.503 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T16:14:39.561 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:39.561 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:14:39.561 INFO:tasks.ceph:Generating config... 2023-12-19T16:14:39.562 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T16:14:39.563 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T16:14:39.563 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T16:14:39.563 INFO:tasks.ceph:[client] pid file = 2023-12-19T16:14:39.563 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T16:14:39.563 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T16:14:39.563 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T16:14:39.563 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T16:14:39.564 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T16:14:39.564 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T16:14:39.565 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T16:14:39.565 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T16:14:39.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T16:14:39.610 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T16:14:39.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T16:14:39.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:39.750 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2023-12-19T16:14:39.751 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T16:14:39.752 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:39.752 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:14:39.802 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:39.891 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:39.962 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:14:39.962 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-12-19T16:14:39.962 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2023-12-19T16:14:39.962 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2023-12-19T16:14:39.892461+0000 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-12-19T16:14:39.892461+0000 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2023-12-19T16:14:39.963 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2023-12-19T16:14:39.964 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T16:14:39.969 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T16:14:39.977 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90ec874a-c348-4a69-99d9-d4bef3b9261d... 2023-12-19T16:14:39.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:14:40.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:14:40.073 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-12-19T16:14:40.073 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-12-19T16:14:40.073 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-12-19T16:14:40.074 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:14:40.075 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:14:40.076 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.077 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2023-12-19T16:14:40.078 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:14:40.079 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:14:40.080 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.081 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-12-19T16:14:40.082 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-12-19T16:14:40.083 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-12-19T16:14:40.084 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-12-19T16:14:40.084 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:14:40.084 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:14:40.084 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:14:40.090 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T16:14:40.090 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T16:14:40.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T16:14:40.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:14:40.093 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T16:14:40.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T16:14:40.095 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:14:40.096 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:14:40.097 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:14:40.098 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:14:40.099 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:14:40.100 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:14:40.106 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T16:14:40.106 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T16:14:40.209 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T16:14:40.210 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:40.210 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T16:14:40.220 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:40.220 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T16:14:40.270 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:14:40.270 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:40.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:14:40.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:40.345 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:14:40.345 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:40.398 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:14:40.398 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:40.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T16:14:40.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T16:14:40.434 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:14:40.434 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:40.490 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T16:14:40.490 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T16:14:40.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:14:40.547 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T16:14:40.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:14:40.612 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T16:14:40.625 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T16:14:40.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:14:40.682 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T16:14:40.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T16:14:40.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:14:40.805 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T16:14:40.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T16:14:40.829 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:14:40.890 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T16:14:40.895 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T16:14:40.916 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T16:14:41.014 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T16:14:41.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T16:14:41.039 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T16:14:41.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T16:14:41.082 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T16:14:41.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-19T16:14:41.183 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-19T16:14:41.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T16:14:41.243 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T16:14:41.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-19T16:14:41.343 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-19T16:14:41.360 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T16:14:41.360 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T16:14:41.360 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:41.380 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:41.381 INFO:tasks.ceph:role: osd.0 2023-12-19T16:14:41.381 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:14:41.381 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:14:41.449 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:41.449 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:41.450 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:41.911 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-19T16:14:41.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T16:14:41.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:42.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:42.039 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:42.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:42.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:42.101 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:42.101 INFO:tasks.ceph:role: osd.1 2023-12-19T16:14:42.101 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:14:42.102 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:42.173 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:42.174 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:42.174 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:42.651 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-19T16:14:42.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T16:14:42.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:42.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:42.826 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:42.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:42.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:42.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:42.891 INFO:tasks.ceph:role: osd.2 2023-12-19T16:14:42.891 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:14:42.891 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:42.963 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:42.964 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:42.964 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:43.437 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-19T16:14:43.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T16:14:43.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:43.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:43.605 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:43.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:43.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:43.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:43.675 INFO:tasks.ceph:role: osd.3 2023-12-19T16:14:43.675 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:14:43.675 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:43.750 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:44.188 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-12-19T16:14:44.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T16:14:44.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:44.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:44.316 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:44.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:44.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:44.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.444+0000 7f8b19487640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T16:14:44.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.448+0000 7f8b19487640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T16:14:44.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.448+0000 7f8b19487640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:44.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.448+0000 7f8b19487640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:44.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.448+0000 7f8b19487640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T16:14:44.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:44.452+0000 7f8b19487640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T16:14:47.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T16:14:47.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:47.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T16:14:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T16:14:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:47.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T16:14:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:47.584+0000 7f9258134640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T16:14:50.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T16:14:50.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.700+0000 7fd686da9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T16:14:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.700+0000 7fd686da9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T16:14:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.700+0000 7fd686da9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.700+0000 7fd686da9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.700+0000 7fd686da9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T16:14:50.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:50.704+0000 7fd686da9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T16:14:53.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T16:14:53.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:14:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.804+0000 7f6fabb96640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T16:14:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.808+0000 7f6fabb96640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T16:14:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.808+0000 7f6fabb96640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.808+0000 7f6fabb96640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.808+0000 7f6fabb96640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T16:14:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:14:53.808+0000 7f6fabb96640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T16:14:56.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T16:14:56.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:56.861 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:56.861 INFO:tasks.ceph:role: osd.4 2023-12-19T16:14:56.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:14:56.861 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T16:14:56.934 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:56.934 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:56.935 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:57.417 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-12-19T16:14:57.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-12-19T16:14:57.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:57.577 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T16:14:57.595 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:57.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:57.596 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:57.659 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:57.659 INFO:tasks.ceph:role: osd.5 2023-12-19T16:14:57.659 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:14:57.659 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T16:14:57.730 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:57.731 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:58.163 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-12-19T16:14:58.166 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-12-19T16:14:58.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:58.262 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T16:14:58.280 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:58.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:58.281 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:58.346 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:58.346 INFO:tasks.ceph:role: osd.6 2023-12-19T16:14:58.346 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:14:58.347 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:58.418 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:58.882 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-12-19T16:14:58.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-12-19T16:14:58.886 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:59.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T16:14:59.049 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:59.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:59.050 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:59.118 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T16:14:59.118 INFO:tasks.ceph:role: osd.7 2023-12-19T16:14:59.118 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:14:59.118 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T16:14:59.190 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2023-12-19T16:14:59.191 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T16:14:59.191 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T16:14:59.191 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T16:14:59.191 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T16:14:59.679 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2023-12-19T16:14:59.682 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2023-12-19T16:14:59.682 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:59.857 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T16:14:59.876 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T16:14:59.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:14:59.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:00.005 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:14:59.998+0000 7f679285b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T16:15:00.009 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:00.002+0000 7f679285b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T16:15:00.009 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:00.002+0000 7f679285b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:15:00.009 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:00.002+0000 7f679285b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:15:00.009 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:00.002+0000 7f679285b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T16:15:00.011 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:00.006+0000 7f679285b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T16:15:02.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T16:15:03.007 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:03.105 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.098+0000 7ffbb90e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T16:15:03.106 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.102+0000 7ffbb90e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T16:15:03.106 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.102+0000 7ffbb90e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:15:03.106 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.102+0000 7ffbb90e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:15:03.106 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.102+0000 7ffbb90e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T16:15:03.107 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:03.102+0000 7ffbb90e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T16:15:06.093 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T16:15:06.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:06.214 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.206+0000 7f15afe80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T16:15:06.214 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.210+0000 7f15afe80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T16:15:06.215 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.210+0000 7f15afe80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:15:06.215 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.210+0000 7f15afe80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:15:06.215 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.210+0000 7f15afe80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T16:15:06.216 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:06.210+0000 7f15afe80640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T16:15:08.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:08.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:09.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T16:15:09.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:09.321 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.314+0000 7f894f82b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T16:15:09.322 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.314+0000 7f894f82b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T16:15:09.322 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.314+0000 7f894f82b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:15:09.322 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.314+0000 7f894f82b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:15:09.322 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.314+0000 7f894f82b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T16:15:09.323 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:09.318+0000 7f894f82b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T16:15:12.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T16:15:12.394 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T16:15:12.394 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T16:15:12.417 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T16:15:12.479 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T16:15:12.543 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T16:15:12.607 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T16:15:12.670 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T16:15:12.734 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:12.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T16:15:12.798 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:12.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T16:15:12.820 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:12.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T16:15:12.883 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:12.883 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T16:15:12.950 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:12.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T16:15:13.015 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:13.015 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T16:15:13.079 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:13.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T16:15:13.143 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:13.143 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T16:15:13.210 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:13.211 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T16:15:13.219 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:13.220 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-19T16:15:13.275 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:13.275 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T16:15:13.285 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:13.285 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-19T16:15:13.334 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T16:15:13.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:15:13.338 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T16:15:13.382 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-12-19T16:15:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwwYFlUC6tIBAApfXknRNqcF6e4Va+YWlomQ== 2023-12-19T16:15:13.382 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:15:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwwYFlEa21KBAAPi35lLT1QVm0TtqHtAkVBQ== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwwYFlHRYLMBAAe6JO4aNCG3tRKcf301jEGA== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB0wYFlnEe8GhAAFy+bGsYQdTfzzRIvVsSmOg== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB3wYFlUm36IhAA2xVp+ZXzw7xti1Pkx5KdIg== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB6wYFlDtP5KRAAglWrB9m+EVDcWoUU1j7sNA== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB9wYFlx9lDMBAA6L1/ZYNN8OrH77GacAfDlA== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwwYFlSD18JBAAWCIX1iH3o6OdOn866TPV/Q== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwwYFlPWcWNRAAg+P1Pb2YDSAluRy+kgP9vA== 2023-12-19T16:15:13.383 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBxwYFlYT3lABAAvTiyPDU3fDNRgpUeTgQhMw== 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCEwYFlzK5bABAAm36Alvm7ZfE52fDUGc7GQQ== 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCHwYFlCWpPBhAAjS701JMVRnTSQQ3tYx9fuQ== 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCKwYFlwfPDDBAAeQxfTEkcpet6fVrXEqwaSA== 2023-12-19T16:15:13.384 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCNwYFlVxsgExAAWN8f82RULx+p0mTwVOf/SA== 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBxwYFlWX79BBAAAARcLd3AscjfpzZ6uWTRGw== 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBxwYFl1JX8ChAAB6m058FKdH4c1IyeCnnd3w== 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBxwYFluZ2CDhAAydccccZqgYYK2rtJ5PQhSQ== 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2023-12-19T16:15:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBxwYFl7tp6FBAAHqaB7TYTKy55/x3oA393gw== 2023-12-19T16:15:13.397 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2023-12-19T16:15:13.397 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBwwYFlUC6tIBAApfXknRNqcF6e4Va+YWlomQ== 2023-12-19T16:15:13.397 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBwwYFlEa21KBAAPi35lLT1QVm0TtqHtAkVBQ== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBwwYFlHRYLMBAAe6JO4aNCG3tRKcf301jEGA== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB0wYFlnEe8GhAAFy+bGsYQdTfzzRIvVsSmOg== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB3wYFlUm36IhAA2xVp+ZXzw7xti1Pkx5KdIg== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB6wYFlDtP5KRAAglWrB9m+EVDcWoUU1j7sNA== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB9wYFlx9lDMBAA6L1/ZYNN8OrH77GacAfDlA== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBwwYFlSD18JBAAWCIX1iH3o6OdOn866TPV/Q== 2023-12-19T16:15:13.398 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBwwYFlPWcWNRAAg+P1Pb2YDSAluRy+kgP9vA== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxwYFlYT3lABAAvTiyPDU3fDNRgpUeTgQhMw== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCEwYFlzK5bABAAm36Alvm7ZfE52fDUGc7GQQ== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCHwYFlCWpPBhAAjS701JMVRnTSQQ3tYx9fuQ== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCKwYFlwfPDDBAAeQxfTEkcpet6fVrXEqwaSA== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCNwYFlVxsgExAAWN8f82RULx+p0mTwVOf/SA== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxwYFlWX79BBAAAARcLd3AscjfpzZ6uWTRGw== 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2023-12-19T16:15:13.399 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxwYFl1JX8ChAAB6m058FKdH4c1IyeCnnd3w== 2023-12-19T16:15:13.400 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2023-12-19T16:15:13.400 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxwYFluZ2CDhAAydccccZqgYYK2rtJ5PQhSQ== 2023-12-19T16:15:13.400 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2023-12-19T16:15:13.400 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxwYFl7tp6FBAAHqaB7TYTKy55/x3oA393gw== 2023-12-19T16:15:13.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:15:13.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:15:13.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.629 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.687 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.808 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:13.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:15:13.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T16:15:13.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.923 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:13.984 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T16:15:14.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.103 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.162 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T16:15:14.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.342 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.399 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.464 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T16:15:14.522 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T16:15:14.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T16:15:14.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:15:14.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T16:15:14.683 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T16:15:14.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:15:14.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T16:15:14.841 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T16:15:14.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T16:15:15.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T16:15:15.043 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:15.047 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T16:15:15.097 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T16:15:15.098 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T16:15:15.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T16:15:15.102 INFO:tasks.ceph.mon.a:Started 2023-12-19T16:15:15.102 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T16:15:15.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T16:15:15.145 INFO:tasks.ceph.mon.b:Started 2023-12-19T16:15:15.145 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T16:15:15.145 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T16:15:15.148 INFO:tasks.ceph.mon.c:Started 2023-12-19T16:15:15.149 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T16:15:15.149 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T16:15:15.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T16:15:15.152 INFO:tasks.ceph.mgr.y:Started 2023-12-19T16:15:15.152 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T16:15:15.152 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T16:15:15.156 INFO:tasks.ceph.mgr.x:Started 2023-12-19T16:15:15.156 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T16:15:15.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T16:15:15.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.290+0000 7f81dbb8f640 1 Processor -- start 2023-12-19T16:15:15.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.290+0000 7f81dbb8f640 1 -- start start 2023-12-19T16:15:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81dbb8f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81dbb8f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d406ffb0 con 0x7f81d4158650 2023-12-19T16:15:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81dbb8f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d415b730 con 0x7f81d4158270 2023-12-19T16:15:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81dbb8f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d415ba10 con 0x7f81d415e4d0 2023-12-19T16:15:15.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81d912a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f81d4158650 0x7f81d4070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:36186/0 (socket says 172.21.15.73:36186) 2023-12-19T16:15:15.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81d912a640 1 -- 172.21.15.73:0/3476305317 learned_addr learned my addr 172.21.15.73:0/3476305317 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:15.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60032/0 (socket says 172.21.15.73:60032) 2023-12-19T16:15:15.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 msgr2=0x7f81d406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T16:15:15.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 msgr2=0x7f81d406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T16:15:15.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T16:15:15.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.294+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021396007 0 0) 0x7f81d406ffb0 con 0x7f81d4158650 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003530 con 0x7f81d4158650 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122838607 0 0) 0x7f81d415b730 con 0x7f81d4158270 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d406ffb0 con 0x7f81d4158270 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341512452 0 0) 0x7f81c0003530 con 0x7f81d4158650 2023-12-19T16:15:15.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 msgr2=0x7f81d406bb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 --2- 172.21.15.73:0/3476305317 >> v2:172.21.15.73:3300/0 conn(0x7f81d415e4d0 0x7f81d406bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 >> v1:172.21.15.162:6789/0 conn(0x7f81d4158270 legacy=0x7f81d415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d415bcf0 con 0x7f81d4158650 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f81c4001680 con 0x7f81d4158650 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 >> v1:172.21.15.73:6789/0 conn(0x7f81d4158650 legacy=0x7f81d4070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81c0004b70 0x7f81c0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0003770 0x7f81c0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 0x7f81c000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d415ba10 con 0x7f81c0004250 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000c180 con 0x7f81c0003770 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c000c340 con 0x7f81c0004b70 2023-12-19T16:15:15.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 0x7f81c000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d912a640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0003770 0x7f81c0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d992b640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81c0004b70 0x7f81c0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81c0004b70 msgr2=0x7f81c0004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81c0004b70 0x7f81c0004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0003770 msgr2=0x7f81c0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0003770 0x7f81c0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0003530 con 0x7f81c0004250 2023-12-19T16:15:15.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.458+0000 7f81d992b640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81c0004b70 0x7f81c0004f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:15.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81da12c640 1 -- 172.21.15.73:0/3476305317 reap_dead start 2023-12-19T16:15:15.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81da12c640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 0x7f81c000b990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009610 tx=0x7f81cc01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b655c026962006d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:15.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a5d00 con 0x7f81c0004250 2023-12-19T16:15:15.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a5e60 con 0x7f81c0004250 2023-12-19T16:15:15.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81d8929640 1 -- 172.21.15.73:0/3476305317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0ad660 con 0x7f81c0004250 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 msgr2=0x7f81c000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 0x7f81c000b990 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009610 tx=0x7f81cc01ce00 comp rx=0 tx=0).stop 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3476305317 shutdown_connections 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3476305317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81c0004250 0x7f81c000b990 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3476305317 >> 172.21.15.73:0/3476305317 conn(0x7f81d406a570 msgr2=0x7f81d40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3476305317 shutdown_connections 2023-12-19T16:15:15.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.462+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3476305317 wait complete. 2023-12-19T16:15:15.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 Processor -- start 2023-12-19T16:15:15.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- start start 2023-12-19T16:15:15.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0004250 0x7f81d40c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 0x7f81d40b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d406d670 con 0x7f81d406ccb0 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40af620 con 0x7f81c0004250 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d40c4cb0 con 0x7f81d40b03a0 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60062/0 (socket says 172.21.15.73:60062) 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 -- 172.21.15.73:0/3792482512 learned_addr learned my addr 172.21.15.73:0/3792482512 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d992b640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0004250 0x7f81d40c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81da12c640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 0x7f81d40b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 -- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 msgr2=0x7f81d40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 0x7f81d40b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 -- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0004250 msgr2=0x7f81d40c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0004250 0x7f81d40c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 -- 172.21.15.73:0/3792482512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40af8c0 con 0x7f81d406ccb0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81da12c640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 0x7f81d40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81d912a640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81c400e7b0 tx=0x7f81c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400ee60 con 0x7f81d406ccb0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c400c8d0 con 0x7f81d406ccb0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400cc80 con 0x7f81d406ccb0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d40afba0 con 0x7f81d406ccb0 2023-12-19T16:15:15.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d40c2600 con 0x7f81d406ccb0 2023-12-19T16:15:15.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f81c401d760 con 0x7f81d406ccb0 2023-12-19T16:15:15.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.466+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f81c4013600 con 0x7f81d406ccb0 2023-12-19T16:15:15.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.470+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d404e070 con 0x7f81d406ccb0 2023-12-19T16:15:15.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.474+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f81c401dba0 con 0x7f81d406ccb0 2023-12-19T16:15:15.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.534+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f81d40cf200 con 0x7f81d406ccb0 2023-12-19T16:15:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81ca7fc640 1 -- 172.21.15.73:0/3792482512 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f81c401dd40 con 0x7f81d406ccb0 2023-12-19T16:15:15.543 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 msgr2=0x7f81d406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81c400e7b0 tx=0x7f81c400ec70 comp rx=0 tx=0).stop 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 shutdown_connections 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81d40b03a0 0x7f81d40b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81d406ccb0 0x7f81d406d130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 --2- 172.21.15.73:0/3792482512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81c0004250 0x7f81d40c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 >> 172.21.15.73:0/3792482512 conn(0x7f81d406a570 msgr2=0x7f81d4157940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 shutdown_connections 2023-12-19T16:15:15.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:15.538+0000 7f81dbb8f640 1 -- 172.21.15.73:0/3792482512 wait complete. 2023-12-19T16:15:15.563 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T16:15:15.563 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T16:15:15.563 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:15.563 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T16:15:15.584 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:15.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T16:15:15.649 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:15.649 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T16:15:15.690 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:15.682+0000 7fae6563a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:15:15.692 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:15.689+0000 7fc887e57180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T16:15:15.709 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:15.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T16:15:15.774 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:15.774 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T16:15:15.794 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:15.794 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T16:15:15.858 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:15.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T16:15:15.922 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:15.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T16:15:15.986 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 5e1edd4e-229c-4b7d-8cfb-5075102516d2 0 2023-12-19T16:15:16.167 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 Processor -- start 2023-12-19T16:15:16.167 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 -- start start 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f956c0d2090 0x7f956c0cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0d02b0 con 0x7f956c0cfe60 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956c0d38f0 con 0x7f956c0d2090 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f957401f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0d2850 con 0x7f956c160260 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f956c0d2090 0x7f956c0cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f9571dbb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f956c0d2090 0x7f956c0cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39704/0 (socket says 172.21.15.162:39704) 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 -- 172.21.15.162:0/4029555832 learned_addr learned my addr 172.21.15.162:0/4029555832 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 -- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 msgr2=0x7f956c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 --2- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.169 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 -- 172.21.15.162:0/4029555832 >> v1:172.21.15.73:6789/0 conn(0x7f956c0cfe60 legacy=0x7f956c0d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.170 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.165+0000 7f95715ba640 1 -- 172.21.15.162:0/4029555832 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0d2b30 con 0x7f956c0d2090 2023-12-19T16:15:16.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f95715ba640 1 --2- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cf920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f955c009870 tx=0x7f955c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1538a3881e3a0ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f9570db9640 1 -- 172.21.15.162:0/4029555832 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c0a8a30 con 0x7f956c0d2090 2023-12-19T16:15:16.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f9570db9640 1 -- 172.21.15.162:0/4029555832 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c0a8b90 con 0x7f956c0d2090 2023-12-19T16:15:16.172 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f9570db9640 1 -- 172.21.15.162:0/4029555832 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c0b0440 con 0x7f956c0d2090 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 -- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 msgr2=0x7f956c0cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 --2- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cf920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f955c009870 tx=0x7f955c01ed30 comp rx=0 tx=0).stop 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 -- 172.21.15.162:0/4029555832 shutdown_connections 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 --2- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cf920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 --2- 172.21.15.162:0/4029555832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 -- 172.21.15.162:0/4029555832 >> 172.21.15.162:0/4029555832 conn(0x7f956c065ae0 msgr2=0x7f956c065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 -- 172.21.15.162:0/4029555832 shutdown_connections 2023-12-19T16:15:16.173 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.169+0000 7f957401f640 1 -- 172.21.15.162:0/4029555832 wait complete. 2023-12-19T16:15:16.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 Processor -- start 2023-12-19T16:15:16.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- start start 2023-12-19T16:15:16.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956c0cfe60 0x7f956c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.176 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c152980 con 0x7f956c0cfe60 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0cc220 con 0x7f956c0d2090 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c0cc500 con 0x7f956c160260 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95725bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39710/0 (socket says 172.21.15.162:39710) 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 -- 172.21.15.162:0/1018807516 learned_addr learned my addr 172.21.15.162:0/1018807516 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f9571dbb640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956c0cfe60 0x7f956c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 -- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 msgr2=0x7f956c0cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 -- 172.21.15.162:0/1018807516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956c0cfe60 msgr2=0x7f956c0abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956c0cfe60 0x7f956c0abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 -- 172.21.15.162:0/1018807516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0094d0 con 0x7f956c0d2090 2023-12-19T16:15:16.178 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95715ba640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f955c0b3040 tx=0x7f955c01bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c0b0dd0 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c0bb460 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c0bb810 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c14fac0 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c150080 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f955c0bb970 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.173+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f955c0c4850 con 0x7f956c0d2090 2023-12-19T16:15:16.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.177+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c04e070 con 0x7f956c0d2090 2023-12-19T16:15:16.189 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.185+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f955c0c0070 con 0x7f956c0d2090 2023-12-19T16:15:16.229 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:16.222+0000 7fae6563a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:15:16.255 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.253+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5e1edd4e-229c-4b7d-8cfb-5075102516d2", "id": 0} v 0) v1 -- 0x7f956c15f640 con 0x7f956c0d2090 2023-12-19T16:15:16.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.257+0000 7f95627fc640 1 -- 172.21.15.162:0/1018807516 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e1edd4e-229c-4b7d-8cfb-5075102516d2", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f955c0b5070 con 0x7f956c0d2090 2023-12-19T16:15:16.262 INFO:teuthology.orchestra.run.smithi162.stdout:0 2023-12-19T16:15:16.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 msgr2=0x7f956c0cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f955c0b3040 tx=0x7f955c01bad0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 shutdown_connections 2023-12-19T16:15:16.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f956c160260 0x7f956c0cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f956c0d2090 0x7f956c0cb610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.264 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 --2- 172.21.15.162:0/1018807516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956c0cfe60 0x7f956c0abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.264 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 >> 172.21.15.162:0/1018807516 conn(0x7f956c065ae0 msgr2=0x7f956c0d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.264 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 shutdown_connections 2023-12-19T16:15:16.264 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.261+0000 7f957401f640 1 -- 172.21.15.162:0/1018807516 wait complete. 2023-12-19T16:15:16.278 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:16.273+0000 7fc887e57180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T16:15:16.281 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new ac2e2657-a448-4653-a6c9-051df97c61a3 1 2023-12-19T16:15:16.419 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 Processor -- start 2023-12-19T16:15:16.419 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 -- start start 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a806af80 con 0x7f82a815cc40 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a806b540 con 0x7f82a80d15c0 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82adbbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80ce330 con 0x7f82a80cdb00 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.421 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f829ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41704/0 (socket says 172.21.15.162:41704) 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 -- 172.21.15.162:0/4116944532 learned_addr learned my addr 172.21.15.162:0/4116944532 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f829ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39714/0 (socket says 172.21.15.162:39714) 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 -- 172.21.15.162:0/4116944532 >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 msgr2=0x7f82a80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 --2- 172.21.15.162:0/4116944532 >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 -- 172.21.15.162:0/4116944532 >> v1:172.21.15.73:6789/0 conn(0x7f82a815cc40 legacy=0x7f82a80d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f82ad3bd640 1 -- 172.21.15.162:0/4116944532 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80ce610 con 0x7f82a80cdb00 2023-12-19T16:15:16.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.417+0000 7f829ffff640 1 --2- 172.21.15.162:0/4116944532 >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:16.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82ad3bd640 1 --2- 172.21.15.162:0/4116944532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009e50 tx=0x7f82a001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b48e1cede9e4ed31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f829f7fe640 1 -- 172.21.15.162:0/4116944532 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00a5850 con 0x7f82a80cdb00 2023-12-19T16:15:16.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f829f7fe640 1 -- 172.21.15.162:0/4116944532 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a00a59b0 con 0x7f82a80cdb00 2023-12-19T16:15:16.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f829f7fe640 1 -- 172.21.15.162:0/4116944532 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00a5d40 con 0x7f82a80cdb00 2023-12-19T16:15:16.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 -- 172.21.15.162:0/4116944532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 msgr2=0x7f82a806b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 --2- 172.21.15.162:0/4116944532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009e50 tx=0x7f82a001c9e0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 -- 172.21.15.162:0/4116944532 shutdown_connections 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 --2- 172.21.15.162:0/4116944532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a80cdb00 0x7f82a806b9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 --2- 172.21.15.162:0/4116944532 >> v2:172.21.15.162:3300/0 conn(0x7f82a80d15c0 0x7f82a80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 -- 172.21.15.162:0/4116944532 >> 172.21.15.162:0/4116944532 conn(0x7f82a809bbf0 msgr2=0x7f82a80d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 -- 172.21.15.162:0/4116944532 shutdown_connections 2023-12-19T16:15:16.426 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.421+0000 7f82adbbe640 1 -- 172.21.15.162:0/4116944532 wait complete. 2023-12-19T16:15:16.427 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 Processor -- start 2023-12-19T16:15:16.427 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- start start 2023-12-19T16:15:16.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82a80cdb00 0x7f82a8159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 0x7f82a81578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 0x7f82a80c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8159bc0 con 0x7f82a80cdb00 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a814ef20 con 0x7f82a80d15c0 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8159df0 con 0x7f82a815cc40 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 0x7f82a80c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 0x7f82a81578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 0x7f82a81578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39716/0 (socket says 172.21.15.162:39716) 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829ffff640 1 -- 172.21.15.162:0/535328457 learned_addr learned my addr 172.21.15.162:0/535328457 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82acbbc640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82a80cdb00 0x7f82a8159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 -- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 msgr2=0x7f82a81578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 0x7f82a81578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 -- 172.21.15.162:0/535328457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82a80cdb00 msgr2=0x7f82a8159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82a80cdb00 0x7f82a8159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 -- 172.21.15.162:0/535328457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8298009420 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82ad3bd640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 0x7f82a80c9f80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82a00ab000 tx=0x7f82a0019780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00b8670 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a00b8810 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00b8bc0 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a0009b30 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a80b66e0 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f82a00c2740 con 0x7f82a815cc40 2023-12-19T16:15:16.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.425+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f82a00b67f0 con 0x7f82a815cc40 2023-12-19T16:15:16.432 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.429+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a815a1e0 con 0x7f82a815cc40 2023-12-19T16:15:16.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.429+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f82a00bd020 con 0x7f82a815cc40 2023-12-19T16:15:16.437 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:16.426+0000 7fae6563a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:15:16.497 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:16.493+0000 7fc887e57180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T16:15:16.503 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.501+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac2e2657-a448-4653-a6c9-051df97c61a3", "id": 1} v 0) v1 -- 0x7f82a804e000 con 0x7f82a815cc40 2023-12-19T16:15:16.511 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f829d7fa640 1 -- 172.21.15.162:0/535328457 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac2e2657-a448-4653-a6c9-051df97c61a3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82a00c2ae0 con 0x7f82a815cc40 2023-12-19T16:15:16.511 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-12-19T16:15:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 msgr2=0x7f82a80c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 0x7f82a80c9f80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f82a00ab000 tx=0x7f82a0019780 comp rx=0 tx=0).stop 2023-12-19T16:15:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 shutdown_connections 2023-12-19T16:15:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f82a815cc40 0x7f82a80c9f80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82a80d15c0 0x7f82a81578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 --2- 172.21.15.162:0/535328457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82a80cdb00 0x7f82a8159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 >> 172.21.15.162:0/535328457 conn(0x7f82a809bbf0 msgr2=0x7f82a815f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 shutdown_connections 2023-12-19T16:15:16.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.509+0000 7f82adbbe640 1 -- 172.21.15.162:0/535328457 wait complete. 2023-12-19T16:15:16.533 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new db618c69-9779-4bc4-b930-8ddf3bf00197 2 2023-12-19T16:15:16.669 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.665+0000 7f0de6752640 1 Processor -- start 2023-12-19T16:15:16.669 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.665+0000 7f0de6752640 1 -- start start 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.665+0000 7f0de6752640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0de0160260 0x7f0de00cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.665+0000 7f0de6752640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0de00d0030 0x7f0de00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0de6752640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00d38f0 con 0x7f0de00d2090 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0de6752640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00d2850 con 0x7f0de00d0030 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0de6752640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de00d2b30 con 0x7f0de0160260 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0de0160260 0x7f0de00cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0de0160260 0x7f0de00cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39724/0 (socket says 172.21.15.162:39724) 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddf7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0de00d2090 0x7f0de00cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41240/0 (socket says 172.21.15.162:41240) 2023-12-19T16:15:16.671 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 -- 172.21.15.162:0/3783875671 learned_addr learned my addr 172.21.15.162:0/3783875671 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0de4cef640 1 --2- 172.21.15.162:0/3783875671 >> v2:172.21.15.73:3300/0 conn(0x7f0de00d0030 0x7f0de00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 -- 172.21.15.162:0/3783875671 >> v2:172.21.15.73:3300/0 conn(0x7f0de00d0030 msgr2=0x7f0de00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 --2- 172.21.15.162:0/3783875671 >> v2:172.21.15.73:3300/0 conn(0x7f0de00d0030 0x7f0de00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 -- 172.21.15.162:0/3783875671 >> v1:172.21.15.162:6789/0 conn(0x7f0de00d2090 legacy=0x7f0de00cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 -- 172.21.15.162:0/3783875671 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de00d2e10 con 0x7f0de0160260 2023-12-19T16:15:16.672 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddeffd640 1 -- 172.21.15.162:0/3783875671 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120524844 0 0) 0x7f0de00d38f0 con 0x7f0de00d2090 2023-12-19T16:15:16.673 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddffff640 1 --2- 172.21.15.162:0/3783875671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de0160260 0x7f0de00cdd50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0de00cf4c0 tx=0x7f0dd001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc039142ac983d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.674 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddeffd640 1 -- 172.21.15.162:0/3783875671 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00a89f0 con 0x7f0de0160260 2023-12-19T16:15:16.674 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddeffd640 1 -- 172.21.15.162:0/3783875671 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd00a8b50 con 0x7f0de0160260 2023-12-19T16:15:16.674 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.669+0000 7f0ddeffd640 1 -- 172.21.15.162:0/3783875671 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00b0440 con 0x7f0de0160260 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- 172.21.15.162:0/3783875671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de0160260 msgr2=0x7f0de00cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- 172.21.15.162:0/3783875671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de0160260 0x7f0de00cdd50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0de00cf4c0 tx=0x7f0dd001ecf0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- 172.21.15.162:0/3783875671 shutdown_connections 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- 172.21.15.162:0/3783875671 >> v2:172.21.15.73:3300/0 conn(0x7f0de00d0030 0x7f0de00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- 172.21.15.162:0/3783875671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de0160260 0x7f0de00cdd50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- 172.21.15.162:0/3783875671 >> 172.21.15.162:0/3783875671 conn(0x7f0de0065ae0 msgr2=0x7f0de0065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- 172.21.15.162:0/3783875671 shutdown_connections 2023-12-19T16:15:16.675 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- 172.21.15.162:0/3783875671 wait complete. 2023-12-19T16:15:16.676 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 Processor -- start 2023-12-19T16:15:16.676 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- start start 2023-12-19T16:15:16.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00d0030 0x7f0de00aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.680 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015de30 con 0x7f0de00d0030 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00a9f00 con 0x7f0de00d2090 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de6752640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de00aa1e0 con 0x7f0de0160260 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de4cef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0ddf7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39732/0 (socket says 172.21.15.162:39732) 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0ddf7fe640 1 -- 172.21.15.162:0/2668603399 learned_addr learned my addr 172.21.15.162:0/2668603399 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.673+0000 7f0de4cef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41718/0 (socket says 172.21.15.162:41718) 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddffff640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00d0030 0x7f0de00aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 -- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 msgr2=0x7f0de015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 -- 172.21.15.162:0/2668603399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00d0030 msgr2=0x7f0de00aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00d0030 0x7f0de00aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.681 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 -- 172.21.15.162:0/2668603399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00094d0 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddf7fe640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de4cef640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800efc0 tx=0x7f0dd800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8009c00 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd800f040 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80146c0 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de00aa4c0 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de00aaa80 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0dd8014b20 con 0x7f0de0160260 2023-12-19T16:15:16.682 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0dd801d820 con 0x7f0de0160260 2023-12-19T16:15:16.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.677+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de00aaca0 con 0x7f0de0160260 2023-12-19T16:15:16.683 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.681+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f0dd803bb40 con 0x7f0de0160260 2023-12-19T16:15:16.748 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.745+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "db618c69-9779-4bc4-b930-8ddf3bf00197", "id": 2} v 0) v1 -- 0x7f0de004e070 con 0x7f0de0160260 2023-12-19T16:15:16.757 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.753+0000 7f0ddcff9640 1 -- 172.21.15.162:0/2668603399 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db618c69-9779-4bc4-b930-8ddf3bf00197", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0dd802a070 con 0x7f0de0160260 2023-12-19T16:15:16.757 INFO:teuthology.orchestra.run.smithi162.stdout:2 2023-12-19T16:15:16.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 msgr2=0x7f0de00a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800efc0 tx=0x7f0dd800c490 comp rx=0 tx=0).stop 2023-12-19T16:15:16.758 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 shutdown_connections 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0de0160260 0x7f0de00a94b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0de00d2090 0x7f0de015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 --2- 172.21.15.162:0/2668603399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0de00d0030 0x7f0de00aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 >> 172.21.15.162:0/2668603399 conn(0x7f0de0065ae0 msgr2=0x7f0de015e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 shutdown_connections 2023-12-19T16:15:16.759 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.757+0000 7f0de6752640 1 -- 172.21.15.162:0/2668603399 wait complete. 2023-12-19T16:15:16.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 12ac8043-3e9b-4654-94d7-2cfb62775770 3 2023-12-19T16:15:16.912 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 Processor -- start 2023-12-19T16:15:16.912 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 -- start start 2023-12-19T16:15:16.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaac160260 0x7fcaac0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 0x7fcaac0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0d38f0 con 0x7fcaac0d2090 2023-12-19T16:15:16.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2850 con 0x7fcaac0d0030 2023-12-19T16:15:16.914 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab43ce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2b30 con 0x7fcaac160260 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab216a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaac160260 0x7fcaac0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab216a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaac160260 0x7fcaac0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39746/0 (socket says 172.21.15.162:39746) 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab216a640 1 -- 172.21.15.162:0/1462263304 learned_addr learned my addr 172.21.15.162:0/1462263304 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab1969640 1 --1- 172.21.15.162:0/1462263304 >> v1:172.21.15.162:6789/0 conn(0x7fcaac0d2090 0x7fcaac0cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41248/0 (socket says 172.21.15.162:41248) 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.909+0000 7fcab296b640 1 --2- 172.21.15.162:0/1462263304 >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 0x7fcaac0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab216a640 1 -- 172.21.15.162:0/1462263304 >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 msgr2=0x7fcaac0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab216a640 1 --2- 172.21.15.162:0/1462263304 >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 0x7fcaac0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab216a640 1 -- 172.21.15.162:0/1462263304 >> v1:172.21.15.162:6789/0 conn(0x7fcaac0d2090 legacy=0x7fcaac0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab216a640 1 -- 172.21.15.162:0/1462263304 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0d2e10 con 0x7fcaac160260 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab1168640 1 -- 172.21.15.162:0/1462263304 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507493675 0 0) 0x7fcaac0d38f0 con 0x7fcaac0d2090 2023-12-19T16:15:16.915 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab296b640 1 --2- 172.21.15.162:0/1462263304 >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 0x7fcaac0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:16.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab216a640 1 --2- 172.21.15.162:0/1462263304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0cdd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0cf4c0 tx=0x7fcaa801ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=855541372b065335 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab1168640 1 -- 172.21.15.162:0/1462263304 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80a89f0 con 0x7fcaac160260 2023-12-19T16:15:16.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab1168640 1 -- 172.21.15.162:0/1462263304 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80a8b50 con 0x7fcaac160260 2023-12-19T16:15:16.917 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.913+0000 7fcab1168640 1 -- 172.21.15.162:0/1462263304 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b0440 con 0x7fcaac160260 2023-12-19T16:15:16.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- 172.21.15.162:0/1462263304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 msgr2=0x7fcaac0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- 172.21.15.162:0/1462263304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0cdd50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0cf4c0 tx=0x7fcaa801ecf0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- 172.21.15.162:0/1462263304 shutdown_connections 2023-12-19T16:15:16.918 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- 172.21.15.162:0/1462263304 >> v2:172.21.15.73:3300/0 conn(0x7fcaac0d0030 0x7fcaac0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- 172.21.15.162:0/1462263304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0cdd50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- 172.21.15.162:0/1462263304 >> 172.21.15.162:0/1462263304 conn(0x7fcaac065ae0 msgr2=0x7fcaac065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:16.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- 172.21.15.162:0/1462263304 shutdown_connections 2023-12-19T16:15:16.919 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- 172.21.15.162:0/1462263304 wait complete. 2023-12-19T16:15:16.920 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 Processor -- start 2023-12-19T16:15:16.920 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- start start 2023-12-19T16:15:16.922 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 0x7fcaac15a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.922 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac158080 con 0x7fcaac0d0030 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0c9e40 con 0x7fcaac160260 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab43ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0ca0e0 con 0x7fcaac0d2090 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab1969640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab216a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 0x7fcaac15a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab1969640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41728/0 (socket says 172.21.15.162:41728) 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab1969640 1 -- 172.21.15.162:0/279225781 learned_addr learned my addr 172.21.15.162:0/279225781 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:16.923 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 -- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 msgr2=0x7fcaac155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 -- 172.21.15.162:0/279225781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 msgr2=0x7fcaac15a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 0x7fcaac15a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab296b640 1 -- 172.21.15.162:0/279225781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa80094d0 con 0x7fcaac160260 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab1969640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.917+0000 7fcab216a640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 0x7fcaac15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:16.924 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcab296b640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0caa30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4007e60 tx=0x7fcaa400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:16.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4003ba0 con 0x7fcaac160260 2023-12-19T16:15:16.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa400f040 con 0x7fcaac160260 2023-12-19T16:15:16.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac0ca3c0 con 0x7fcaac160260 2023-12-19T16:15:16.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400de80 con 0x7fcaac160260 2023-12-19T16:15:16.925 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac0cb570 con 0x7fcaac160260 2023-12-19T16:15:16.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcaa4004330 con 0x7fcaac160260 2023-12-19T16:15:16.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fcaa401f440 con 0x7fcaac160260 2023-12-19T16:15:16.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.921+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0ca600 con 0x7fcaac160260 2023-12-19T16:15:16.926 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:16.925+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fcaa401a070 con 0x7fcaac160260 2023-12-19T16:15:17.006 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.001+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12ac8043-3e9b-4654-94d7-2cfb62775770", "id": 3} v 0) v1 -- 0x7fcaac04e070 con 0x7fcaac160260 2023-12-19T16:15:17.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.009+0000 7fcaa2ffd640 1 -- 172.21.15.162:0/279225781 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12ac8043-3e9b-4654-94d7-2cfb62775770", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcaa40046b0 con 0x7fcaac160260 2023-12-19T16:15:17.014 INFO:teuthology.orchestra.run.smithi162.stdout:3 2023-12-19T16:15:17.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 msgr2=0x7fcaac0caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0caa30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4007e60 tx=0x7fcaa400d4a0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 shutdown_connections 2023-12-19T16:15:17.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaac160260 0x7fcaac0caa30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaac0d2090 0x7fcaac155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 --2- 172.21.15.162:0/279225781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0d0030 0x7fcaac15a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 >> 172.21.15.162:0/279225781 conn(0x7fcaac065ae0 msgr2=0x7fcaac15f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 shutdown_connections 2023-12-19T16:15:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.013+0000 7fcab43ce640 1 -- 172.21.15.162:0/279225781 wait complete. 2023-12-19T16:15:17.034 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 496d81f4-3bcc-4ff7-8872-1c6fbfab5367 4 2023-12-19T16:15:17.071 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.066+0000 7fae6563a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:15:17.133 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.126+0000 7fae6563a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:15:17.161 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.157+0000 7fc887e57180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T16:15:17.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 Processor -- start 2023-12-19T16:15:17.171 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 -- start start 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 0x7f205c167820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c0ce1c0 con 0x7f205c160260 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c0d38f0 con 0x7f205c0cdd50 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2063266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0d2850 con 0x7f205c0d0030 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2061803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 0x7f205c167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2060801640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f205c0cdd50 0x7f205c0cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41262/0 (socket says 172.21.15.162:41262) 2023-12-19T16:15:17.174 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.169+0000 7f2060801640 1 -- 172.21.15.162:0/1363810265 learned_addr learned my addr 172.21.15.162:0/1363810265 (peer_addr_for_me v1:172.21.15.162:0/0) 2023-12-19T16:15:17.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2061803640 1 -- 172.21.15.162:0/1363810265 >> v1:172.21.15.162:6789/0 conn(0x7f205c0cdd50 legacy=0x7f205c0cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2061803640 1 -- 172.21.15.162:0/1363810265 >> v1:172.21.15.73:6789/0 conn(0x7f205c160260 legacy=0x7f205c0d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2061803640 1 -- 172.21.15.162:0/1363810265 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0d2b30 con 0x7f205c0d0030 2023-12-19T16:15:17.175 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2053fff640 1 -- 172.21.15.162:0/1363810265 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33829826 0 0) 0x7f2058001120 con 0x7f205c160260 2023-12-19T16:15:17.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2061803640 1 --2- 172.21.15.162:0/1363810265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 0x7f205c167820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f205401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6690eba9ce7f9a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2053fff640 1 -- 172.21.15.162:0/1363810265 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540af600 con 0x7f205c0d0030 2023-12-19T16:15:17.177 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2053fff640 1 -- 172.21.15.162:0/1363810265 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540ab050 con 0x7f205c0d0030 2023-12-19T16:15:17.178 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.173+0000 7f2053fff640 1 -- 172.21.15.162:0/1363810265 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540af980 con 0x7f205c0d0030 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- 172.21.15.162:0/1363810265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 msgr2=0x7f205c167820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 --2- 172.21.15.162:0/1363810265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 0x7f205c167820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2054009dc0 tx=0x7f205401f150 comp rx=0 tx=0).stop 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- 172.21.15.162:0/1363810265 shutdown_connections 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 --2- 172.21.15.162:0/1363810265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c0d0030 0x7f205c167820 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- 172.21.15.162:0/1363810265 >> 172.21.15.162:0/1363810265 conn(0x7f205c065ae0 msgr2=0x7f205c065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- 172.21.15.162:0/1363810265 shutdown_connections 2023-12-19T16:15:17.179 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- 172.21.15.162:0/1363810265 wait complete. 2023-12-19T16:15:17.180 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 Processor -- start 2023-12-19T16:15:17.180 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- start start 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0cdd50 0x7f205c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 0x7f205c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c1f5670 con 0x7f205c0cdd50 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c15bf00 con 0x7f205c0d0030 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2063266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0b7110 con 0x7f205c160260 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2060801640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.183 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 0x7f205c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2060801640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39774/0 (socket says 172.21.15.162:39774) 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2060801640 1 -- 172.21.15.162:0/2977615162 learned_addr learned my addr 172.21.15.162:0/2977615162 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061002640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0cdd50 0x7f205c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 -- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 msgr2=0x7f205c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 -- 172.21.15.162:0/2977615162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0cdd50 msgr2=0x7f205c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0cdd50 0x7f205c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2061803640 1 -- 172.21.15.162:0/2977615162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054009a70 con 0x7f205c160260 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.177+0000 7f2060801640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2061803640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 0x7f205c14a9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20540af000 tx=0x7f205401bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540c1070 con 0x7f205c160260 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540afe10 con 0x7f205c160260 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c0b73f0 con 0x7f205c160260 2023-12-19T16:15:17.184 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b9650 con 0x7f205c160260 2023-12-19T16:15:17.185 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c0b79b0 con 0x7f205c160260 2023-12-19T16:15:17.185 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f20540b6050 con 0x7f205c160260 2023-12-19T16:15:17.185 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f20540c6410 con 0x7f205c160260 2023-12-19T16:15:17.185 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.181+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c0b7ba0 con 0x7f205c160260 2023-12-19T16:15:17.186 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.185+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f20540b4070 con 0x7f205c160260 2023-12-19T16:15:17.193 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.186+0000 7fae6563a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:15:17.228 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.225+0000 7fc887e57180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T16:15:17.252 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.249+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "496d81f4-3bcc-4ff7-8872-1c6fbfab5367", "id": 4} v 0) v1 -- 0x7f205c04e070 con 0x7f205c160260 2023-12-19T16:15:17.260 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2051ffb640 1 -- 172.21.15.162:0/2977615162 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "496d81f4-3bcc-4ff7-8872-1c6fbfab5367", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f20540b9ab0 con 0x7f205c160260 2023-12-19T16:15:17.261 INFO:teuthology.orchestra.run.smithi162.stdout:4 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 msgr2=0x7f205c14a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 0x7f205c14a9e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20540af000 tx=0x7f205401bef0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 shutdown_connections 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f205c160260 0x7f205c14a9e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f205c0d0030 0x7f205c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 --2- 172.21.15.162:0/2977615162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205c0cdd50 0x7f205c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 >> 172.21.15.162:0/2977615162 conn(0x7f205c065ae0 msgr2=0x7f205c06b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.262 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 shutdown_connections 2023-12-19T16:15:17.263 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.257+0000 7f2063266640 1 -- 172.21.15.162:0/2977615162 wait complete. 2023-12-19T16:15:17.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 35ff844f-d51a-46fc-84aa-a95e5a17c9b3 5 2023-12-19T16:15:17.282 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.278+0000 7fae6563a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:15:17.293 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.289+0000 7fc887e57180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T16:15:17.342 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.334+0000 7fae6563a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:15:17.385 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.381+0000 7fc887e57180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.417+0000 7f380618f640 1 Processor -- start 2023-12-19T16:15:17.422 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.417+0000 7f380618f640 1 -- start start 2023-12-19T16:15:17.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f380618f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f380618f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38000d0030 0x7f38000b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.423 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f380618f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000d38f0 con 0x7f38000d2090 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f380618f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000d2850 con 0x7f38000d0030 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f380618f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000d2b30 con 0x7f3800160260 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41736/0 (socket says 172.21.15.162:41736) 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 -- 172.21.15.162:0/3450855619 learned_addr learned my addr 172.21.15.162:0/3450855619 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37fffff640 1 --2- 172.21.15.162:0/3450855619 >> v2:172.21.15.73:3300/0 conn(0x7f38000d0030 0x7f38000b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 -- 172.21.15.162:0/3450855619 >> v2:172.21.15.73:3300/0 conn(0x7f38000d0030 msgr2=0x7f38000b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.424 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 --2- 172.21.15.162:0/3450855619 >> v2:172.21.15.73:3300/0 conn(0x7f38000d0030 0x7f38000b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 -- 172.21.15.162:0/3450855619 >> v1:172.21.15.73:6789/0 conn(0x7f38000d2090 legacy=0x7f38000cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.425 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.421+0000 7f37ff7fe640 1 -- 172.21.15.162:0/3450855619 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000d2e10 con 0x7f3800160260 2023-12-19T16:15:17.427 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f37ff7fe640 1 --2- 172.21.15.162:0/3450855619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009870 tx=0x7f37f001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c874bd322e92a48f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.427 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f37fe7fc640 1 -- 172.21.15.162:0/3450855619 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00a8a30 con 0x7f3800160260 2023-12-19T16:15:17.427 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f37fe7fc640 1 -- 172.21.15.162:0/3450855619 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00a8b90 con 0x7f3800160260 2023-12-19T16:15:17.428 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f37fe7fc640 1 -- 172.21.15.162:0/3450855619 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00b0440 con 0x7f3800160260 2023-12-19T16:15:17.428 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 -- 172.21.15.162:0/3450855619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 msgr2=0x7f38000cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.428 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 --2- 172.21.15.162:0/3450855619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009870 tx=0x7f37f001ed30 comp rx=0 tx=0).stop 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 -- 172.21.15.162:0/3450855619 shutdown_connections 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 --2- 172.21.15.162:0/3450855619 >> v2:172.21.15.73:3300/0 conn(0x7f38000d0030 0x7f38000b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 --2- 172.21.15.162:0/3450855619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38000cdd50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 -- 172.21.15.162:0/3450855619 >> 172.21.15.162:0/3450855619 conn(0x7f3800065ae0 msgr2=0x7f3800065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 -- 172.21.15.162:0/3450855619 shutdown_connections 2023-12-19T16:15:17.429 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 -- 172.21.15.162:0/3450855619 wait complete. 2023-12-19T16:15:17.429 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.422+0000 7fae6563a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.425+0000 7f380618f640 1 Processor -- start 2023-12-19T16:15:17.430 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- start start 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000d0030 0x7f38000b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 0x7f380015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800156b50 con 0x7f38000d0030 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001561b0 con 0x7f38000d2090 2023-12-19T16:15:17.431 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800156490 con 0x7f3800160260 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37feffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 0x7f380015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41740/0 (socket says 172.21.15.162:41740) 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 -- 172.21.15.162:0/1714106955 learned_addr learned my addr 172.21.15.162:0/1714106955 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37ff7fe640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000d0030 0x7f38000b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 -- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 msgr2=0x7f380015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 0x7f380015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 -- 172.21.15.162:0/1714106955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000d0030 msgr2=0x7f38000b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000d0030 0x7f38000b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 -- 172.21.15.162:0/1714106955 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00094d0 con 0x7f3800160260 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37feffd640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 0x7f380015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:17.433 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37fffff640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37f800efc0 tx=0x7f37f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8009ca0 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f800f040 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80146c0 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800156770 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38000b8110 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f37f8014b20 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f37f8014dd0 con 0x7f3800160260 2023-12-19T16:15:17.434 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.429+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800156c90 con 0x7f3800160260 2023-12-19T16:15:17.435 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.433+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f37f803bb40 con 0x7f3800160260 2023-12-19T16:15:17.449 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.445+0000 7fc887e57180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T16:15:17.490 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.482+0000 7fae6563a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:15:17.503 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.501+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35ff844f-d51a-46fc-84aa-a95e5a17c9b3", "id": 5} v 0) v1 -- 0x7f380004e070 con 0x7f3800160260 2023-12-19T16:15:17.511 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f37e7fff640 1 -- 172.21.15.162:0/1714106955 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35ff844f-d51a-46fc-84aa-a95e5a17c9b3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37f802a070 con 0x7f3800160260 2023-12-19T16:15:17.512 INFO:teuthology.orchestra.run.smithi162.stdout:5 2023-12-19T16:15:17.513 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 msgr2=0x7f38001549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f37f800efc0 tx=0x7f37f800c490 comp rx=0 tx=0).stop 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 shutdown_connections 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3800160260 0x7f38001549e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38000d2090 0x7f380015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 --2- 172.21.15.162:0/1714106955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38000d0030 0x7f38000b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 >> 172.21.15.162:0/1714106955 conn(0x7f3800065ae0 msgr2=0x7f38000d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 shutdown_connections 2023-12-19T16:15:17.514 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.509+0000 7f380618f640 1 -- 172.21.15.162:0/1714106955 wait complete. 2023-12-19T16:15:17.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 04623184-554c-4798-b3a9-de2cff1e0da6 6 2023-12-19T16:15:17.544 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.541+0000 7fc887e57180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T16:15:17.607 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.605+0000 7fc887e57180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T16:15:17.645 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.638+0000 7fae6563a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:15:17.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 Processor -- start 2023-12-19T16:15:17.684 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 -- start start 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd80d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecd80cdcd0 0x7fecd806b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd806af80 con 0x7fecd80d13f0 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd806b540 con 0x7fecd80cdcd0 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdf4f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80d1830 con 0x7fecd815cc40 2023-12-19T16:15:17.686 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecde4ee640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd80d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecddced640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fecd80d13f0 0x7fecd80cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:41276/0 (socket says 172.21.15.162:41276) 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecddced640 1 -- 172.21.15.162:0/4178390097 learned_addr learned my addr 172.21.15.162:0/4178390097 (peer_addr_for_me v1:172.21.15.162:0/0) 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.681+0000 7fecdecef640 1 --2- 172.21.15.162:0/4178390097 >> v2:172.21.15.73:3300/0 conn(0x7fecd80cdcd0 0x7fecd806b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecde4ee640 1 -- 172.21.15.162:0/4178390097 >> v2:172.21.15.73:3300/0 conn(0x7fecd80cdcd0 msgr2=0x7fecd806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecde4ee640 1 --2- 172.21.15.162:0/4178390097 >> v2:172.21.15.73:3300/0 conn(0x7fecd80cdcd0 0x7fecd806b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecdd4ec640 1 -- 172.21.15.162:0/4178390097 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222588204 0 0) 0x7fecd806af80 con 0x7fecd80d13f0 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecde4ee640 1 -- 172.21.15.162:0/4178390097 >> v1:172.21.15.162:6789/0 conn(0x7fecd80d13f0 legacy=0x7fecd80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.687 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecde4ee640 1 -- 172.21.15.162:0/4178390097 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80ce330 con 0x7fecd815cc40 2023-12-19T16:15:17.689 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecde4ee640 1 --2- 172.21.15.162:0/4178390097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd80d0eb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097c0 tx=0x7fecd401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8697cb1a14d1591e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecdd4ec640 1 -- 172.21.15.162:0/4178390097 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ab600 con 0x7fecd815cc40 2023-12-19T16:15:17.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecdd4ec640 1 -- 172.21.15.162:0/4178390097 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40a7050 con 0x7fecd815cc40 2023-12-19T16:15:17.690 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.685+0000 7fecdd4ec640 1 -- 172.21.15.162:0/4178390097 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ab980 con 0x7fecd815cc40 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- 172.21.15.162:0/4178390097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 msgr2=0x7fecd80d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/4178390097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd80d0eb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097c0 tx=0x7fecd401c480 comp rx=0 tx=0).stop 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- 172.21.15.162:0/4178390097 shutdown_connections 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/4178390097 >> v2:172.21.15.73:3300/0 conn(0x7fecd80cdcd0 0x7fecd806b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/4178390097 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd80d0eb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- 172.21.15.162:0/4178390097 >> 172.21.15.162:0/4178390097 conn(0x7fecd809bbf0 msgr2=0x7fecd80d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- 172.21.15.162:0/4178390097 shutdown_connections 2023-12-19T16:15:17.691 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- 172.21.15.162:0/4178390097 wait complete. 2023-12-19T16:15:17.692 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 Processor -- start 2023-12-19T16:15:17.692 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- start start 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d13f0 0x7fecd8155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81565d0 con 0x7fecd80d13f0 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81f5f30 con 0x7fecd80cdcd0 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdf4f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81f6210 con 0x7fecd815cc40 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.694 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecde4ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41760/0 (socket says 172.21.15.162:41760) 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecde4ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39792/0 (socket says 172.21.15.162:39792) 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 -- 172.21.15.162:0/404935099 learned_addr learned my addr 172.21.15.162:0/404935099 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecddced640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d13f0 0x7fecd8155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 -- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 msgr2=0x7fecd80c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 -- 172.21.15.162:0/404935099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d13f0 msgr2=0x7fecd8155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d13f0 0x7fecd8155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecdecef640 1 -- 172.21.15.162:0/404935099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4009420 con 0x7fecd815cc40 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.689+0000 7fecde4ee640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:17.695 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecdecef640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fecd000efc0 tx=0x7fecd000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0014480 con 0x7fecd815cc40 2023-12-19T16:15:17.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000f040 con 0x7fecd815cc40 2023-12-19T16:15:17.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0014820 con 0x7fecd815cc40 2023-12-19T16:15:17.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd81f64f0 con 0x7fecd815cc40 2023-12-19T16:15:17.696 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd81f5c40 con 0x7fecd815cc40 2023-12-19T16:15:17.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fecd0014c80 con 0x7fecd815cc40 2023-12-19T16:15:17.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fecd00133e0 con 0x7fecd815cc40 2023-12-19T16:15:17.697 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd804e000 con 0x7fecd815cc40 2023-12-19T16:15:17.698 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.693+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fecd0018020 con 0x7fecd815cc40 2023-12-19T16:15:17.713 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:17.706+0000 7fae6563a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:15:17.764 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.761+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "04623184-554c-4798-b3a9-de2cff1e0da6", "id": 6} v 0) v1 -- 0x7fecd81f69a0 con 0x7fecd815cc40 2023-12-19T16:15:17.770 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.765+0000 7fecceffd640 1 -- 172.21.15.162:0/404935099 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04623184-554c-4798-b3a9-de2cff1e0da6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fecd001d400 con 0x7fecd815cc40 2023-12-19T16:15:17.770 INFO:teuthology.orchestra.run.smithi162.stdout:6 2023-12-19T16:15:17.771 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 msgr2=0x7fecd8158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.771 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fecd000efc0 tx=0x7fecd000c490 comp rx=0 tx=0).stop 2023-12-19T16:15:17.771 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 shutdown_connections 2023-12-19T16:15:17.771 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fecd815cc40 0x7fecd8158b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.772 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d13f0 0x7fecd8155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.772 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 --2- 172.21.15.162:0/404935099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecd80cdcd0 0x7fecd80c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.772 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 >> 172.21.15.162:0/404935099 conn(0x7fecd809bbf0 msgr2=0x7fecd80b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.772 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 shutdown_connections 2023-12-19T16:15:17.772 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fecdf4f0640 1 -- 172.21.15.162:0/404935099 wait complete. 2023-12-19T16:15:17.773 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.769+0000 7fc887e57180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T16:15:17.789 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 3d5c32d6-bdbb-4b1e-882f-c3894870308c 7 2023-12-19T16:15:17.845 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:17.841+0000 7fc887e57180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T16:15:17.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 Processor -- start 2023-12-19T16:15:17.927 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 -- start start 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4e480d2090 0x7f4e480cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e480d02b0 con 0x7f4e480cfe60 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e480d38f0 con 0x7f4e480d2090 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e4dda6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480d2850 con 0x7f4e48160260 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.929 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41776/0 (socket says 172.21.15.162:41776) 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 -- 172.21.15.162:0/486018754 learned_addr learned my addr 172.21.15.162:0/486018754 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e46ffd640 1 --2- 172.21.15.162:0/486018754 >> v2:172.21.15.73:3300/0 conn(0x7f4e480d2090 0x7f4e480cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 -- 172.21.15.162:0/486018754 >> v2:172.21.15.73:3300/0 conn(0x7f4e480d2090 msgr2=0x7f4e480cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 --2- 172.21.15.162:0/486018754 >> v2:172.21.15.73:3300/0 conn(0x7f4e480d2090 0x7f4e480cf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 -- 172.21.15.162:0/486018754 >> v1:172.21.15.73:6789/0 conn(0x7f4e480cfe60 legacy=0x7f4e480d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.930 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.925+0000 7f4e477fe640 1 -- 172.21.15.162:0/486018754 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480d2b30 con 0x7f4e48160260 2023-12-19T16:15:17.932 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e477fe640 1 --2- 172.21.15.162:0/486018754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=483a36442a99cc57 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.932 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e467fc640 1 -- 172.21.15.162:0/486018754 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380a8a30 con 0x7f4e48160260 2023-12-19T16:15:17.932 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e467fc640 1 -- 172.21.15.162:0/486018754 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380a8b90 con 0x7f4e48160260 2023-12-19T16:15:17.932 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e467fc640 1 -- 172.21.15.162:0/486018754 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b0440 con 0x7f4e48160260 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 -- 172.21.15.162:0/486018754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 msgr2=0x7f4e480cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/486018754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009870 tx=0x7f4e3801ed30 comp rx=0 tx=0).stop 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 -- 172.21.15.162:0/486018754 shutdown_connections 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/486018754 >> v2:172.21.15.73:3300/0 conn(0x7f4e480d2090 0x7f4e480cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/486018754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e48160260 0x7f4e480cdd50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 -- 172.21.15.162:0/486018754 >> 172.21.15.162:0/486018754 conn(0x7f4e48065ae0 msgr2=0x7f4e48065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:17.933 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 -- 172.21.15.162:0/486018754 shutdown_connections 2023-12-19T16:15:17.934 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.929+0000 7f4e4dda6640 1 -- 172.21.15.162:0/486018754 wait complete. 2023-12-19T16:15:17.935 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 Processor -- start 2023-12-19T16:15:17.935 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- start start 2023-12-19T16:15:17.937 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.937 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 0x7f4e480c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 0x7f4e4815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e481592a0 con 0x7f4e48160260 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480cc510 con 0x7f4e480d2090 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e480caf30 con 0x7f4e480cfe60 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e46ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 0x7f4e480c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:41786/0 (socket says 172.21.15.162:41786) 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 -- 172.21.15.162:0/1498488224 learned_addr learned my addr 172.21.15.162:0/1498488224 (peer_addr_for_me v2:172.21.15.162:0/0) 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e47fff640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 0x7f4e4815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 -- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 msgr2=0x7f4e480c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 0x7f4e480c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 -- 172.21.15.162:0/1498488224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 msgr2=0x7f4e4815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 0x7f4e4815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 -- 172.21.15.162:0/1498488224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380094d0 con 0x7f4e480cfe60 2023-12-19T16:15:17.938 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e47fff640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 0x7f4e4815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e46ffd640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 0x7f4e480c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e477fe640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b3040 tx=0x7f4e3801bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b9620 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e380b97a0 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e480cb210 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e380b9b50 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e480cb7d0 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4e380b7070 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.933+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4e380b9cb0 con 0x7f4e480cfe60 2023-12-19T16:15:17.939 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.937+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4804e070 con 0x7f4e480cfe60 2023-12-19T16:15:17.940 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:17.937+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f4e380b5070 con 0x7f4e480cfe60 2023-12-19T16:15:18.006 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.001+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d5c32d6-bdbb-4b1e-882f-c3894870308c", "id": 7} v 0) v1 -- 0x7f4e480b8170 con 0x7f4e480cfe60 2023-12-19T16:15:18.014 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.009+0000 7f4e2ffff640 1 -- 172.21.15.162:0/1498488224 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d5c32d6-bdbb-4b1e-882f-c3894870308c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e380c4820 con 0x7f4e480cfe60 2023-12-19T16:15:18.014 INFO:teuthology.orchestra.run.smithi162.stdout:7 2023-12-19T16:15:18.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 msgr2=0x7f4e480cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b3040 tx=0x7f4e3801bad0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.015 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 shutdown_connections 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e48160260 0x7f4e4815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e480d2090 0x7f4e480c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 --2- 172.21.15.162:0/1498488224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e480cfe60 0x7f4e480cbfd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 >> 172.21.15.162:0/1498488224 conn(0x7f4e48065ae0 msgr2=0x7f4e480d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 shutdown_connections 2023-12-19T16:15:18.016 INFO:teuthology.orchestra.run.smithi162.stderr:2023-12-19T16:15:18.013+0000 7f4e4dda6640 1 -- 172.21.15.162:0/1498488224 wait complete. 2023-12-19T16:15:18.033 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T16:15:18.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T16:15:18.042 INFO:tasks.ceph.osd.0:Started 2023-12-19T16:15:18.042 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T16:15:18.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T16:15:18.054 INFO:tasks.ceph.osd.1:Started 2023-12-19T16:15:18.054 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T16:15:18.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T16:15:18.064 INFO:tasks.ceph.osd.2:Started 2023-12-19T16:15:18.064 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T16:15:18.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T16:15:18.073 INFO:tasks.ceph.osd.3:Started 2023-12-19T16:15:18.073 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T16:15:18.073 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T16:15:18.076 INFO:tasks.ceph.osd.4:Started 2023-12-19T16:15:18.076 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T16:15:18.077 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T16:15:18.080 INFO:tasks.ceph.osd.5:Started 2023-12-19T16:15:18.080 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T16:15:18.080 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T16:15:18.083 INFO:tasks.ceph.osd.6:Started 2023-12-19T16:15:18.083 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T16:15:18.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T16:15:18.088 INFO:tasks.ceph.osd.7:Started 2023-12-19T16:15:18.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:18.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 Processor -- start 2023-12-19T16:15:18.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 -- start start 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b47f0 0x7fef740b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef7415cff0 0x7fef740b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740b7250 con 0x7fef740b4bd0 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740b7530 con 0x7fef7415cff0 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7be20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740b7810 con 0x7fef740b47f0 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef7415cff0 0x7fef740b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fef7415cff0 0x7fef740b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60110/0 (socket says 172.21.15.73:60110) 2023-12-19T16:15:18.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 -- 172.21.15.73:0/1670790903 learned_addr learned my addr 172.21.15.73:0/1670790903 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef79bbc640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b47f0 0x7fef740b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 -- 172.21.15.73:0/1670790903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b47f0 msgr2=0x7fef740b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b47f0 0x7fef740b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 -- 172.21.15.73:0/1670790903 >> v1:172.21.15.162:6789/0 conn(0x7fef740b4bd0 legacy=0x7fef7415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.262+0000 7fef7a3bd640 1 -- 172.21.15.73:0/1670790903 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740b7af0 con 0x7fef7415cff0 2023-12-19T16:15:18.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7a3bd640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef740b5c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009e50 tx=0x7fef6c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76be57b3ba25821 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef78bba640 1 -- 172.21.15.73:0/1670790903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0a5830 con 0x7fef7415cff0 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef78bba640 1 -- 172.21.15.73:0/1670790903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c0a5990 con 0x7fef7415cff0 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef78bba640 1 -- 172.21.15.73:0/1670790903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0a5d20 con 0x7fef7415cff0 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 -- 172.21.15.73:0/1670790903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 msgr2=0x7fef740b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef740b5c40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009e50 tx=0x7fef6c01c950 comp rx=0 tx=0).stop 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 -- 172.21.15.73:0/1670790903 shutdown_connections 2023-12-19T16:15:18.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef740b5c40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 --2- 172.21.15.73:0/1670790903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b47f0 0x7fef740b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 -- 172.21.15.73:0/1670790903 >> 172.21.15.73:0/1670790903 conn(0x7fef74065ce0 msgr2=0x7fef740660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 -- 172.21.15.73:0/1670790903 shutdown_connections 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.266+0000 7fef7be20640 1 -- 172.21.15.73:0/1670790903 wait complete. 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 Processor -- start 2023-12-19T16:15:18.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 -- start start 2023-12-19T16:15:18.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef740b47f0 0x7fef740c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b4bd0 0x7fef740c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c7e30 con 0x7fef7415cff0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef74150530 con 0x7fef740b47f0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef74150810 con 0x7fef740b4bd0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60122/0 (socket says 172.21.15.73:60122) 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef79bbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef740b47f0 0x7fef740c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 -- 172.21.15.73:0/3825522236 learned_addr learned my addr 172.21.15.73:0/3825522236 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef793bb640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b4bd0 0x7fef740c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 -- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b4bd0 msgr2=0x7fef740c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b4bd0 0x7fef740c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 -- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef740b47f0 msgr2=0x7fef740c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef740b47f0 0x7fef740c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 -- 172.21.15.73:0/3825522236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c009b30 con 0x7fef7415cff0 2023-12-19T16:15:18.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7a3bd640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef6c01a580 tx=0x7fef6c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b8670 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c0b87f0 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0b8ba0 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.270+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7415d600 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.274+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef74155330 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.274+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fef6c0c1400 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.274+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fef6c0b6440 con 0x7fef7415cff0 2023-12-19T16:15:18.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.274+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7415d460 con 0x7fef7415cff0 2023-12-19T16:15:18.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.274+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fef6c0dfb40 con 0x7fef7415cff0 2023-12-19T16:15:18.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.330+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef74074050 con 0x7fef7415cff0 2023-12-19T16:15:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.330+0000 7fef6a7fc640 1 -- 172.21.15.73:0/3825522236 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fef6c0ce030 con 0x7fef7415cff0 2023-12-19T16:15:18.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:18.338 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:18.007589+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 msgr2=0x7fef7414d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:18.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef6c01a580 tx=0x7fef6c0196f0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 shutdown_connections 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7415cff0 0x7fef7414d110 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef740b4bd0 0x7fef740c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 --2- 172.21.15.73:0/3825522236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef740b47f0 0x7fef740c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 >> 172.21.15.73:0/3825522236 conn(0x7fef74065ce0 msgr2=0x7fef7415b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 shutdown_connections 2023-12-19T16:15:18.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:18.334+0000 7fef7be20640 1 -- 172.21.15.73:0/3825522236 wait complete. 2023-12-19T16:15:18.358 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T16:15:18.358 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T16:15:18.402 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T16:15:18.402 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T16:15:18.402 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2023-12-19T16:15:18.447 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:18.446+0000 7fae6563a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:15:18.487 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-12-19T16:15:18.485+0000 7fde32a2b640 -1 Falling back to public interface 2023-12-19T16:15:18.537 INFO:tasks.ceph.mgr.x.smithi162.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T16:15:18.538 INFO:tasks.ceph.mgr.x.smithi162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T16:15:18.538 INFO:tasks.ceph.mgr.x.smithi162.stderr: from numpy import show_config as show_numpy_config 2023-12-19T16:15:18.583 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:18.582+0000 7fae6563a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:15:18.589 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:18.585+0000 7fc887e57180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T16:15:18.724 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:18.721+0000 7fc887e57180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:15:18.728 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-12-19T16:15:18.725+0000 7efc72fad640 -1 Falling back to public interface 2023-12-19T16:15:18.729 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-12-19T16:15:18.725+0000 7fb5e5a2c640 -1 Falling back to public interface 2023-12-19T16:15:18.729 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-12-19T16:15:18.725+0000 7efc71f6e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-12-19T16:15:18.743 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-12-19T16:15:18.741+0000 7f921b7da640 -1 Falling back to public interface 2023-12-19T16:15:18.754 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:18.754+0000 7fae6563a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:15:18.755 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-19T16:15:18.754+0000 7f7a1ab43640 -1 Falling back to public interface 2023-12-19T16:15:18.763 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-19T16:15:18.762+0000 7fcd30f13640 -1 Falling back to public interface 2023-12-19T16:15:18.763 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-19T16:15:18.762+0000 7f079fda7640 -1 Falling back to public interface 2023-12-19T16:15:18.766 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-19T16:15:18.766+0000 7fcd2fed4640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6817/0: (98) Address already in use 2023-12-19T16:15:18.771 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-19T16:15:18.770+0000 7fdc8542b640 -1 Falling back to public interface 2023-12-19T16:15:18.830 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:18.826+0000 7fae6563a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:15:18.900 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:18.897+0000 7fc887e57180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T16:15:18.967 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:18.966+0000 7fae6563a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:15:18.973 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:18.969+0000 7fc887e57180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T16:15:19.111 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:19.109+0000 7fc887e57180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T16:15:19.163 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:19.291 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 Processor -- start 2023-12-19T16:15:19.291 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 -- start start 2023-12-19T16:15:19.294 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab200ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.294 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab200ade50 0x7fab200c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.294 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab2006c460 0x7fab2006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2006ce50 con 0x7fab2006c460 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2006d2c0 con 0x7fab200ade50 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab2558f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20069d20 con 0x7fab201604d0 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab2006c460 0x7fab2006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab2006c460 0x7fab2006c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60132/0 (socket says 172.21.15.73:60132) 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 -- 172.21.15.73:0/3940992859 learned_addr learned my addr 172.21.15.73:0/3940992859 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:19.295 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1e7fc640 1 --2- 172.21.15.73:0/3940992859 >> v2:172.21.15.162:3300/0 conn(0x7fab200ade50 0x7fab200c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1effd640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab200ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 -- 172.21.15.73:0/3940992859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 msgr2=0x7fab200ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab200ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 -- 172.21.15.73:0/3940992859 >> v2:172.21.15.162:3300/0 conn(0x7fab200ade50 msgr2=0x7fab200c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 --2- 172.21.15.73:0/3940992859 >> v2:172.21.15.162:3300/0 conn(0x7fab200ade50 0x7fab200c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.296 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.290+0000 7fab1f7fe640 1 -- 172.21.15.73:0/3940992859 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200c9ca0 con 0x7fab2006c460 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab1f7fe640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab2006c460 0x7fab2006c910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab2006e880 tx=0x7fab1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312285ca5e7201bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab1dffb640 1 -- 172.21.15.73:0/3940992859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5820 con 0x7fab2006c460 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab1dffb640 1 -- 172.21.15.73:0/3940992859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a5980 con 0x7fab2006c460 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab1dffb640 1 -- 172.21.15.73:0/3940992859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5d10 con 0x7fab2006c460 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 -- 172.21.15.73:0/3940992859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab2006c460 msgr2=0x7fab2006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab2006c460 0x7fab2006c910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab2006e880 tx=0x7fab1801c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 -- 172.21.15.73:0/3940992859 shutdown_connections 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab2006c460 0x7fab2006c910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 --2- 172.21.15.73:0/3940992859 >> v2:172.21.15.162:3300/0 conn(0x7fab200ade50 0x7fab200c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 --2- 172.21.15.73:0/3940992859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab200ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.299 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 -- 172.21.15.73:0/3940992859 >> 172.21.15.73:0/3940992859 conn(0x7fab200b09b0 msgr2=0x7fab200b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:19.300 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 -- 172.21.15.73:0/3940992859 shutdown_connections 2023-12-19T16:15:19.300 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.294+0000 7fab2558f640 1 -- 172.21.15.73:0/3940992859 wait complete. 2023-12-19T16:15:19.300 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 Processor -- start 2023-12-19T16:15:19.300 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- start start 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2006c460 0x7fab200ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab20150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015fc60 con 0x7fab200ade50 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200ac830 con 0x7fab2006c460 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015f050 con 0x7fab201604d0 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60146/0 (socket says 172.21.15.73:60146) 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 -- 172.21.15.73:0/1511362276 learned_addr learned my addr 172.21.15.73:0/1511362276 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1effd640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2006c460 0x7fab200ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.302 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1f7fe640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab20150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 -- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 msgr2=0x7fab20150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab20150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 -- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2006c460 msgr2=0x7fab200ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2006c460 0x7fab200ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 -- 172.21.15.73:0/1511362276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009b30 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab1e7fc640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab1400e8b0 tx=0x7fab1400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400c940 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1400caa0 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1400ce30 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2015f330 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2015f8f0 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fab14005ca0 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fab14013b40 con 0x7fab200ade50 2023-12-19T16:15:19.303 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.298+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab200740a0 con 0x7fab200ade50 2023-12-19T16:15:19.304 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.302+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fab14021060 con 0x7fab200ade50 2023-12-19T16:15:19.362 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.358+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab200cd070 con 0x7fab200ade50 2023-12-19T16:15:19.362 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab077fe640 1 -- 172.21.15.73:0/1511362276 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fab14029020 con 0x7fab200ade50 2023-12-19T16:15:19.363 INFO:teuthology.misc.health.smithi073.stdout: 2023-12-19T16:15:19.363 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:18.007589+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 msgr2=0x7fab200ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fab1400e8b0 tx=0x7fab1400ed70 comp rx=0 tx=0).stop 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 shutdown_connections 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab201604d0 0x7fab20150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab200ade50 0x7fab200ca090 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 --2- 172.21.15.73:0/1511362276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2006c460 0x7fab200ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 >> 172.21.15.73:0/1511362276 conn(0x7fab200b09b0 msgr2=0x7fab200b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 shutdown_connections 2023-12-19T16:15:19.364 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:19.362+0000 7fab2558f640 1 -- 172.21.15.73:0/1511362276 wait complete. 2023-12-19T16:15:19.381 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T16:15:19.668 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:19.666+0000 7fae6563a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:15:19.754 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:19.750+0000 7fae6563a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:15:19.782 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:19.777+0000 7fc887e57180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T16:15:19.868 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:19.865+0000 7fc887e57180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T16:15:19.943 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:19.942+0000 7fae6563a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:15:20.028 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:20.026+0000 7fae6563a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:15:20.059 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:20.057+0000 7fc887e57180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T16:15:20.143 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:20.141+0000 7fc887e57180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T16:15:20.355 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:20.354+0000 7fae6563a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:15:20.422 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:20.418+0000 7fae6563a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:15:20.483 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:20.481+0000 7fc887e57180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T16:15:20.552 INFO:tasks.ceph.mgr.x.smithi162.stderr:2023-12-19T16:15:20.549+0000 7fc887e57180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T16:15:21.447 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:21.446+0000 7fae0ccec640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T16:15:21.448 INFO:tasks.ceph.mgr.y.smithi073.stderr:2023-12-19T16:15:21.446+0000 7fae0ccec640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T16:15:22.386 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-12-19T16:15:22.385+0000 7fde32a2b640 -1 osd.4 0 log_to_monitors true 2023-12-19T16:15:22.523 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-12-19T16:15:22.521+0000 7fb5e5a2c640 -1 osd.7 0 log_to_monitors true 2023-12-19T16:15:22.592 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-19T16:15:22.590+0000 7f7a1ab43640 -1 osd.2 0 log_to_monitors true 2023-12-19T16:15:22.637 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-12-19T16:15:22.633+0000 7efc72fad640 -1 osd.5 0 log_to_monitors true 2023-12-19T16:15:22.664 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-19T16:15:22.662+0000 7f079fda7640 -1 osd.3 0 log_to_monitors true 2023-12-19T16:15:22.702 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-19T16:15:22.702+0000 7fcd30f13640 -1 osd.1 0 log_to_monitors true 2023-12-19T16:15:22.709 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-12-19T16:15:22.705+0000 7f921b7da640 -1 osd.6 0 log_to_monitors true 2023-12-19T16:15:22.738 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-19T16:15:22.734+0000 7fdc8542b640 -1 osd.0 0 log_to_monitors true 2023-12-19T16:15:24.592 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-12-19T16:15:24.589+0000 7fde2d6aa640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T16:15:24.711 INFO:tasks.ceph.osd.4.smithi162.stderr:2023-12-19T16:15:24.709+0000 7fde25cef640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.189 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:26.406 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.402+0000 7f02afc2d640 1 Processor -- start 2023-12-19T16:15:26.406 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.402+0000 7f02afc2d640 1 -- start start 2023-12-19T16:15:26.407 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 0x7f02a80c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.408 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02a80ad740 0x7f02a80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.408 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.408 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a806da90 con 0x7f02a80adba0 2023-12-19T16:15:26.408 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a806dd70 con 0x7f02a80ad740 2023-12-19T16:15:26.408 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02afc2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a806e050 con 0x7f02a8159a10 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ae1ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 0x7f02a80c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ae1ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56576/0 (socket says 172.21.15.73:56576) 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ae1ca640 1 -- 172.21.15.73:0/1481309644 learned_addr learned my addr 172.21.15.73:0/1481309644 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad1c8640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.162:3300/0 conn(0x7f02a80ad740 0x7f02a80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 -- 172.21.15.73:0/1481309644 >> v2:172.21.15.162:3300/0 conn(0x7f02a80ad740 msgr2=0x7f02a80b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.162:3300/0 conn(0x7f02a80ad740 0x7f02a80b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 -- 172.21.15.73:0/1481309644 >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 msgr2=0x7f02a80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.409 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ad9c9640 1 -- 172.21.15.73:0/1481309644 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80cc320 con 0x7f02a8159a10 2023-12-19T16:15:26.410 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.406+0000 7f02ae1ca640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:26.413 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.410+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/1481309644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 0x7f02a80c8d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02a8071430 tx=0x7f02a001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44657f8bb5e397 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.410+0000 7f02ac9c7640 1 -- 172.21.15.73:0/1481309644 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ab600 con 0x7f02a8159a10 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.410+0000 7f02ac9c7640 1 -- 172.21.15.73:0/1481309644 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00a7050 con 0x7f02a8159a10 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.410+0000 7f02ac9c7640 1 -- 172.21.15.73:0/1481309644 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ab980 con 0x7f02a8159a10 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 -- 172.21.15.73:0/1481309644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 msgr2=0x7f02a80c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 --2- 172.21.15.73:0/1481309644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 0x7f02a80c8d00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02a8071430 tx=0x7f02a001c3a0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 -- 172.21.15.73:0/1481309644 shutdown_connections 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.73:3300/0 conn(0x7f02a80adba0 0x7f02a80b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 --2- 172.21.15.73:0/1481309644 >> v2:172.21.15.162:3300/0 conn(0x7f02a80ad740 0x7f02a80b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 --2- 172.21.15.73:0/1481309644 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a8159a10 0x7f02a80c8d00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.416 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 -- 172.21.15.73:0/1481309644 >> 172.21.15.73:0/1481309644 conn(0x7f02a806a760 msgr2=0x7f02a80cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.417 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 -- 172.21.15.73:0/1481309644 shutdown_connections 2023-12-19T16:15:26.417 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.414+0000 7f02afc2d640 1 -- 172.21.15.73:0/1481309644 wait complete. 2023-12-19T16:15:26.418 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 Processor -- start 2023-12-19T16:15:26.419 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-12-19T16:15:26.417+0000 7f9216f5e640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T16:15:26.419 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 -- start start 2023-12-19T16:15:26.423 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.423 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a80adba0 0x7f02a8144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.423 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02a8159a10 0x7f02a80af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80c1340 con 0x7f02a80adba0 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80afef0 con 0x7f02a8159a10 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02afc2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80b01d0 con 0x7f02a80ad740 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:44184/0 (socket says 172.21.15.73:44184) 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 -- 172.21.15.73:0/674351376 learned_addr learned my addr 172.21.15.73:0/674351376 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:26.424 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ae1ca640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02a8159a10 0x7f02a80af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad1c8640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a80adba0 0x7f02a8144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 -- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02a8159a10 msgr2=0x7f02a80af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02a8159a10 0x7f02a80af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 -- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a80adba0 msgr2=0x7f02a8144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a80adba0 0x7f02a8144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.425 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 -- 172.21.15.73:0/674351376 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900094d0 con 0x7f02a80ad740 2023-12-19T16:15:26.426 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.418+0000 7f02ad9c9640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02a0019fd0 tx=0x7f02a0019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.426 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00abe70 con 0x7f02a80ad740 2023-12-19T16:15:26.426 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00b6700 con 0x7f02a80ad740 2023-12-19T16:15:26.426 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00b6a70 con 0x7f02a80ad740 2023-12-19T16:15:26.426 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0009420 con 0x7f02a80ad740 2023-12-19T16:15:26.427 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a80b0790 con 0x7f02a80ad740 2023-12-19T16:15:26.427 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a80740a0 con 0x7f02a80ad740 2023-12-19T16:15:26.427 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.422+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f02a00b2040 con 0x7f02a80ad740 2023-12-19T16:15:26.428 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.426+0000 7f02a67fc640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 0x7f0288067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:26.428 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.426+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f02a00f2e90 con 0x7f02a80ad740 2023-12-19T16:15:26.429 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.426+0000 7f02ad1c8640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 0x7f0288067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:26.432 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.430+0000 7f02ad1c8640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 0x7f0288067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02a80aeeb0 tx=0x7f029800b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:26.435 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.434+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02a00eead0 con 0x7f02a80ad740 2023-12-19T16:15:26.441 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-12-19T16:15:26.437+0000 7efc6e72f640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T16:15:26.451 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-12-19T16:15:26.449+0000 7fb5e074e640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T16:15:26.467 INFO:tasks.ceph.osd.6.smithi162.stderr:2023-12-19T16:15:26.465+0000 7f920f5a3640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.483 INFO:tasks.ceph.osd.5.smithi162.stderr:2023-12-19T16:15:26.481+0000 7efc66d74640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.483 INFO:tasks.ceph.osd.7.smithi162.stderr:2023-12-19T16:15:26.481+0000 7fb5d8d93640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.813 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.810+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02a806b0f0 con 0x7f02a80ad740 2023-12-19T16:15:26.814 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.810+0000 7f02a67fc640 1 -- 172.21.15.73:0/674351376 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8807 (secure 0 0 0) 0x7f02a00b0070 con 0x7f02a80ad740 2023-12-19T16:15:26.814 INFO:teuthology.misc.health.smithi073.stdout: 2023-12-19T16:15:26.814 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":15,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:26.797181+0000","last_up_change":"2023-12-19T16:15:26.797181+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:26.817 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 msgr2=0x7f0288067e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.817 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 0x7f0288067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02a80aeeb0 tx=0x7f029800b040 comp rx=0 tx=0).stop 2023-12-19T16:15:26.817 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 msgr2=0x7f02a80c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f02a0019fd0 tx=0x7f02a0019140 comp rx=0 tx=0).stop 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 shutdown_connections 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02a8159a10 0x7f02a80af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f02880659d0 0x7f0288067e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a80adba0 0x7f02a8144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 --2- 172.21.15.73:0/674351376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02a80ad740 0x7f02a80c0e00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 >> 172.21.15.73:0/674351376 conn(0x7f02a806a760 msgr2=0x7f02a815ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 shutdown_connections 2023-12-19T16:15:26.818 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:26.814+0000 7f02afc2d640 1 -- 172.21.15.73:0/674351376 wait complete. 2023-12-19T16:15:26.848 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-12-19T16:15:26.875 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-19T16:15:26.870+0000 7f079b529640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T16:15:26.899 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-19T16:15:26.898+0000 7fdc823e8640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T16:15:26.911 INFO:tasks.ceph.osd.3.smithi073.stderr:2023-12-19T16:15:26.910+0000 7f0793b6e640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.911 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-19T16:15:26.910+0000 7f7a162c7640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T16:15:26.943 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-12-19T16:15:26.942+0000 7fdc791f2640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.950 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-12-19T16:15:26.950+0000 7f7a0e90c640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:26.954 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-19T16:15:26.950+0000 7fcd2c695640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T16:15:26.999 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-12-19T16:15:26.998+0000 7fcd24cda640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T16:15:33.655 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:33.791 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 Processor -- start 2023-12-19T16:15:33.791 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 -- start start 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb78c159a10 0x7fb78c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb78c0ad740 0x7fb78c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78c06da90 con 0x7fb78c0adba0 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c06dd70 con 0x7fb78c0ad740 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb79158f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb78c06e050 con 0x7fb78c159a10 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb78c0ad740 0x7fb78c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb78c0ad740 0x7fb78c0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56622/0 (socket says 172.21.15.73:56622) 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 -- 172.21.15.73:0/1205443235 learned_addr learned my addr 172.21.15.73:0/1205443235 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:33.793 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb78affd640 1 --2- 172.21.15.73:0/1205443235 >> v2:172.21.15.162:3300/0 conn(0x7fb78c159a10 0x7fb78c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.794 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 -- 172.21.15.73:0/1205443235 >> v2:172.21.15.162:3300/0 conn(0x7fb78c159a10 msgr2=0x7fb78c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:33.794 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 --2- 172.21.15.73:0/1205443235 >> v2:172.21.15.162:3300/0 conn(0x7fb78c159a10 0x7fb78c0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.794 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 -- 172.21.15.73:0/1205443235 >> v1:172.21.15.162:6789/0 conn(0x7fb78c0adba0 legacy=0x7fb78c0cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.794 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.790+0000 7fb7827fc640 1 -- 172.21.15.73:0/1205443235 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c0cc320 con 0x7fb78c0ad740 2023-12-19T16:15:33.795 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb7827fc640 1 --2- 172.21.15.73:0/1205443235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c0ad740 0x7fb78c0b0130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb78c06e600 tx=0x7fb77c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81127761c2a27d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.796 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb78a7fc640 1 -- 172.21.15.73:0/1205443235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c004230 con 0x7fb78c0ad740 2023-12-19T16:15:33.796 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb78a7fc640 1 -- 172.21.15.73:0/1205443235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c0a7050 con 0x7fb78c0ad740 2023-12-19T16:15:33.796 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb78a7fc640 1 -- 172.21.15.73:0/1205443235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c003620 con 0x7fb78c0ad740 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 -- 172.21.15.73:0/1205443235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c0ad740 msgr2=0x7fb78c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 --2- 172.21.15.73:0/1205443235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c0ad740 0x7fb78c0b0130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb78c06e600 tx=0x7fb77c01c440 comp rx=0 tx=0).stop 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 -- 172.21.15.73:0/1205443235 shutdown_connections 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 --2- 172.21.15.73:0/1205443235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c0ad740 0x7fb78c0b0130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 --2- 172.21.15.73:0/1205443235 >> v2:172.21.15.162:3300/0 conn(0x7fb78c159a10 0x7fb78c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 -- 172.21.15.73:0/1205443235 >> 172.21.15.73:0/1205443235 conn(0x7fb78c06a760 msgr2=0x7fb78c0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 -- 172.21.15.73:0/1205443235 shutdown_connections 2023-12-19T16:15:33.797 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 -- 172.21.15.73:0/1205443235 wait complete. 2023-12-19T16:15:33.798 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.794+0000 7fb79158f640 1 Processor -- start 2023-12-19T16:15:33.798 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- start start 2023-12-19T16:15:33.800 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb78c0ad740 0x7fb78c140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.800 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78c0adba0 0x7fb78c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.800 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c140ea0 con 0x7fb78c159a10 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c163a60 con 0x7fb78c0ad740 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c163d40 con 0x7fb78c0adba0 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56638/0 (socket says 172.21.15.73:56638) 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 -- 172.21.15.73:0/3657555907 learned_addr learned my addr 172.21.15.73:0/3657555907 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78affd640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb78c0ad740 0x7fb78c140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb7827fc640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78c0adba0 0x7fb78c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 -- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78c0adba0 msgr2=0x7fb78c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78c0adba0 0x7fb78c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 -- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb78c0ad740 msgr2=0x7fb78c140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb78c0ad740 0x7fb78c140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.801 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 -- 172.21.15.73:0/3657555907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0094d0 con 0x7fb78c159a10 2023-12-19T16:15:33.802 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb78b7fe640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb78400c770 tx=0x7fb78400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.802 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784003b80 con 0x7fb78c159a10 2023-12-19T16:15:33.802 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb784003ce0 con 0x7fb78c159a10 2023-12-19T16:15:33.803 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78c164020 con 0x7fb78c159a10 2023-12-19T16:15:33.803 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400aa90 con 0x7fb78c159a10 2023-12-19T16:15:33.803 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78c15b4e0 con 0x7fb78c159a10 2023-12-19T16:15:33.803 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.798+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78c0ae700 con 0x7fb78c159a10 2023-12-19T16:15:33.803 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.802+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb78400abf0 con 0x7fb78c159a10 2023-12-19T16:15:33.804 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.802+0000 7fb783fff640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 0x7fb76c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:33.804 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.802+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb784082bc0 con 0x7fb78c159a10 2023-12-19T16:15:33.804 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.802+0000 7fb78affd640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 0x7fb76c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:33.804 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.802+0000 7fb78affd640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 0x7fb76c067f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb78c1555b0 tx=0x7fb774008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:33.809 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.806+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb78c0ae700 con 0x7fb78c159a10 2023-12-19T16:15:33.958 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.954+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb78c0ae700 con 0x7fb78c159a10 2023-12-19T16:15:33.959 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb783fff640 1 -- 172.21.15.73:0/3657555907 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7fb78c0ae700 con 0x7fb78c159a10 2023-12-19T16:15:33.959 INFO:teuthology.misc.health.smithi073.stdout: 2023-12-19T16:15:33.959 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":19,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:30.930581+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:33.960 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 msgr2=0x7fb76c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 0x7fb76c067f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb78c1555b0 tx=0x7fb774008040 comp rx=0 tx=0).stop 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 msgr2=0x7fb78c15ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb78400c770 tx=0x7fb78400cc30 comp rx=0 tx=0).stop 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 shutdown_connections 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb76c065a60 0x7fb76c067f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb78c159a10 0x7fb78c15ae60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb78c0adba0 0x7fb78c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.961 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 --2- 172.21.15.73:0/3657555907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb78c0ad740 0x7fb78c140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:33.962 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 >> 172.21.15.73:0/3657555907 conn(0x7fb78c06a760 msgr2=0x7fb78c15dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:33.962 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 shutdown_connections 2023-12-19T16:15:33.962 INFO:teuthology.misc.health.smithi073.stderr:2023-12-19T16:15:33.958+0000 7fb79158f640 1 -- 172.21.15.73:0/3657555907 wait complete. 2023-12-19T16:15:33.978 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T16:15:33.978 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T16:15:33.978 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:15:33.978 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:15:33.982 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:15:33.982 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:15:33.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:15:33.985 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:15:33.986 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:15:33.986 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:15:33.990 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:15:33.990 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:15:33.990 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:15:33.993 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:15:33.994 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T16:15:33.994 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:34.084 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-19T16:15:34.085 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:15:34.097 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:15:34.098 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:15:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 Processor -- start 2023-12-19T16:15:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 -- start start 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52680b47f0 0x7f52680b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52680b4bd0 0x7f526815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f526815ce20 0x7f52680d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526815d290 con 0x7f52680b47f0 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680b7250 con 0x7f526815ce20 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f527050a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b7530 con 0x7f52680b4bd0 2023-12-19T16:15:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52680b47f0 0x7f52680b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52680b47f0 0x7f52680b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56674/0 (socket says 172.21.15.73:56674) 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 -- 172.21.15.73:0/3857009609 learned_addr learned my addr 172.21.15.73:0/3857009609 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526eaa7640 1 --2- 172.21.15.73:0/3857009609 >> v2:172.21.15.162:3300/0 conn(0x7f526815ce20 0x7f52680d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526daa5640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52680b4bd0 0x7f526815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 -- 172.21.15.73:0/3857009609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52680b4bd0 msgr2=0x7f526815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52680b4bd0 0x7f526815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 -- 172.21.15.73:0/3857009609 >> v2:172.21.15.162:3300/0 conn(0x7f526815ce20 msgr2=0x7f52680d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 --2- 172.21.15.73:0/3857009609 >> v2:172.21.15.162:3300/0 conn(0x7f526815ce20 0x7f52680d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.142+0000 7f526e2a6640 1 -- 172.21.15.73:0/3857009609 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680b7810 con 0x7f52680b47f0 2023-12-19T16:15:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f526e2a6640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f52680b8430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f526808be30 tx=0x7f526401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0e79a4ee715766 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f526d2a4640 1 -- 172.21.15.73:0/3857009609 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640ab600 con 0x7f52680b47f0 2023-12-19T16:15:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f526d2a4640 1 -- 172.21.15.73:0/3857009609 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52640ab760 con 0x7f52680b47f0 2023-12-19T16:15:34.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f526d2a4640 1 -- 172.21.15.73:0/3857009609 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640abaf0 con 0x7f52680b47f0 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 -- 172.21.15.73:0/3857009609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 msgr2=0x7f52680b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f52680b8430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f526808be30 tx=0x7f526401c440 comp rx=0 tx=0).stop 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 -- 172.21.15.73:0/3857009609 shutdown_connections 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 --2- 172.21.15.73:0/3857009609 >> v2:172.21.15.162:3300/0 conn(0x7f526815ce20 0x7f52680d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52680b4bd0 0x7f526815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 --2- 172.21.15.73:0/3857009609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f52680b8430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 -- 172.21.15.73:0/3857009609 >> 172.21.15.73:0/3857009609 conn(0x7f5268065ce0 msgr2=0x7f52680660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 -- 172.21.15.73:0/3857009609 shutdown_connections 2023-12-19T16:15:34.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.146+0000 7f527050a640 1 -- 172.21.15.73:0/3857009609 wait complete. 2023-12-19T16:15:34.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 Processor -- start 2023-12-19T16:15:34.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- start start 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52680b4bd0 0x7f52680c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526815ce20 0x7f526814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268155020 con 0x7f52680b47f0 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526814b890 con 0x7f52680b4bd0 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c8a70 con 0x7f526815ce20 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56678/0 (socket says 172.21.15.73:56678) 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 -- 172.21.15.73:0/1430039706 learned_addr learned my addr 172.21.15.73:0/1430039706 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526eaa7640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526815ce20 0x7f526814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526daa5640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52680b4bd0 0x7f52680c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 -- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526815ce20 msgr2=0x7f526814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526815ce20 0x7f526814e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 -- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52680b4bd0 msgr2=0x7f52680c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52680b4bd0 0x7f52680c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 -- 172.21.15.73:0/1430039706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640094d0 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f526e2a6640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f526401aaf0 tx=0x7f526401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640ab600 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52640b4800 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640b4b70 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526814ee70 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681495b0 con 0x7f52680b47f0 2023-12-19T16:15:34.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.150+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5268074050 con 0x7f52680b47f0 2023-12-19T16:15:34.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.154+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f52640b4cd0 con 0x7f52680b47f0 2023-12-19T16:15:34.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.154+0000 7f525effd640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 0x7f524c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.154+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f526411d500 con 0x7f52680b47f0 2023-12-19T16:15:34.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.154+0000 7f526daa5640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 0x7f524c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.154+0000 7f526daa5640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 0x7f524c067f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5268156f30 tx=0x7f5258008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.158+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f52640eb220 con 0x7f52680b47f0 2023-12-19T16:15:34.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52680cfd90 con 0x7f52680b47f0 2023-12-19T16:15:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f525effd640 1 -- 172.21.15.73:0/1430039706 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f52640ee840 con 0x7f52680b47f0 2023-12-19T16:15:34.312 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:34.312 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:30.930581+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 msgr2=0x7f524c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 0x7f524c067f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5268156f30 tx=0x7f5258008040 comp rx=0 tx=0).stop 2023-12-19T16:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 msgr2=0x7f526814da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f526401aaf0 tx=0x7f526401ac80 comp rx=0 tx=0).stop 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 shutdown_connections 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f526815ce20 0x7f526814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52680b4bd0 0x7f52680c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f524c065a90 0x7f524c067f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 --2- 172.21.15.73:0/1430039706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680b47f0 0x7f526814da60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 >> 172.21.15.73:0/1430039706 conn(0x7f5268065ce0 msgr2=0x7f52680c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 shutdown_connections 2023-12-19T16:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.310+0000 7f527050a640 1 -- 172.21.15.73:0/1430039706 wait complete. 2023-12-19T16:15:34.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:34.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 Processor -- start 2023-12-19T16:15:34.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 -- start start 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 0x7fb04406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 0x7fb0440b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0440b0ac0 con 0x7fb0440b0660 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440cce80 con 0x7fb04406d410 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb04a2fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04406cad0 con 0x7fb0441598c0 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb048899640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0440b0660 0x7fb0440c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41878/0 (socket says 172.21.15.73:41878) 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb048899640 1 -- 172.21.15.73:0/2519535785 learned_addr learned my addr 172.21.15.73:0/2519535785 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb043fff640 1 --2- 172.21.15.73:0/2519535785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 0x7fb04406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb0437fe640 1 --2- 172.21.15.73:0/2519535785 >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 0x7fb0440b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb042ffd640 1 -- 172.21.15.73:0/2519535785 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783405447 0 0) 0x7fb0440b0ac0 con 0x7fb0440b0660 2023-12-19T16:15:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb042ffd640 1 -- 172.21.15.73:0/2519535785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c003530 con 0x7fb0440b0660 2023-12-19T16:15:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb043fff640 1 -- 172.21.15.73:0/2519535785 >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 msgr2=0x7fb0440b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb043fff640 1 --2- 172.21.15.73:0/2519535785 >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 0x7fb0440b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb043fff640 1 -- 172.21.15.73:0/2519535785 >> v1:172.21.15.73:6789/0 conn(0x7fb0440b0660 legacy=0x7fb0440c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb043fff640 1 -- 172.21.15.73:0/2519535785 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440cc270 con 0x7fb0441598c0 2023-12-19T16:15:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.474+0000 7fb0437fe640 1 --2- 172.21.15.73:0/2519535785 >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 0x7fb0440b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb043fff640 1 --2- 172.21.15.73:0/2519535785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 0x7fb04406c590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0340097c0 tx=0x7fb03401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=702080bd0b47a8e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb042ffd640 1 -- 172.21.15.73:0/2519535785 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0340ab680 con 0x7fb0441598c0 2023-12-19T16:15:34.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb042ffd640 1 -- 172.21.15.73:0/2519535785 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0340ab7e0 con 0x7fb0441598c0 2023-12-19T16:15:34.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb042ffd640 1 -- 172.21.15.73:0/2519535785 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0340abb70 con 0x7fb0441598c0 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2519535785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 msgr2=0x7fb04406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2519535785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 0x7fb04406c590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0340097c0 tx=0x7fb03401c480 comp rx=0 tx=0).stop 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2519535785 shutdown_connections 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2519535785 >> v2:172.21.15.162:3300/0 conn(0x7fb04406d410 0x7fb0440b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2519535785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0441598c0 0x7fb04406c590 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2519535785 >> 172.21.15.73:0/2519535785 conn(0x7fb04406a570 msgr2=0x7fb0440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2519535785 shutdown_connections 2023-12-19T16:15:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.478+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2519535785 wait complete. 2023-12-19T16:15:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 Processor -- start 2023-12-19T16:15:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 -- start start 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 0x7fb044150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440b0660 0x7fb044156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0441510a0 con 0x7fb0441598c0 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044163610 con 0x7fb0440b0660 2023-12-19T16:15:34.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb044163330 con 0x7fb04406d410 2023-12-19T16:15:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56688/0 (socket says 172.21.15.73:56688) 2023-12-19T16:15:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 -- 172.21.15.73:0/2442224572 learned_addr learned my addr 172.21.15.73:0/2442224572 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb0437fe640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440b0660 0x7fb044156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb043fff640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 0x7fb044150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 -- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 msgr2=0x7fb044150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 0x7fb044150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 -- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440b0660 msgr2=0x7fb044156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440b0660 0x7fb044156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 -- 172.21.15.73:0/2442224572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009420 con 0x7fb0441598c0 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb043fff640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 0x7fb044150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb048899640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00cb40 tx=0x7fb03c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00aca0 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00ae00 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c012620 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.482+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb034009420 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0440af150 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04404e070 con 0x7fb0441598c0 2023-12-19T16:15:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb03c007070 con 0x7fb0441598c0 2023-12-19T16:15:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb040ff9640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 0x7fb030067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb03c082df0 con 0x7fb0441598c0 2023-12-19T16:15:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb043fff640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 0x7fb030067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.486+0000 7fb043fff640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 0x7fb030067f20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0340af000 tx=0x7fb0340b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.490+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb03c050ba0 con 0x7fb0441598c0 2023-12-19T16:15:34.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0440c4640 con 0x7fb0441598c0 2023-12-19T16:15:34.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb040ff9640 1 -- 172.21.15.73:0/2442224572 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb03c017020 con 0x7fb0441598c0 2023-12-19T16:15:34.645 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:15:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 msgr2=0x7fb030067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 0x7fb030067f20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0340af000 tx=0x7fb0340b6040 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 msgr2=0x7fb0440cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00cb40 tx=0x7fb03c00a060 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 shutdown_connections 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb030065a60 0x7fb030067f20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0441598c0 0x7fb0440cb330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0440b0660 0x7fb044156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 --2- 172.21.15.73:0/2442224572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb04406d410 0x7fb044150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.642+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 >> 172.21.15.73:0/2442224572 conn(0x7fb04406a570 msgr2=0x7fb0440acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.646+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 shutdown_connections 2023-12-19T16:15:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.646+0000 7fb04a2fc640 1 -- 172.21.15.73:0/2442224572 wait complete. 2023-12-19T16:15:34.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.798+0000 7f39d9097640 1 Processor -- start 2023-12-19T16:15:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d9097640 1 -- start start 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d9097640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d9097640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d40cf2d0 con 0x7f39d4070e20 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d9097640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d4070990 con 0x7f39d415a9a0 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d9097640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d415ad80 con 0x7f39d40ce930 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d8896640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f39d4070e20 0x7f39d40712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49982/0 (socket says 172.21.15.73:49982) 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d8896640 1 -- 172.21.15.73:0/834702101 learned_addr learned my addr 172.21.15.73:0/834702101 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:34.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d37fe640 1 --2- 172.21.15.73:0/834702101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108381687 0 0) 0x7f39d40cf2d0 con 0x7f39d4070e20 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39bc003530 con 0x7f39d4070e20 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d37fe640 1 -- 172.21.15.73:0/834702101 >> v1:172.21.15.162:6789/0 conn(0x7f39d415a9a0 legacy=0x7f39d40b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461259258 0 0) 0x7f39d4070990 con 0x7f39d415a9a0 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d37fe640 1 -- 172.21.15.73:0/834702101 >> v1:172.21.15.73:6789/0 conn(0x7f39d4070e20 legacy=0x7f39d40712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.802+0000 7f39d37fe640 1 -- 172.21.15.73:0/834702101 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d406de20 con 0x7f39d40ce930 2023-12-19T16:15:34.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d37fe640 1 --2- 172.21.15.73:0/834702101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40ced90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097f0 tx=0x7f39c801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=301ede88b4cce19d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80a7070 con 0x7f39d40ce930 2023-12-19T16:15:34.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80ab430 con 0x7f39d40ce930 2023-12-19T16:15:34.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d2ffd640 1 -- 172.21.15.73:0/834702101 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80ab7c0 con 0x7f39d40ce930 2023-12-19T16:15:34.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- 172.21.15.73:0/834702101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 msgr2=0x7f39d40ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 --2- 172.21.15.73:0/834702101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40ced90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39c80097f0 tx=0x7f39c801c430 comp rx=0 tx=0).stop 2023-12-19T16:15:34.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- 172.21.15.73:0/834702101 shutdown_connections 2023-12-19T16:15:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 --2- 172.21.15.73:0/834702101 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40ced90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- 172.21.15.73:0/834702101 >> 172.21.15.73:0/834702101 conn(0x7f39d406a120 msgr2=0x7f39d406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- 172.21.15.73:0/834702101 shutdown_connections 2023-12-19T16:15:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- 172.21.15.73:0/834702101 wait complete. 2023-12-19T16:15:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 Processor -- start 2023-12-19T16:15:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.806+0000 7f39d9097640 1 -- start start 2023-12-19T16:15:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 0x7f39d41586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4157c60 con 0x7f39d415a9a0 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d40ad240 con 0x7f39d4070e20 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4156960 con 0x7f39d40ce930 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58694/0 (socket says 172.21.15.73:58694) 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 -- 172.21.15.73:0/3498028247 learned_addr learned my addr 172.21.15.73:0/3498028247 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d37fe640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 -- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 msgr2=0x7f39d40c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 -- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 msgr2=0x7f39d41586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d3fff640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 0x7f39d41586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 0x7f39d41586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 -- 172.21.15.73:0/3498028247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009420 con 0x7f39d415a9a0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d37fe640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d3fff640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 0x7f39d41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d8896640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c9f0 tx=0x7f39cc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc00ab70 con 0x7f39d415a9a0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39cc00acd0 con 0x7f39d415a9a0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4156c40 con 0x7f39d415a9a0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39cc012600 con 0x7f39d415a9a0 2023-12-19T16:15:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4157200 con 0x7f39d415a9a0 2023-12-19T16:15:34.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.810+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d41573f0 con 0x7f39d415a9a0 2023-12-19T16:15:34.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.814+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39cc007070 con 0x7f39d415a9a0 2023-12-19T16:15:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.814+0000 7f39d0ff9640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 0x7f39c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.814+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39cc082b60 con 0x7f39d415a9a0 2023-12-19T16:15:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.814+0000 7f39d3fff640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 0x7f39c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.814+0000 7f39d3fff640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 0x7f39c0067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39c4000f70 tx=0x7f39c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.818+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39cc0509b0 con 0x7f39d415a9a0 2023-12-19T16:15:34.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39d40705f0 con 0x7f39d415a9a0 2023-12-19T16:15:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d0ff9640 1 -- 172.21.15.73:0/3498028247 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f39cc017020 con 0x7f39d415a9a0 2023-12-19T16:15:35.000 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:35.000 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T16:15:35.000 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 msgr2=0x7f39c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 0x7f39c0067f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39c4000f70 tx=0x7f39c4009040 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 msgr2=0x7f39d4157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c9f0 tx=0x7f39cc00ceb0 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 shutdown_connections 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39c0065a60 0x7f39c0067f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d415a9a0 0x7f39d4157720 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d40ce930 0x7f39d40c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 --2- 172.21.15.73:0/3498028247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d4070e20 0x7f39d41586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 >> 172.21.15.73:0/3498028247 conn(0x7f39d406a120 msgr2=0x7f39d40b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 shutdown_connections 2023-12-19T16:15:35.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:34.998+0000 7f39d9097640 1 -- 172.21.15.73:0/3498028247 wait complete. 2023-12-19T16:15:37.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:37.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 Processor -- start 2023-12-19T16:15:37.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 -- start start 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 0x7f98480cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 0x7f98480c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98480c9940 con 0x7f98480c8fa0 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984806d720 con 0x7f98480b26a0 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984f62d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984815e3a0 con 0x7f984815dfc0 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984cbc8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98480c8fa0 0x7f9848070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49992/0 (socket says 172.21.15.73:49992) 2023-12-19T16:15:37.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984cbc8640 1 -- 172.21.15.73:0/2975342713 learned_addr learned my addr 172.21.15.73:0/2975342713 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984d3c9640 1 --2- 172.21.15.73:0/2975342713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 0x7f98480cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f984dbca640 1 --2- 172.21.15.73:0/2975342713 >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 0x7f98480c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992538342 0 0) 0x7f98480c9940 con 0x7f98480c8fa0 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.169+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9834003530 con 0x7f98480c8fa0 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984d3c9640 1 -- 172.21.15.73:0/2975342713 >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 msgr2=0x7f98480c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984d3c9640 1 --2- 172.21.15.73:0/2975342713 >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 0x7f98480c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984d3c9640 1 -- 172.21.15.73:0/2975342713 >> v1:172.21.15.73:6789/0 conn(0x7f98480c8fa0 legacy=0x7f9848070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536845901 0 0) 0x7f9834003530 con 0x7f98480c8fa0 2023-12-19T16:15:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984d3c9640 1 -- 172.21.15.73:0/2975342713 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984806c3a0 con 0x7f984815dfc0 2023-12-19T16:15:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984dbca640 1 --2- 172.21.15.73:0/2975342713 >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 0x7f98480c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:37.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f984d3c9640 1 --2- 172.21.15.73:0/2975342713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 0x7f98480cbac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98440097c0 tx=0x7f984401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc718f131524390 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838001680 con 0x7f984815dfc0 2023-12-19T16:15:37.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98440a7050 con 0x7f984815dfc0 2023-12-19T16:15:37.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.173+0000 7f983ffff640 1 -- 172.21.15.73:0/2975342713 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98440ab620 con 0x7f984815dfc0 2023-12-19T16:15:37.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- 172.21.15.73:0/2975342713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 msgr2=0x7f98480cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- 172.21.15.73:0/2975342713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 0x7f98480cbac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f98440097c0 tx=0x7f984401c370 comp rx=0 tx=0).stop 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- 172.21.15.73:0/2975342713 shutdown_connections 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- 172.21.15.73:0/2975342713 >> v2:172.21.15.162:3300/0 conn(0x7f98480b26a0 0x7f98480c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- 172.21.15.73:0/2975342713 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f984815dfc0 0x7f98480cbac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- 172.21.15.73:0/2975342713 >> 172.21.15.73:0/2975342713 conn(0x7f98480b0270 msgr2=0x7f98480b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- 172.21.15.73:0/2975342713 shutdown_connections 2023-12-19T16:15:37.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- 172.21.15.73:0/2975342713 wait complete. 2023-12-19T16:15:37.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 Processor -- start 2023-12-19T16:15:37.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- start start 2023-12-19T16:15:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98480b26a0 0x7f98480c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98480c8fa0 0x7f984815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480ccf80 con 0x7f984815dfc0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480cc370 con 0x7f98480b26a0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984f62d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98480cc650 con 0x7f98480c8fa0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58700/0 (socket says 172.21.15.73:58700) 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 -- 172.21.15.73:0/4215358898 learned_addr learned my addr 172.21.15.73:0/4215358898 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984d3c9640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98480b26a0 0x7f98480c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984cbc8640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98480c8fa0 0x7f984815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 -- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98480c8fa0 msgr2=0x7f984815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98480c8fa0 0x7f984815aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 -- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98480b26a0 msgr2=0x7f98480c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98480b26a0 0x7f98480c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 -- 172.21.15.73:0/4215358898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009a70 con 0x7f984815dfc0 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.177+0000 7f984dbca640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f984000efb0 tx=0x7f984000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840009d50 con 0x7f984815dfc0 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984000f040 con 0x7f984815dfc0 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400146a0 con 0x7f984815dfc0 2023-12-19T16:15:37.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9844009420 con 0x7f984815dfc0 2023-12-19T16:15:37.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98480ccc10 con 0x7f984815dfc0 2023-12-19T16:15:37.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98480cd0f0 con 0x7f984815dfc0 2023-12-19T16:15:37.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9840014800 con 0x7f984815dfc0 2023-12-19T16:15:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 0x7f982c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9840083d30 con 0x7f984815dfc0 2023-12-19T16:15:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.181+0000 7f984d3c9640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 0x7f982c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.185+0000 7f984d3c9640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 0x7f982c067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f98440ad000 tx=0x7f9844008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.185+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9840051af0 con 0x7f984815dfc0 2023-12-19T16:15:37.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.369+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9848074050 con 0x7f984815dfc0 2023-12-19T16:15:37.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f983dffb640 1 -- 172.21.15.73:0/4215358898 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f9840018020 con 0x7f984815dfc0 2023-12-19T16:15:37.375 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:37.375 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T16:15:37.375 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2023-12-19T16:15:37.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 msgr2=0x7f982c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 0x7f982c067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f98440ad000 tx=0x7f9844008040 comp rx=0 tx=0).stop 2023-12-19T16:15:37.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 msgr2=0x7f98480af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f984000efb0 tx=0x7f984000c490 comp rx=0 tx=0).stop 2023-12-19T16:15:37.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 shutdown_connections 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f982c065a60 0x7f982c067f20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f984815dfc0 0x7f98480af230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98480c8fa0 0x7f984815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 --2- 172.21.15.73:0/4215358898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98480b26a0 0x7f98480c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 >> 172.21.15.73:0/4215358898 conn(0x7f98480b0270 msgr2=0x7f9848156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 shutdown_connections 2023-12-19T16:15:37.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.373+0000 7f984f62d640 1 -- 172.21.15.73:0/4215358898 wait complete. 2023-12-19T16:15:37.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:37.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.529+0000 7efeb0803640 1 Processor -- start 2023-12-19T16:15:37.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.529+0000 7efeb0803640 1 -- start start 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeb0803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeb0803640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efeac0ce930 0x7efeac0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeb0803640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac06c080 con 0x7efeac0ccae0 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeb0803640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0cf300 con 0x7efeac0ce930 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeb0803640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac159cb0 con 0x7efeac15d3a0 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efeac0ce930 0x7efeac0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efeac0ce930 0x7efeac0cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58712/0 (socket says 172.21.15.73:58712) 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 -- 172.21.15.73:0/3312974055 learned_addr learned my addr 172.21.15.73:0/3312974055 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:37.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efea3fff640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 -- 172.21.15.73:0/3312974055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 msgr2=0x7efeac0b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:37.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 -- 172.21.15.73:0/3312974055 >> v1:172.21.15.162:6789/0 conn(0x7efeac0ccae0 legacy=0x7efeac0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 -- 172.21.15.73:0/3312974055 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0ccec0 con 0x7efeac0ce930 2023-12-19T16:15:37.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeab59e640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac0cedc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea401ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8e021936231b9f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeaa59c640 1 -- 172.21.15.73:0/3312974055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40a7a00 con 0x7efeac0ce930 2023-12-19T16:15:37.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeaa59c640 1 -- 172.21.15.73:0/3312974055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40a7b60 con 0x7efeac0ce930 2023-12-19T16:15:37.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.533+0000 7efeaa59c640 1 -- 172.21.15.73:0/3312974055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40af3f0 con 0x7efeac0ce930 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- 172.21.15.73:0/3312974055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 msgr2=0x7efeac0cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac0cedc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea401ec20 comp rx=0 tx=0).stop 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- 172.21.15.73:0/3312974055 shutdown_connections 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac0cedc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- 172.21.15.73:0/3312974055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- 172.21.15.73:0/3312974055 >> 172.21.15.73:0/3312974055 conn(0x7efeac06a120 msgr2=0x7efeac06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- 172.21.15.73:0/3312974055 shutdown_connections 2023-12-19T16:15:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- 172.21.15.73:0/3312974055 wait complete. 2023-12-19T16:15:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 Processor -- start 2023-12-19T16:15:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- start start 2023-12-19T16:15:37.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeac0ccae0 0x7efeac153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac153bf0 con 0x7efeac0ce930 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac156350 con 0x7efeac0ccae0 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeb0803640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac1f8f50 con 0x7efeac15d3a0 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efea3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efea3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58724/0 (socket says 172.21.15.73:58724) 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efea3fff640 1 -- 172.21.15.73:0/4166981974 learned_addr learned my addr 172.21.15.73:0/4166981974 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeaad9d640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeac0ccae0 0x7efeac153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.537+0000 7efeab59e640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 -- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 msgr2=0x7efeac0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 -- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeac0ccae0 msgr2=0x7efeac153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeac0ccae0 0x7efeac153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 -- 172.21.15.73:0/4166981974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009b30 con 0x7efeac0ce930 2023-12-19T16:15:37.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea3fff640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe9400e930 tx=0x7efe9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94009690 con 0x7efeac0ce930 2023-12-19T16:15:37.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400ca00 con 0x7efeac0ce930 2023-12-19T16:15:37.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400cd70 con 0x7efeac0ce930 2023-12-19T16:15:37.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac1f9230 con 0x7efeac0ce930 2023-12-19T16:15:37.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac1f97f0 con 0x7efeac0ce930 2023-12-19T16:15:37.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac04e000 con 0x7efeac0ce930 2023-12-19T16:15:37.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe94013470 con 0x7efeac0ce930 2023-12-19T16:15:37.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 0x7efe8c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe94082fe0 con 0x7efeac0ce930 2023-12-19T16:15:37.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.541+0000 7efeaad9d640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 0x7efe8c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.545+0000 7efeaad9d640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 0x7efe8c067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efeac156280 tx=0x7efe9c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.545+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe94050e90 con 0x7efeac0ce930 2023-12-19T16:15:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.697+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeac0719d0 con 0x7efeac0ce930 2023-12-19T16:15:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.697+0000 7efea37fe640 1 -- 172.21.15.73:0/4166981974 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12382 (secure 0 0 0) 0x7efe94017090 con 0x7efeac0ce930 2023-12-19T16:15:37.701 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:37.701 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:30.930581+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 msgr2=0x7efe8c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 0x7efe8c067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efeac156280 tx=0x7efe9c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 msgr2=0x7efeac1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe9400e930 tx=0x7efe9400edf0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 shutdown_connections 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efeac15d3a0 0x7efeac0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efe8c065a60 0x7efe8c067f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeac0ce930 0x7efeac1536b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 --2- 172.21.15.73:0/4166981974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efeac0ccae0 0x7efeac153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 >> 172.21.15.73:0/4166981974 conn(0x7efeac06a120 msgr2=0x7efeac0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:37.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 shutdown_connections 2023-12-19T16:15:37.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.701+0000 7efeb0803640 1 -- 172.21.15.73:0/4166981974 wait complete. 2023-12-19T16:15:37.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:37.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:37.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 Processor -- start 2023-12-19T16:15:37.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 -- start start 2023-12-19T16:15:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff11c1598c0 0x7ff11c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c0cce80 con 0x7ff11c0b0830 2023-12-19T16:15:37.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c06cad0 con 0x7ff11c06d410 2023-12-19T16:15:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff1239bc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c0cc270 con 0x7ff11c1598c0 2023-12-19T16:15:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121f59640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff11c0b0830 0x7ff11c0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50004/0 (socket says 172.21.15.73:50004) 2023-12-19T16:15:37.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121f59640 1 -- 172.21.15.73:0/426548315 learned_addr learned my addr 172.21.15.73:0/426548315 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 --2- 172.21.15.73:0/426548315 >> v2:172.21.15.162:3300/0 conn(0x7ff11c1598c0 0x7ff11c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724033866 0 0) 0x7ff11c0cce80 con 0x7ff11c0b0830 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff108003530 con 0x7ff11c0b0830 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426748034 0 0) 0x7ff108003530 con 0x7ff11c0b0830 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 >> v2:172.21.15.162:3300/0 conn(0x7ff11c1598c0 msgr2=0x7ff11c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 --2- 172.21.15.73:0/426548315 >> v2:172.21.15.162:3300/0 conn(0x7ff11c1598c0 0x7ff11c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 >> v1:172.21.15.162:6789/0 conn(0x7ff11c06d410 legacy=0x7ff11c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0cc550 con 0x7ff11c0b0830 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7ff114001a00 con 0x7ff11c0b0830 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 >> v1:172.21.15.73:6789/0 conn(0x7ff11c0b0830 legacy=0x7ff11c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 0x7ff108003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1080047d0 0x7ff108004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108005190 0x7ff10800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0cc270 con 0x7ff108003980 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10800c030 con 0x7ff1080047d0 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10800c1f0 con 0x7ff108005190 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 0x7ff108003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff120f57640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1080047d0 0x7ff108004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121f59640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108005190 0x7ff10800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 -- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108005190 msgr2=0x7ff10800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108005190 0x7ff10800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 -- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1080047d0 msgr2=0x7ff108004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1080047d0 0x7ff108004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121f59640 1 -- 172.21.15.73:0/426548315 reap_dead start 2023-12-19T16:15:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.861+0000 7ff121758640 1 -- 172.21.15.73:0/426548315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff108003530 con 0x7ff108003980 2023-12-19T16:15:37.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff121758640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 0x7ff108003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff118009ae0 tx=0x7ff11801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7984fca5adbbbee1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180a5640 con 0x7ff108003980 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1180a57a0 con 0x7ff108003980 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff113fff640 1 -- 172.21.15.73:0/426548315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180a5b50 con 0x7ff108003980 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 -- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 msgr2=0x7ff108003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 0x7ff108003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff118009ae0 tx=0x7ff11801ca00 comp rx=0 tx=0).stop 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 -- 172.21.15.73:0/426548315 shutdown_connections 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 --2- 172.21.15.73:0/426548315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff108003980 0x7ff108003da0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 -- 172.21.15.73:0/426548315 >> 172.21.15.73:0/426548315 conn(0x7ff11c06a570 msgr2=0x7ff11c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 -- 172.21.15.73:0/426548315 shutdown_connections 2023-12-19T16:15:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.865+0000 7ff1239bc640 1 -- 172.21.15.73:0/426548315 wait complete. 2023-12-19T16:15:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 Processor -- start 2023-12-19T16:15:37.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- start start 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108003980 0x7ff11c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 0x7ff11c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0c83c0 con 0x7ff11c0c7a00 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0c5660 con 0x7ff11c159ca0 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c15a810 con 0x7ff108003980 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58750/0 (socket says 172.21.15.73:58750) 2023-12-19T16:15:37.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 -- 172.21.15.73:0/926145925 learned_addr learned my addr 172.21.15.73:0/926145925 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121758640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108003980 0x7ff11c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff120f57640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 0x7ff11c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 -- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108003980 msgr2=0x7ff11c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108003980 0x7ff11c157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 -- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 msgr2=0x7ff11c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 0x7ff11c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 -- 172.21.15.73:0/926145925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c15aaf0 con 0x7ff11c0c7a00 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff120f57640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 0x7ff11c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff121f59640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0ad700 tx=0x7ff114007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400ab10 con 0x7ff11c0c7a00 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400ac70 con 0x7ff11c0c7a00 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c15add0 con 0x7ff11c0c7a00 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140133f0 con 0x7ff11c0c7a00 2023-12-19T16:15:37.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.869+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c0c7680 con 0x7ff11c0c7a00 2023-12-19T16:15:37.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11c04e070 con 0x7ff11c0c7a00 2023-12-19T16:15:37.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff114013550 con 0x7ff11c0c7a00 2023-12-19T16:15:37.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff111ffb640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 0x7ff100067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:37.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff114083330 con 0x7ff11c0c7a00 2023-12-19T16:15:37.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff121758640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 0x7ff100067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:37.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.873+0000 7ff121758640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 0x7ff100067f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1180af000 tx=0x7ff1180046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:37.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:37.877+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff114051030 con 0x7ff11c0c7a00 2023-12-19T16:15:38.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff11c0c6f50 con 0x7ff11c0c7a00 2023-12-19T16:15:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff111ffb640 1 -- 172.21.15.73:0/926145925 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff114054650 con 0x7ff11c0c7a00 2023-12-19T16:15:38.031 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:15:38.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 msgr2=0x7ff100067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 0x7ff100067f50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff1180af000 tx=0x7ff1180046d0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 msgr2=0x7ff11c0c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0ad700 tx=0x7ff114007b00 comp rx=0 tx=0).stop 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 shutdown_connections 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff100065a90 0x7ff100067f50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0c7a00 0x7ff11c0c7e80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff11c159ca0 0x7ff11c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 --2- 172.21.15.73:0/926145925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff108003980 0x7ff11c157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 >> 172.21.15.73:0/926145925 conn(0x7ff11c06a570 msgr2=0x7ff11c0ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 shutdown_connections 2023-12-19T16:15:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.029+0000 7ff1239bc640 1 -- 172.21.15.73:0/926145925 wait complete. 2023-12-19T16:15:38.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:15:38.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.185+0000 7f1ce2198640 1 Processor -- start 2023-12-19T16:15:38.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1ce2198640 1 -- start start 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1ce2198640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1cdc0c8fa0 0x7f1cdc0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1ce2198640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cdc0c9940 con 0x7f1cdc0b1690 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1ce2198640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cdc06d720 con 0x7f1cdc15dfc0 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1ce2198640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc15e3a0 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cdbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1cdc0b1690 0x7f1cdc0b1ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50014/0 (socket says 172.21.15.73:50014) 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cdbfff640 1 -- 172.21.15.73:0/3157644490 learned_addr learned my addr 172.21.15.73:0/3157644490 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:38.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cd3fff640 1 --2- 172.21.15.73:0/3157644490 >> v2:172.21.15.162:3300/0 conn(0x7f1cdc0c8fa0 0x7f1cdc0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979204402 0 0) 0x7f1cdc0c9940 con 0x7f1cdc0b1690 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc8003530 con 0x7f1cdc0b1690 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cd3fff640 1 -- 172.21.15.73:0/3157644490 >> v1:172.21.15.162:6789/0 conn(0x7f1cdc15dfc0 legacy=0x7f1cdc0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136664835 0 0) 0x7f1cc8003530 con 0x7f1cdc0b1690 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cd3fff640 1 -- 172.21.15.73:0/3157644490 >> v1:172.21.15.73:6789/0 conn(0x7f1cdc0b1690 legacy=0x7f1cdc0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.189+0000 7f1cd3fff640 1 -- 172.21.15.73:0/3157644490 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc06c3a0 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1cd3fff640 1 --2- 172.21.15.73:0/3157644490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0c9400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40097c0 tx=0x7f1cc401c160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eff95f11f9d024b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4001a00 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40a7050 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1cdaffd640 1 -- 172.21.15.73:0/3157644490 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40ab620 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 -- 172.21.15.73:0/3157644490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 msgr2=0x7f1cdc0c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 --2- 172.21.15.73:0/3157644490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0c9400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40097c0 tx=0x7f1cc401c160 comp rx=0 tx=0).stop 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 -- 172.21.15.73:0/3157644490 shutdown_connections 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 --2- 172.21.15.73:0/3157644490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0c9400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 -- 172.21.15.73:0/3157644490 >> 172.21.15.73:0/3157644490 conn(0x7f1cdc0b0270 msgr2=0x7f1cdc0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 -- 172.21.15.73:0/3157644490 shutdown_connections 2023-12-19T16:15:38.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 -- 172.21.15.73:0/3157644490 wait complete. 2023-12-19T16:15:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.193+0000 7f1ce2198640 1 Processor -- start 2023-12-19T16:15:38.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- start start 2023-12-19T16:15:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cdc15dfc0 0x7f1cdc148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc15c370 con 0x7f1cdc0b1690 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc15c090 con 0x7f1cdc0c8fa0 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc0c7b10 con 0x7f1cdc15dfc0 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58752/0 (socket says 172.21.15.73:58752) 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 -- 172.21.15.73:0/1732199806 learned_addr learned my addr 172.21.15.73:0/1732199806 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 -- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cdc15dfc0 msgr2=0x7f1cdc148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cdc15dfc0 0x7f1cdc148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 -- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 msgr2=0x7f1cdc0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 -- 172.21.15.73:0/1732199806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009420 con 0x7f1cdc0b1690 2023-12-19T16:15:38.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cdb7fe640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c780 tx=0x7f1ccc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc005270 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc0053f0 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00a880 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc0c7df0 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc149be0 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.197+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc0c7970 con 0x7f1cdc0b1690 2023-12-19T16:15:38.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.201+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ccc00a9e0 con 0x7f1cdc0b1690 2023-12-19T16:15:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.201+0000 7f1cd8ff9640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 0x7f1cbc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.201+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ccc082530 con 0x7f1cdc0b1690 2023-12-19T16:15:38.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.201+0000 7f1cd3fff640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 0x7f1cbc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.201+0000 7f1cd3fff640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 0x7f1cbc067f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40ad000 tx=0x7f1cc4004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.205+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1cdc0c7970 con 0x7f1cdc0b1690 2023-12-19T16:15:38.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:38.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.357+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1cdc0c7970 con 0x7f1cdc0b1690 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.357+0000 7f1cd8ff9640 1 -- 172.21.15.73:0/1732199806 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1cdc0c7970 con 0x7f1cdc0b1690 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-19T16:15:38.361 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-19T16:15:38.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:15:38.362 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 msgr2=0x7f1cbc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 0x7f1cbc067f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1cc40ad000 tx=0x7f1cc4004740 comp rx=0 tx=0).stop 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 msgr2=0x7f1cdc1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c780 tx=0x7f1ccc00cc40 comp rx=0 tx=0).stop 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 shutdown_connections 2023-12-19T16:15:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1cdc15dfc0 0x7f1cdc148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cdc0c8fa0 0x7f1cdc0af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1cbc065a60 0x7f1cbc067f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 --2- 172.21.15.73:0/1732199806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1cdc0b1690 0x7f1cdc1496a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 >> 172.21.15.73:0/1732199806 conn(0x7f1cdc0b0270 msgr2=0x7f1cdc15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 shutdown_connections 2023-12-19T16:15:38.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.361+0000 7f1ce2198640 1 -- 172.21.15.73:0/1732199806 wait complete. 2023-12-19T16:15:38.382 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:15:38.383 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:15:38.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 Processor -- start 2023-12-19T16:15:38.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 -- start start 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 0x7f1d4806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1d4806d410 0x7f1d480b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d480b0ac0 con 0x7f1d480b0660 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d480cce80 con 0x7f1d4806d410 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4eae5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4806cad0 con 0x7f1d481598c0 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4d082640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1d480b0660 0x7f1d480c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50016/0 (socket says 172.21.15.73:50016) 2023-12-19T16:15:38.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4d082640 1 -- 172.21.15.73:0/2074978777 learned_addr learned my addr 172.21.15.73:0/2074978777 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2074978777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 0x7f1d4806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d3ffff640 1 --2- 172.21.15.73:0/2074978777 >> v2:172.21.15.162:3300/0 conn(0x7f1d4806d410 0x7f1d480b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929160558 0 0) 0x7f1d480b0ac0 con 0x7f1d480b0660 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d30003530 con 0x7f1d480b0660 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4c881640 1 -- 172.21.15.73:0/2074978777 >> v2:172.21.15.162:3300/0 conn(0x7f1d4806d410 msgr2=0x7f1d480b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2074978777 >> v2:172.21.15.162:3300/0 conn(0x7f1d4806d410 0x7f1d480b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4c881640 1 -- 172.21.15.73:0/2074978777 >> v1:172.21.15.73:6789/0 conn(0x7f1d480b0660 legacy=0x7f1d480c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555025405 0 0) 0x7f1d30003530 con 0x7f1d480b0660 2023-12-19T16:15:38.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.565+0000 7f1d4c881640 1 -- 172.21.15.73:0/2074978777 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480cc270 con 0x7f1d481598c0 2023-12-19T16:15:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2074978777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 0x7f1d4806c590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097c0 tx=0x7f1d4401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e66ac49341273b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d40001a00 con 0x7f1d481598c0 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440a7050 con 0x7f1d481598c0 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d3f7fe640 1 -- 172.21.15.73:0/2074978777 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440ab620 con 0x7f1d481598c0 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2074978777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 msgr2=0x7f1d4806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2074978777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 0x7f1d4806c590 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d440097c0 tx=0x7f1d4401c3a0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2074978777 shutdown_connections 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2074978777 >> v2:172.21.15.162:3300/0 conn(0x7f1d4806d410 0x7f1d480b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2074978777 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d481598c0 0x7f1d4806c590 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2074978777 >> 172.21.15.73:0/2074978777 conn(0x7f1d4806a570 msgr2=0x7f1d480ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2074978777 shutdown_connections 2023-12-19T16:15:38.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.569+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2074978777 wait complete. 2023-12-19T16:15:38.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 Processor -- start 2023-12-19T16:15:38.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- start start 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d480b0660 0x7f1d48151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d481598c0 0x7f1d480a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48152a40 con 0x7f1d4806d410 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480c6c40 con 0x7f1d481598c0 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d48151f70 con 0x7f1d480b0660 2023-12-19T16:15:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58768/0 (socket says 172.21.15.73:58768) 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 -- 172.21.15.73:0/2166512872 learned_addr learned my addr 172.21.15.73:0/2166512872 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4d082640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d481598c0 0x7f1d480a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d3ffff640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d480b0660 0x7f1d48151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 -- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d480b0660 msgr2=0x7f1d48151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d480b0660 0x7f1d48151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 -- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d481598c0 msgr2=0x7f1d480a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d481598c0 0x7f1d480a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 -- 172.21.15.73:0/2166512872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d44009420 con 0x7f1d4806d410 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4c881640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d4401cc40 tx=0x7f1d44019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440abea0 con 0x7f1d4806d410 2023-12-19T16:15:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440b5470 con 0x7f1d4806d410 2023-12-19T16:15:38.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d48157e60 con 0x7f1d4806d410 2023-12-19T16:15:38.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d440b5840 con 0x7f1d4806d410 2023-12-19T16:15:38.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.573+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d48158420 con 0x7f1d4806d410 2023-12-19T16:15:38.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804e070 con 0x7f1d4806d410 2023-12-19T16:15:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d440b2040 con 0x7f1d4806d410 2023-12-19T16:15:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d3d7fa640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 0x7f1d34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d4411d080 con 0x7f1d4806d410 2023-12-19T16:15:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d3ffff640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 0x7f1d34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:38.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.577+0000 7f1d3ffff640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 0x7f1d34067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d48153030 tx=0x7f1d38008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:38.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.581+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d4414e0a0 con 0x7f1d4806d410 2023-12-19T16:15:38.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:38.729+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1d48156210 con 0x7f1d4806d410 2023-12-19T16:15:39.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.125+0000 7f1d3d7fa640 1 -- 172.21.15.73:0/2166512872 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1d440bc0b0 con 0x7f1d4806d410 2023-12-19T16:15:39.129 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-19T16:15:39.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 msgr2=0x7f1d34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 0x7f1d34067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d48153030 tx=0x7f1d38008040 comp rx=0 tx=0).stop 2023-12-19T16:15:39.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 msgr2=0x7f1d48157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1d4401cc40 tx=0x7f1d44019140 comp rx=0 tx=0).stop 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 shutdown_connections 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d481598c0 0x7f1d480a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d480b0660 0x7f1d48151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d34065a60 0x7f1d34067f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 --2- 172.21.15.73:0/2166512872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d4806d410 0x7f1d48157780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 >> 172.21.15.73:0/2166512872 conn(0x7f1d4806a570 msgr2=0x7f1d480cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:39.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 shutdown_connections 2023-12-19T16:15:39.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.129+0000 7f1d4eae5640 1 -- 172.21.15.73:0/2166512872 wait complete. 2023-12-19T16:15:39.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:15:39.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 Processor -- start 2023-12-19T16:15:39.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 -- start start 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21b015cc80 0x7f21b00cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b0160910 0x7f21b00d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b00d1080 con 0x7f21b00d1a50 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b00b8520 con 0x7f21b015cc80 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b76c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00d0d50 con 0x7f21b0160910 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21b015cc80 0x7f21b00cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21b015cc80 0x7f21b00cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58782/0 (socket says 172.21.15.73:58782) 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 -- 172.21.15.73:0/1077063824 learned_addr learned my addr 172.21.15.73:0/1077063824 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5c61640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f21b00d1a50 0x7f21b00b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50018/0 (socket says 172.21.15.73:50018) 2023-12-19T16:15:39.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b4c5f640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b0160910 0x7f21b00d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 -- 172.21.15.73:0/1077063824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b0160910 msgr2=0x7f21b00d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:39.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b0160910 0x7f21b00d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 -- 172.21.15.73:0/1077063824 >> v1:172.21.15.73:6789/0 conn(0x7f21b00d1a50 legacy=0x7f21b00b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.297+0000 7f21b5460640 1 -- 172.21.15.73:0/1077063824 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0161120 con 0x7f21b015cc80 2023-12-19T16:15:39.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b5460640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b015cc80 0x7f21b00cde80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009870 tx=0x7f21ac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8476c1c38f7d606e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21a7fff640 1 -- 172.21.15.73:0/1077063824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0ab620 con 0x7f21b015cc80 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21a7fff640 1 -- 172.21.15.73:0/1077063824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac0ab780 con 0x7f21b015cc80 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21a7fff640 1 -- 172.21.15.73:0/1077063824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0abb10 con 0x7f21b015cc80 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 -- 172.21.15.73:0/1077063824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b015cc80 msgr2=0x7f21b00cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b015cc80 0x7f21b00cde80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009870 tx=0x7f21ac01c510 comp rx=0 tx=0).stop 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 -- 172.21.15.73:0/1077063824 shutdown_connections 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b0160910 0x7f21b00d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 --2- 172.21.15.73:0/1077063824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b015cc80 0x7f21b00cde80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 -- 172.21.15.73:0/1077063824 >> 172.21.15.73:0/1077063824 conn(0x7f21b006b020 msgr2=0x7f21b006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:39.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 -- 172.21.15.73:0/1077063824 shutdown_connections 2023-12-19T16:15:39.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.301+0000 7f21b76c4640 1 -- 172.21.15.73:0/1077063824 wait complete. 2023-12-19T16:15:39.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 Processor -- start 2023-12-19T16:15:39.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- start start 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 0x7f21b0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 0x7f21b015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b015c8a0 con 0x7f21b00d1a50 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b01554f0 con 0x7f21b0160910 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00ccd30 con 0x7f21b015cc80 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58792/0 (socket says 172.21.15.73:58792) 2023-12-19T16:15:39.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 -- 172.21.15.73:0/2677748735 learned_addr learned my addr 172.21.15.73:0/2677748735 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b4c5f640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 0x7f21b0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5c61640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 0x7f21b015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 -- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 msgr2=0x7f21b0150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 0x7f21b0150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 -- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 msgr2=0x7f21b015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 0x7f21b015e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 -- 172.21.15.73:0/2677748735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0094d0 con 0x7f21b00d1a50 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b4c5f640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 0x7f21b0150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5c61640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 0x7f21b015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b5460640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0ad040 tx=0x7f21ac01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0be3f0 con 0x7f21b00d1a50 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac0be550 con 0x7f21b00d1a50 2023-12-19T16:15:39.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0be900 con 0x7f21b00d1a50 2023-12-19T16:15:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b0155910 con 0x7f21b00d1a50 2023-12-19T16:15:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.305+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b0154e30 con 0x7f21b00d1a50 2023-12-19T16:15:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b004e070 con 0x7f21b00d1a50 2023-12-19T16:15:39.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21ac0c9430 con 0x7f21b00d1a50 2023-12-19T16:15:39.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21a5ffb640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 0x7f2194067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:39.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f21ac11d640 con 0x7f21b00d1a50 2023-12-19T16:15:39.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21b4c5f640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 0x7f2194067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.309+0000 7f21b4c5f640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 0x7f2194067f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21b0153110 tx=0x7f21a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.313+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21ac0eb400 con 0x7f21b00d1a50 2023-12-19T16:15:39.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:39.465+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f21b006bf00 con 0x7f21b00d1a50 2023-12-19T16:15:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.133+0000 7f21a5ffb640 1 -- 172.21.15.73:0/2677748735 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f21ac0eea20 con 0x7f21b00d1a50 2023-12-19T16:15:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-19T16:15:40.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 msgr2=0x7f2194067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 0x7f2194067f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21b0153110 tx=0x7f21a0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:40.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 msgr2=0x7f21b015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0ad040 tx=0x7f21ac01ad50 comp rx=0 tx=0).stop 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 shutdown_connections 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21b0160910 0x7f21b015e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21b015cc80 0x7f21b0150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2194065a90 0x7f2194067f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 --2- 172.21.15.73:0/2677748735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21b00d1a50 0x7f21b015a260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 >> 172.21.15.73:0/2677748735 conn(0x7f21b006b020 msgr2=0x7f21b00d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 shutdown_connections 2023-12-19T16:15:40.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.141+0000 7f21b76c4640 1 -- 172.21.15.73:0/2677748735 wait complete. 2023-12-19T16:15:40.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:15:40.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.321+0000 7f7490df3640 1 Processor -- start 2023-12-19T16:15:40.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.321+0000 7f7490df3640 1 -- start start 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.321+0000 7f7490df3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f748c06d410 0x7f748c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7490df3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7490df3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748c0cce80 con 0x7f748c1598c0 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7490df3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748c0b0b10 con 0x7f748c06d410 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7490df3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c0cc270 con 0x7f748c0b0660 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f748a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f748c1598c0 0x7f748c06c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50030/0 (socket says 172.21.15.73:50030) 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f748a59c640 1 -- 172.21.15.73:0/1190590736 learned_addr learned my addr 172.21.15.73:0/1190590736 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 --2- 172.21.15.73:0/1190590736 >> v2:172.21.15.73:3300/0 conn(0x7f748c06d410 0x7f748c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f748ad9d640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7489d9b640 1 -- 172.21.15.73:0/1190590736 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228577746 0 0) 0x7f748c0cce80 con 0x7f748c1598c0 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7489d9b640 1 -- 172.21.15.73:0/1190590736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7478003530 con 0x7f748c1598c0 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 -- 172.21.15.73:0/1190590736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 msgr2=0x7f748c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c0cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 -- 172.21.15.73:0/1190590736 >> v1:172.21.15.73:6789/0 conn(0x7f748c1598c0 legacy=0x7f748c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 -- 172.21.15.73:0/1190590736 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0cc550 con 0x7f748c06d410 2023-12-19T16:15:40.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7483fff640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c06d410 0x7f748c0b0120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74740097f0 tx=0x7f747401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a30a66cd73bfa27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7489d9b640 1 -- 172.21.15.73:0/1190590736 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740ab650 con 0x7f748c06d410 2023-12-19T16:15:40.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7489d9b640 1 -- 172.21.15.73:0/1190590736 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74740ab7b0 con 0x7f748c06d410 2023-12-19T16:15:40.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.325+0000 7f7489d9b640 1 -- 172.21.15.73:0/1190590736 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740abb40 con 0x7f748c06d410 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- 172.21.15.73:0/1190590736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c06d410 msgr2=0x7f748c0b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c06d410 0x7f748c0b0120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74740097f0 tx=0x7f747401c450 comp rx=0 tx=0).stop 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- 172.21.15.73:0/1190590736 shutdown_connections 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- 172.21.15.73:0/1190590736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c06d410 0x7f748c0b0120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- 172.21.15.73:0/1190590736 >> 172.21.15.73:0/1190590736 conn(0x7f748c06a570 msgr2=0x7f748c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:40.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- 172.21.15.73:0/1190590736 shutdown_connections 2023-12-19T16:15:40.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- 172.21.15.73:0/1190590736 wait complete. 2023-12-19T16:15:40.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 Processor -- start 2023-12-19T16:15:40.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- start start 2023-12-19T16:15:40.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f748c06d410 0x7f748c165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c156a60 con 0x7f748c1598c0 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c155f70 con 0x7f748c06d410 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f7490df3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c157e80 con 0x7f748c0b0660 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f748ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f748ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58802/0 (socket says 172.21.15.73:58802) 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f748ad9d640 1 -- 172.21.15.73:0/213088873 learned_addr learned my addr 172.21.15.73:0/213088873 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.329+0000 7f748a59c640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f748c06d410 0x7f748c165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7483fff640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 -- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 msgr2=0x7f748c164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 -- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f748c06d410 msgr2=0x7f748c165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f748c06d410 0x7f748c165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 -- 172.21.15.73:0/213088873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009420 con 0x7f748c1598c0 2023-12-19T16:15:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f748ad9d640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f748400efc0 tx=0x7f748400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484014480 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748400f040 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484014820 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c1561c0 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c156780 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748c04e070 con 0x7f748c1598c0 2023-12-19T16:15:40.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.333+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7484014980 con 0x7f748c1598c0 2023-12-19T16:15:40.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.337+0000 7f7482ffd640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 0x7f746c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.337+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f74840843c0 con 0x7f748c1598c0 2023-12-19T16:15:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.337+0000 7f748a59c640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 0x7f746c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.337+0000 7f748a59c640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 0x7f746c067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f747c0011f0 tx=0x7f747c007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.337+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7484051e70 con 0x7f748c1598c0 2023-12-19T16:15:40.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.521+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f748c0ca650 con 0x7f748c1598c0 2023-12-19T16:15:40.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.533+0000 7f7482ffd640 1 -- 172.21.15.73:0/213088873 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f74840180c0 con 0x7f748c1598c0 2023-12-19T16:15:40.536 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 msgr2=0x7f746c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 0x7f746c067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f747c0011f0 tx=0x7f747c007d40 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 msgr2=0x7f748c1542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f748400efc0 tx=0x7f748400c490 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 shutdown_connections 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f746c065a60 0x7f746c067f20 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f747c0011f0 tx=0x7f747c007d40 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f748c1598c0 0x7f748c1542a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f748c0b0660 0x7f748c164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 --2- 172.21.15.73:0/213088873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f748c06d410 0x7f748c165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.537+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 >> 172.21.15.73:0/213088873 conn(0x7f748c06a570 msgr2=0x7f748c06ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.541+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 shutdown_connections 2023-12-19T16:15:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.545+0000 7f7490df3640 1 -- 172.21.15.73:0/213088873 wait complete. 2023-12-19T16:15:40.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 Processor -- start 2023-12-19T16:15:40.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 -- start start 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3c40b47f0 0x7fb3c40b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3c415cff0 0x7fb3c40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c40b7250 con 0x7fb3c40b4bd0 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b7530 con 0x7fb3c415cff0 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3cbf09640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b7810 con 0x7fb3c40b47f0 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3c415cff0 0x7fb3c40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3c415cff0 0x7fb3c40b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58804/0 (socket says 172.21.15.73:58804) 2023-12-19T16:15:40.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/3510619910 learned_addr learned my addr 172.21.15.73:0/3510619910 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:40.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3c9ca5640 1 --2- 172.21.15.73:0/3510619910 >> v2:172.21.15.162:3300/0 conn(0x7fb3c40b47f0 0x7fb3c40b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/3510619910 >> v2:172.21.15.162:3300/0 conn(0x7fb3c40b47f0 msgr2=0x7fb3c40b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:40.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 --2- 172.21.15.73:0/3510619910 >> v2:172.21.15.162:3300/0 conn(0x7fb3c40b47f0 0x7fb3c40b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/3510619910 >> v1:172.21.15.162:6789/0 conn(0x7fb3c40b4bd0 legacy=0x7fb3c415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.721+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/3510619910 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c40b7af0 con 0x7fb3c415cff0 2023-12-19T16:15:40.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3ca4a6640 1 --2- 172.21.15.73:0/3510619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c40b5c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cfcd0 tx=0x7fb3bc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3056bb64daf78f14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3c8ca3640 1 -- 172.21.15.73:0/3510619910 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a57f0 con 0x7fb3c415cff0 2023-12-19T16:15:40.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3c8ca3640 1 -- 172.21.15.73:0/3510619910 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0a5950 con 0x7fb3c415cff0 2023-12-19T16:15:40.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3c8ca3640 1 -- 172.21.15.73:0/3510619910 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0a5ce0 con 0x7fb3c415cff0 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 -- 172.21.15.73:0/3510619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 msgr2=0x7fb3c40b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/3510619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c40b5c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40cfcd0 tx=0x7fb3bc01c910 comp rx=0 tx=0).stop 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 -- 172.21.15.73:0/3510619910 shutdown_connections 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/3510619910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c40b5c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/3510619910 >> v2:172.21.15.162:3300/0 conn(0x7fb3c40b47f0 0x7fb3c40b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 -- 172.21.15.73:0/3510619910 >> 172.21.15.73:0/3510619910 conn(0x7fb3c4065ce0 msgr2=0x7fb3c40660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 -- 172.21.15.73:0/3510619910 shutdown_connections 2023-12-19T16:15:40.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.725+0000 7fb3cbf09640 1 -- 172.21.15.73:0/3510619910 wait complete. 2023-12-19T16:15:40.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 Processor -- start 2023-12-19T16:15:40.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- start start 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3c40b47f0 0x7fb3c41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 0x7fb3c4150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c414f730 con 0x7fb3c415cff0 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c414e810 con 0x7fb3c40b47f0 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c414eab0 con 0x7fb3c40b4bd0 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58816/0 (socket says 172.21.15.73:58816) 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/2528505806 learned_addr learned my addr 172.21.15.73:0/2528505806 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3c94a4640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 0x7fb3c4150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3c9ca5640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3c40b47f0 0x7fb3c41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 msgr2=0x7fb3c4150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 0x7fb3c4150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3c40b47f0 msgr2=0x7fb3c41543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3c40b47f0 0x7fb3c41543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 -- 172.21.15.73:0/2528505806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc009b30 con 0x7fb3c415cff0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3c94a4640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 0x7fb3c4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ca4a6640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0af040 tx=0x7fb3bc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0b8670 con 0x7fb3c415cff0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc0b87d0 con 0x7fb3c415cff0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc0b8b80 con 0x7fb3c415cff0 2023-12-19T16:15:40.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c414ed90 con 0x7fb3c415cff0 2023-12-19T16:15:40.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.729+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c414f350 con 0x7fb3c415cff0 2023-12-19T16:15:40.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c414f870 con 0x7fb3c415cff0 2023-12-19T16:15:40.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3bc0b8ce0 con 0x7fb3c415cff0 2023-12-19T16:15:40.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3ba7fc640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 0x7fb3a8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:40.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3bc11e6a0 con 0x7fb3c415cff0 2023-12-19T16:15:40.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3c9ca5640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 0x7fb3a8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:40.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.733+0000 7fb3c9ca5640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 0x7fb3a8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0007a60 tx=0x7fb3c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.737+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb3c414f870 con 0x7fb3c415cff0 2023-12-19T16:15:40.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.889+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3c414f870 con 0x7fb3c415cff0 2023-12-19T16:15:40.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.889+0000 7fb3ba7fc640 1 -- 172.21.15.73:0/2528505806 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fb3c414f870 con 0x7fb3c415cff0 2023-12-19T16:15:40.893 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:40.893 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:40.526136+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 msgr2=0x7fb3a8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 0x7fb3a8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0007a60 tx=0x7fb3c0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 msgr2=0x7fb3c4155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0af040 tx=0x7fb3bc0196b0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 shutdown_connections 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb3a8065a60 0x7fb3a8067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c415cff0 0x7fb3c4155310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3c40b4bd0 0x7fb3c4150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 --2- 172.21.15.73:0/2528505806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3c40b47f0 0x7fb3c41543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 >> 172.21.15.73:0/2528505806 conn(0x7fb3c4065ce0 msgr2=0x7fb3c40d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 shutdown_connections 2023-12-19T16:15:40.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:40.893+0000 7fb3cbf09640 1 -- 172.21.15.73:0/2528505806 wait complete. 2023-12-19T16:15:40.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:41.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.045+0000 7f479d12c640 1 Processor -- start 2023-12-19T16:15:41.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.045+0000 7f479d12c640 1 -- start start 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f479806ddf0 0x7f47980cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980cbe90 0x7f47980cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f479815cc80 0x7f4798070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980cccb0 con 0x7f479806ddf0 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47980ca6f0 con 0x7f479815cc80 2023-12-19T16:15:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479d12c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4798159530 con 0x7f47980cbe90 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f479806ddf0 0x7f47980cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f479806ddf0 0x7f47980cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58820/0 (socket says 172.21.15.73:58820) 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 -- 172.21.15.73:0/3936605818 learned_addr learned my addr 172.21.15.73:0/3936605818 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f479759e640 1 --2- 172.21.15.73:0/3936605818 >> v2:172.21.15.162:3300/0 conn(0x7f479815cc80 0x7f4798070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f478e59c640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980cbe90 0x7f47980cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 -- 172.21.15.73:0/3936605818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980cbe90 msgr2=0x7f47980cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980cbe90 0x7f47980cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 -- 172.21.15.73:0/3936605818 >> v2:172.21.15.162:3300/0 conn(0x7f479815cc80 msgr2=0x7f4798070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 --2- 172.21.15.73:0/3936605818 >> v2:172.21.15.162:3300/0 conn(0x7f479815cc80 0x7f4798070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.049+0000 7f4796d9d640 1 -- 172.21.15.73:0/3936605818 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980c9ae0 con 0x7f479806ddf0 2023-12-19T16:15:41.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f4796d9d640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f479806ddf0 0x7f47980cce70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4788009870 tx=0x7f478801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2604e5ea7f121f95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479659c640 1 -- 172.21.15.73:0/3936605818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880ab610 con 0x7f479806ddf0 2023-12-19T16:15:41.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479659c640 1 -- 172.21.15.73:0/3936605818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47880ab770 con 0x7f479806ddf0 2023-12-19T16:15:41.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479659c640 1 -- 172.21.15.73:0/3936605818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880abb00 con 0x7f479806ddf0 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 -- 172.21.15.73:0/3936605818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f479806ddf0 msgr2=0x7f47980cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f479806ddf0 0x7f47980cce70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4788009870 tx=0x7f478801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 -- 172.21.15.73:0/3936605818 shutdown_connections 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 --2- 172.21.15.73:0/3936605818 >> v2:172.21.15.162:3300/0 conn(0x7f479815cc80 0x7f4798070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47980cbe90 0x7f47980cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 --2- 172.21.15.73:0/3936605818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f479806ddf0 0x7f47980cce70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 -- 172.21.15.73:0/3936605818 >> 172.21.15.73:0/3936605818 conn(0x7f47980b0270 msgr2=0x7f47980b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 -- 172.21.15.73:0/3936605818 shutdown_connections 2023-12-19T16:15:41.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 -- 172.21.15.73:0/3936605818 wait complete. 2023-12-19T16:15:41.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.053+0000 7f479d12c640 1 Processor -- start 2023-12-19T16:15:41.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- start start 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f479806ddf0 0x7f4798150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f479815cc80 0x7f479806c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c51f0 con 0x7f47980cbe90 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c6270 con 0x7f479815cc80 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47980c5940 con 0x7f479806ddf0 2023-12-19T16:15:41.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58824/0 (socket says 172.21.15.73:58824) 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 -- 172.21.15.73:0/1237150311 learned_addr learned my addr 172.21.15.73:0/1237150311 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479759e640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f479815cc80 0x7f479806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f4796d9d640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f479806ddf0 0x7f4798150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 -- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f479806ddf0 msgr2=0x7f4798150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f479806ddf0 0x7f4798150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 -- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f479815cc80 msgr2=0x7f479806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f479815cc80 0x7f479806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 -- 172.21.15.73:0/1237150311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880094d0 con 0x7f47980cbe90 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478e59c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f478000eed0 tx=0x7f478000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780010040 con 0x7f47980cbe90 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4780009e80 con 0x7f47980cbe90 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780014620 con 0x7f47980cbe90 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47980c5c20 con 0x7f47980cbe90 2023-12-19T16:15:41.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47980c80d0 con 0x7f47980cbe90 2023-12-19T16:15:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.057+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798074050 con 0x7f47980cbe90 2023-12-19T16:15:41.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.061+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4780014780 con 0x7f47980cbe90 2023-12-19T16:15:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.061+0000 7f478ffff640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 0x7f4778067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.061+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4780083800 con 0x7f47980cbe90 2023-12-19T16:15:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.061+0000 7f4796d9d640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 0x7f4778067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.061+0000 7f4796d9d640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 0x7f4778067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47880af000 tx=0x7f47880b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.065+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4780051260 con 0x7f47980cbe90 2023-12-19T16:15:41.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.217+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47980c5580 con 0x7f47980cbe90 2023-12-19T16:15:41.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.217+0000 7f478ffff640 1 -- 172.21.15.73:0/1237150311 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f478007be60 con 0x7f47980cbe90 2023-12-19T16:15:41.221 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:41.221 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:40.526136+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 msgr2=0x7f4778067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 0x7f4778067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47880af000 tx=0x7f47880b6040 comp rx=0 tx=0).stop 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 msgr2=0x7f47980c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f478000eed0 tx=0x7f478000b480 comp rx=0 tx=0).stop 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 shutdown_connections 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f479815cc80 0x7f479806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4778065a60 0x7f4778067f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47980cbe90 0x7f47980c6700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 --2- 172.21.15.73:0/1237150311 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f479806ddf0 0x7f4798150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 >> 172.21.15.73:0/1237150311 conn(0x7f47980b0270 msgr2=0x7f47980ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 shutdown_connections 2023-12-19T16:15:41.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.221+0000 7f479d12c640 1 -- 172.21.15.73:0/1237150311 wait complete. 2023-12-19T16:15:41.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:15:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 Processor -- start 2023-12-19T16:15:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 -- start start 2023-12-19T16:15:41.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7d38158270 0x7f7d3815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d3815e4d0 0x7f7d3806bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3806ffb0 con 0x7f7d38158650 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3815b730 con 0x7f7d38158270 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ec8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3815ba10 con 0x7f7d3815e4d0 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7d38158270 0x7f7d3815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d37fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7d38158650 0x7f7d38070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50046/0 (socket says 172.21.15.73:50046) 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d37fff640 1 -- 172.21.15.73:0/2332951032 learned_addr learned my addr 172.21.15.73:0/2332951032 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/2332951032 >> v2:172.21.15.73:3300/0 conn(0x7f7d38158270 0x7f7d3815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58828/0 (socket says 172.21.15.73:58828) 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3d229640 1 --2- 172.21.15.73:0/2332951032 >> v2:172.21.15.162:3300/0 conn(0x7f7d3815e4d0 0x7f7d3806bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 -- 172.21.15.73:0/2332951032 >> v2:172.21.15.162:3300/0 conn(0x7f7d3815e4d0 msgr2=0x7f7d3806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:41.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/2332951032 >> v2:172.21.15.162:3300/0 conn(0x7f7d3815e4d0 0x7f7d3806bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 -- 172.21.15.73:0/2332951032 >> v1:172.21.15.73:6789/0 conn(0x7f7d38158650 legacy=0x7f7d38070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d3ca28640 1 -- 172.21.15.73:0/2332951032 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3815bcf0 con 0x7f7d38158270 2023-12-19T16:15:41.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.381+0000 7f7d377fe640 1 -- 172.21.15.73:0/2332951032 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041738929 0 0) 0x7f7d3806ffb0 con 0x7f7d38158650 2023-12-19T16:15:41.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/2332951032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d38158270 0x7f7d3815aee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097c0 tx=0x7f7d2801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f894a4c3eed1a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d377fe640 1 -- 172.21.15.73:0/2332951032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280ac600 con 0x7f7d38158270 2023-12-19T16:15:41.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d377fe640 1 -- 172.21.15.73:0/2332951032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d280a8050 con 0x7f7d38158270 2023-12-19T16:15:41.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d377fe640 1 -- 172.21.15.73:0/2332951032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280ac980 con 0x7f7d38158270 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/2332951032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d38158270 msgr2=0x7f7d3815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/2332951032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d38158270 0x7f7d3815aee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d280097c0 tx=0x7f7d2801c380 comp rx=0 tx=0).stop 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/2332951032 shutdown_connections 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/2332951032 >> v2:172.21.15.162:3300/0 conn(0x7f7d3815e4d0 0x7f7d3806bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/2332951032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d38158270 0x7f7d3815aee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/2332951032 >> 172.21.15.73:0/2332951032 conn(0x7f7d3806a570 msgr2=0x7f7d380ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/2332951032 shutdown_connections 2023-12-19T16:15:41.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.385+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/2332951032 wait complete. 2023-12-19T16:15:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 Processor -- start 2023-12-19T16:15:41.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- start start 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38158270 0x7f7d380b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 0x7f7d380c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380c25e0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d38152df0 con 0x7f7d38158650 2023-12-19T16:15:41.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d381530d0 con 0x7f7d38158270 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58836/0 (socket says 172.21.15.73:58836) 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 -- 172.21.15.73:0/740883220 learned_addr learned my addr 172.21.15.73:0/740883220 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38158270 0x7f7d380b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d37fff640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 0x7f7d380c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 -- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38158270 msgr2=0x7f7d380b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38158270 0x7f7d380b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 -- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 msgr2=0x7f7d380c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 0x7f7d380c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:41.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 -- 172.21.15.73:0/740883220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28009420 con 0x7f7d3815e4d0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d37fff640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 0x7f7d380c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3d229640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007e60 tx=0x7f7d3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30014420 con 0x7f7d3815e4d0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300145a0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30014950 con 0x7f7d3815e4d0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d381533b0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.389+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d38153970 con 0x7f7d3815e4d0 2023-12-19T16:15:41.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3804e070 con 0x7f7d3815e4d0 2023-12-19T16:15:41.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d30014ab0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d357fa640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 0x7f7d24067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:41.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d300839f0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 0x7f7d24067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:41.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.393+0000 7f7d3ca28640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 0x7f7d24067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ae000 tx=0x7f7d280a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:41.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.397+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d300513b0 con 0x7f7d3815e4d0 2023-12-19T16:15:41.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:41.585+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7d380cf200 con 0x7f7d3815e4d0 2023-12-19T16:15:42.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d357fa640 1 -- 172.21.15.73:0/740883220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7d300549d0 con 0x7f7d3815e4d0 2023-12-19T16:15:42.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 msgr2=0x7f7d24067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 0x7f7d24067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ae000 tx=0x7f7d280a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:42.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 msgr2=0x7f7d3814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d30007e60 tx=0x7f7d3000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 shutdown_connections 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7d24065a60 0x7f7d24067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d3815e4d0 0x7f7d3814e1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d38158650 0x7f7d380c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 --2- 172.21.15.73:0/740883220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d38158270 0x7f7d380b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 >> 172.21.15.73:0/740883220 conn(0x7f7d3806a570 msgr2=0x7f7d380ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 shutdown_connections 2023-12-19T16:15:42.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.541+0000 7f7d3ec8c640 1 -- 172.21.15.73:0/740883220 wait complete. 2023-12-19T16:15:42.569 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:15:42.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:15:42.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 Processor -- start 2023-12-19T16:15:42.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 -- start start 2023-12-19T16:15:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 0x7f499006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4990159c70 0x7f49900cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49900cb8a0 0x7f49900719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499006ce80 con 0x7f49900cb8a0 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900ce280 con 0x7f4990159c70 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49974fe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990071560 con 0x7f49900cb4c0 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f4996cfd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49900cb8a0 0x7f49900719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f4996cfd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49900cb8a0 0x7f49900719f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58838/0 (socket says 172.21.15.73:58838) 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f4996cfd640 1 -- 172.21.15.73:0/694064169 learned_addr learned my addr 172.21.15.73:0/694064169 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f4995cfb640 1 --2- 172.21.15.73:0/694064169 >> v2:172.21.15.162:3300/0 conn(0x7f4990159c70 0x7f49900cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.709+0000 7f49964fc640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 0x7f499006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 -- 172.21.15.73:0/694064169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 msgr2=0x7f499006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:42.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 0x7f499006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 -- 172.21.15.73:0/694064169 >> v2:172.21.15.162:3300/0 conn(0x7f4990159c70 msgr2=0x7f49900cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:42.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 --2- 172.21.15.73:0/694064169 >> v2:172.21.15.162:3300/0 conn(0x7f4990159c70 0x7f49900cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 -- 172.21.15.73:0/694064169 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990071230 con 0x7f49900cb8a0 2023-12-19T16:15:42.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49964fc640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 0x7f499006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:42.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f4996cfd640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb8a0 0x7f49900719f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f499006ad00 tx=0x7f498801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d05b908d1598436 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49954fa640 1 -- 172.21.15.73:0/694064169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a5820 con 0x7f49900cb8a0 2023-12-19T16:15:42.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49954fa640 1 -- 172.21.15.73:0/694064169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880a5980 con 0x7f49900cb8a0 2023-12-19T16:15:42.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49954fa640 1 -- 172.21.15.73:0/694064169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a5d10 con 0x7f49900cb8a0 2023-12-19T16:15:42.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 -- 172.21.15.73:0/694064169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb8a0 msgr2=0x7f49900719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb8a0 0x7f49900719f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f499006ad00 tx=0x7f498801c9a0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 -- 172.21.15.73:0/694064169 shutdown_connections 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb8a0 0x7f49900719f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 --2- 172.21.15.73:0/694064169 >> v2:172.21.15.162:3300/0 conn(0x7f4990159c70 0x7f49900cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 --2- 172.21.15.73:0/694064169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb4c0 0x7f499006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.713+0000 7f49974fe640 1 -- 172.21.15.73:0/694064169 >> 172.21.15.73:0/694064169 conn(0x7f499006a120 msgr2=0x7f499006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:42.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- 172.21.15.73:0/694064169 shutdown_connections 2023-12-19T16:15:42.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- 172.21.15.73:0/694064169 wait complete. 2023-12-19T16:15:42.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 Processor -- start 2023-12-19T16:15:42.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- start start 2023-12-19T16:15:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb8a0 0x7f49900c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4990159c70 0x7f49900c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901f96b0 con 0x7f49900cb4c0 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900ad390 con 0x7f4990159c70 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49974fe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990153750 con 0x7f49900cb8a0 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58844/0 (socket says 172.21.15.73:58844) 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 -- 172.21.15.73:0/2760950301 learned_addr learned my addr 172.21.15.73:0/2760950301 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f4995cfb640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb8a0 0x7f49900c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f4996cfd640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4990159c70 0x7f49900c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 -- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb8a0 msgr2=0x7f49900c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb8a0 0x7f49900c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 -- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4990159c70 msgr2=0x7f49900c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4990159c70 0x7f49900c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:42.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 -- 172.21.15.73:0/2760950301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009b30 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f49964fc640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e7e0 tx=0x7f498c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.717+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0059a0 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c005b00 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c005e90 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49901f87e0 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49901f8d10 con 0x7f49900cb4c0 2023-12-19T16:15:42.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499004e000 con 0x7f49900cb4c0 2023-12-19T16:15:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f498c004030 con 0x7f49900cb4c0 2023-12-19T16:15:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4986ffd640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 0x7f4974067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f498c082fa0 con 0x7f49900cb4c0 2023-12-19T16:15:42.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4995cfb640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 0x7f4974067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:42.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.721+0000 7f4995cfb640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 0x7f4974067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f499006a8e0 tx=0x7f4980009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:42.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.725+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f498c050970 con 0x7f49900cb4c0 2023-12-19T16:15:42.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:42.905+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f499006a630 con 0x7f49900cb4c0 2023-12-19T16:15:43.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.541+0000 7f4986ffd640 1 -- 172.21.15.73:0/2760950301 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f498c053f90 con 0x7f49900cb4c0 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 msgr2=0x7f4974067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 0x7f4974067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f499006a8e0 tx=0x7f4980009190 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 msgr2=0x7f4990153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e7e0 tx=0x7f498c00eca0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 shutdown_connections 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4990159c70 0x7f49900c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49900cb8a0 0x7f49900c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4974065a60 0x7f4974067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 --2- 172.21.15.73:0/2760950301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49900cb4c0 0x7f4990153210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 >> 172.21.15.73:0/2760950301 conn(0x7f499006a120 msgr2=0x7f49900af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 shutdown_connections 2023-12-19T16:15:43.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.545+0000 7f49974fe640 1 -- 172.21.15.73:0/2760950301 wait complete. 2023-12-19T16:15:43.568 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:15:43.568 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:43.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 Processor -- start 2023-12-19T16:15:43.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 -- start start 2023-12-19T16:15:43.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 0x7f39f40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f39f406d1a0 0x7f39f40cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40ca6f0 con 0x7f39f40cbe90 2023-12-19T16:15:43.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40cccb0 con 0x7f39f406d1a0 2023-12-19T16:15:43.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39fa37b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4159530 con 0x7f39f406ddf0 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 0x7f39f40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f8918640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f39f406d1a0 0x7f39f40cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 0x7f39f40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:58910/0 (socket says 172.21.15.73:58910) 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f3fff640 1 -- 172.21.15.73:0/2930551318 learned_addr learned my addr 172.21.15.73:0/2930551318 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f8918640 1 -- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 msgr2=0x7f39f40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f8918640 1 --2- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 0x7f39f40cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f8918640 1 -- 172.21.15.73:0/2930551318 >> v1:172.21.15.162:6789/0 conn(0x7f39f40cbe90 legacy=0x7f39f4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.705+0000 7f39f8918640 1 -- 172.21.15.73:0/2930551318 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40c9ae0 con 0x7f39f406d1a0 2023-12-19T16:15:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39f8918640 1 --2- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406d1a0 0x7f39f40cd3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009d90 tx=0x7f39ec01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ec635f2f2f0dfe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39f2ffd640 1 -- 172.21.15.73:0/2930551318 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0a5960 con 0x7f39f406d1a0 2023-12-19T16:15:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39f2ffd640 1 -- 172.21.15.73:0/2930551318 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec0a5ac0 con 0x7f39f406d1a0 2023-12-19T16:15:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39f2ffd640 1 -- 172.21.15.73:0/2930551318 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0a5e50 con 0x7f39f406d1a0 2023-12-19T16:15:43.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 -- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406d1a0 msgr2=0x7f39f40cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 --2- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406d1a0 0x7f39f40cd3b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009d90 tx=0x7f39ec01c920 comp rx=0 tx=0).stop 2023-12-19T16:15:43.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 -- 172.21.15.73:0/2930551318 shutdown_connections 2023-12-19T16:15:43.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 --2- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406d1a0 0x7f39f40cd3b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 --2- 172.21.15.73:0/2930551318 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406ddf0 0x7f39f40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 -- 172.21.15.73:0/2930551318 >> 172.21.15.73:0/2930551318 conn(0x7f39f40b0270 msgr2=0x7f39f40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 -- 172.21.15.73:0/2930551318 shutdown_connections 2023-12-19T16:15:43.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.709+0000 7f39fa37b640 1 -- 172.21.15.73:0/2930551318 wait complete. 2023-12-19T16:15:43.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 Processor -- start 2023-12-19T16:15:43.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 -- start start 2023-12-19T16:15:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406d1a0 0x7f39f4145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406ddf0 0x7f39f40b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40b41b0 con 0x7f39f40cbe90 2023-12-19T16:15:43.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41476d0 con 0x7f39f406ddf0 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4146910 con 0x7f39f406d1a0 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58860/0 (socket says 172.21.15.73:58860) 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 -- 172.21.15.73:0/744097166 learned_addr learned my addr 172.21.15.73:0/744097166 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f3fff640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406d1a0 0x7f39f4145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f37fe640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406ddf0 0x7f39f40b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 -- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406d1a0 msgr2=0x7f39f4145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406d1a0 0x7f39f4145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 -- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406ddf0 msgr2=0x7f39f40b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406ddf0 0x7f39f40b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 -- 172.21.15.73:0/744097166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009a70 con 0x7f39f40cbe90 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f8918640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39ec01a550 tx=0x7f39ec0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec009450 con 0x7f39f40cbe90 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec0adb50 con 0x7f39f40cbe90 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0b8420 con 0x7f39f40cbe90 2023-12-19T16:15:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.713+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f4146bf0 con 0x7f39f40cbe90 2023-12-19T16:15:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f41471b0 con 0x7f39f40cbe90 2023-12-19T16:15:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f41473a0 con 0x7f39f40cbe90 2023-12-19T16:15:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39ec0b8580 con 0x7f39f40cbe90 2023-12-19T16:15:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39f0ff9640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 0x7f39e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39ec11e950 con 0x7f39f40cbe90 2023-12-19T16:15:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39f3fff640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 0x7f39e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.717+0000 7f39f3fff640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 0x7f39e0067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006fd0 tx=0x7f39e400f040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.721+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39ec0ec440 con 0x7f39f40cbe90 2023-12-19T16:15:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39f4074050 con 0x7f39f40cbe90 2023-12-19T16:15:43.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39f0ff9640 1 -- 172.21.15.73:0/744097166 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f39ec0bc090 con 0x7f39f40cbe90 2023-12-19T16:15:43.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:43.909 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:43.909 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:15:43.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 msgr2=0x7f39e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 0x7f39e0067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39e4006fd0 tx=0x7f39e400f040 comp rx=0 tx=0).stop 2023-12-19T16:15:43.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 msgr2=0x7f39f40b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:43.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f39ec01a550 tx=0x7f39ec0196c0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 shutdown_connections 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39e0065a60 0x7f39e0067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39f40cbe90 0x7f39f40b0b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f406ddf0 0x7f39f40b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 --2- 172.21.15.73:0/744097166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f406d1a0 0x7f39f4145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:43.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.905+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 >> 172.21.15.73:0/744097166 conn(0x7f39f40b0270 msgr2=0x7f39f4162080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:43.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.909+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 shutdown_connections 2023-12-19T16:15:43.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:43.909+0000 7f39fa37b640 1 -- 172.21.15.73:0/744097166 wait complete. 2023-12-19T16:15:43.931 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:44.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 Processor -- start 2023-12-19T16:15:44.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 -- start start 2023-12-19T16:15:44.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb85c0cd580 0x7fb85c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c0cbe90 0x7fb85c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0ca6f0 con 0x7fb85c06ddf0 2023-12-19T16:15:44.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0cccb0 con 0x7fb85c0cd580 2023-12-19T16:15:44.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb861ef9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c159530 con 0x7fb85c0cbe90 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb85c0cd580 0x7fb85c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb85c0cd580 0x7fb85c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58866/0 (socket says 172.21.15.73:58866) 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb85c06ddf0 0x7fb85c0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50056/0 (socket says 172.21.15.73:50056) 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 -- 172.21.15.73:0/2032593622 learned_addr learned my addr 172.21.15.73:0/2032593622 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85bfff640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c0cbe90 0x7fb85c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 -- 172.21.15.73:0/2032593622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c0cbe90 msgr2=0x7fb85c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c0cbe90 0x7fb85c06c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 -- 172.21.15.73:0/2032593622 >> v1:172.21.15.73:6789/0 conn(0x7fb85c06ddf0 legacy=0x7fb85c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85affd640 1 -- 172.21.15.73:0/2032593622 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0c9ae0 con 0x7fb85c0cd580 2023-12-19T16:15:44.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.065+0000 7fb85a7fc640 1 -- 172.21.15.73:0/2032593622 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577548649 0 0) 0x7fb85c0ca6f0 con 0x7fb85c06ddf0 2023-12-19T16:15:44.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb85affd640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cd580 0x7fb85c06c190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb850009870 tx=0x7fb85001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67767a0288b03e98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb85a7fc640 1 -- 172.21.15.73:0/2032593622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ad680 con 0x7fb85c0cd580 2023-12-19T16:15:44.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb85a7fc640 1 -- 172.21.15.73:0/2032593622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500ad7e0 con 0x7fb85c0cd580 2023-12-19T16:15:44.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb85a7fc640 1 -- 172.21.15.73:0/2032593622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500adb70 con 0x7fb85c0cd580 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 -- 172.21.15.73:0/2032593622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cd580 msgr2=0x7fb85c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cd580 0x7fb85c06c190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb850009870 tx=0x7fb85001c510 comp rx=0 tx=0).stop 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 -- 172.21.15.73:0/2032593622 shutdown_connections 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c0cbe90 0x7fb85c06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2032593622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cd580 0x7fb85c06c190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 -- 172.21.15.73:0/2032593622 >> 172.21.15.73:0/2032593622 conn(0x7fb85c0b0270 msgr2=0x7fb85c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 -- 172.21.15.73:0/2032593622 shutdown_connections 2023-12-19T16:15:44.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.069+0000 7fb861ef9640 1 -- 172.21.15.73:0/2032593622 wait complete. 2023-12-19T16:15:44.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 Processor -- start 2023-12-19T16:15:44.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- start start 2023-12-19T16:15:44.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c06ddf0 0x7fb85c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb85c0cd580 0x7fb85c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15bc50 con 0x7fb85c0cbe90 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c167690 con 0x7fb85c0cd580 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c166a80 con 0x7fb85c06ddf0 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58872/0 (socket says 172.21.15.73:58872) 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 -- 172.21.15.73:0/2825645291 learned_addr learned my addr 172.21.15.73:0/2825645291 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85b7fe640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c06ddf0 0x7fb85c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85bfff640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb85c0cd580 0x7fb85c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 -- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c06ddf0 msgr2=0x7fb85c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c06ddf0 0x7fb85c15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 -- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb85c0cd580 msgr2=0x7fb85c0ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb85c0cd580 0x7fb85c0ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 -- 172.21.15.73:0/2825645291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500094d0 con 0x7fb85c0cbe90 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb85affd640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb85001a140 tx=0x7fb8500192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ade20 con 0x7fb85c0cbe90 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500b6460 con 0x7fb85c0cbe90 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c166d60 con 0x7fb85c0cbe90 2023-12-19T16:15:44.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b6810 con 0x7fb85c0cbe90 2023-12-19T16:15:44.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.073+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c167320 con 0x7fb85c0cbe90 2023-12-19T16:15:44.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c074050 con 0x7fb85c0cbe90 2023-12-19T16:15:44.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8500b4070 con 0x7fb85c0cbe90 2023-12-19T16:15:44.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb843fff640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 0x7fb848067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb85011ccf0 con 0x7fb85c0cbe90 2023-12-19T16:15:44.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb85b7fe640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 0x7fb848067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.077+0000 7fb85b7fe640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 0x7fb848067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb84c000f70 tx=0x7fb84c007b60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.081+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb8500ea610 con 0x7fb85c0cbe90 2023-12-19T16:15:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.233+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85c0b46c0 con 0x7fb85c0cbe90 2023-12-19T16:15:44.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.233+0000 7fb843fff640 1 -- 172.21.15.73:0/2825645291 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fb8500edc30 con 0x7fb85c0cbe90 2023-12-19T16:15:44.238 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:44.238 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 msgr2=0x7fb848067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 0x7fb848067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb84c000f70 tx=0x7fb84c007b60 comp rx=0 tx=0).stop 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 msgr2=0x7fb85c166110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb85001a140 tx=0x7fb8500192b0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 shutdown_connections 2023-12-19T16:15:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb85c0cd580 0x7fb85c0ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb848065a60 0x7fb848067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb85c0cbe90 0x7fb85c166110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 --2- 172.21.15.73:0/2825645291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb85c06ddf0 0x7fb85c15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 >> 172.21.15.73:0/2825645291 conn(0x7fb85c0b0270 msgr2=0x7fb85c154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 shutdown_connections 2023-12-19T16:15:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.237+0000 7fb861ef9640 1 -- 172.21.15.73:0/2825645291 wait complete. 2023-12-19T16:15:44.259 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:15:44.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:44.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 Processor -- start 2023-12-19T16:15:44.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 -- start start 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c0cd580 0x7f396c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f396c0cbe90 0x7f396c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0ca6f0 con 0x7f396c06ddf0 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0cccb0 con 0x7f396c0cbe90 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.393+0000 7f3970f60640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c159530 con 0x7f396c0cd580 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f396c06ddf0 0x7f396c0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:50062/0 (socket says 172.21.15.73:50062) 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396a59c640 1 -- 172.21.15.73:0/4247112264 learned_addr learned my addr 172.21.15.73:0/4247112264 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:44.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 --2- 172.21.15.73:0/4247112264 >> v2:172.21.15.73:3300/0 conn(0x7f396c0cbe90 0x7f396c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3969d9b640 1 -- 172.21.15.73:0/4247112264 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517032833 0 0) 0x7f396c0ca6f0 con 0x7f396c06ddf0 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3961d9b640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c0cd580 0x7f396c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3969d9b640 1 -- 172.21.15.73:0/4247112264 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3958003530 con 0x7f396c06ddf0 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 -- 172.21.15.73:0/4247112264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c0cd580 msgr2=0x7f396c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c0cd580 0x7f396c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 -- 172.21.15.73:0/4247112264 >> v1:172.21.15.73:6789/0 conn(0x7f396c06ddf0 legacy=0x7f396c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 -- 172.21.15.73:0/4247112264 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0c9ae0 con 0x7f396c0cbe90 2023-12-19T16:15:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f396ad9d640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cbe90 0x7f396c06c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3964009d90 tx=0x7f396401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628889aad9ebb819 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3969d9b640 1 -- 172.21.15.73:0/4247112264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640a5960 con 0x7f396c0cbe90 2023-12-19T16:15:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3969d9b640 1 -- 172.21.15.73:0/4247112264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39640a5ac0 con 0x7f396c0cbe90 2023-12-19T16:15:44.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.397+0000 7f3969d9b640 1 -- 172.21.15.73:0/4247112264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640a5e50 con 0x7f396c0cbe90 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- 172.21.15.73:0/4247112264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cbe90 msgr2=0x7f396c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cbe90 0x7f396c06c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3964009d90 tx=0x7f396401c920 comp rx=0 tx=0).stop 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- 172.21.15.73:0/4247112264 shutdown_connections 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c0cd580 0x7f396c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- 172.21.15.73:0/4247112264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cbe90 0x7f396c06c6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- 172.21.15.73:0/4247112264 >> 172.21.15.73:0/4247112264 conn(0x7f396c0b0270 msgr2=0x7f396c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- 172.21.15.73:0/4247112264 shutdown_connections 2023-12-19T16:15:44.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- 172.21.15.73:0/4247112264 wait complete. 2023-12-19T16:15:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 Processor -- start 2023-12-19T16:15:44.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- start start 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 0x7f396c1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 0x7f396c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c3f30 con 0x7f396c0cd580 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c2e40 con 0x7f396c0cbe90 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3970f60640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0c3600 con 0x7f396c06ddf0 2023-12-19T16:15:44.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f396ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f396ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58896/0 (socket says 172.21.15.73:58896) 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f396ad9d640 1 -- 172.21.15.73:0/749385400 learned_addr learned my addr 172.21.15.73:0/749385400 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f396a59c640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 0x7f396c1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.401+0000 7f3961d9b640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 0x7f396c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 -- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 msgr2=0x7f396c1f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 0x7f396c1f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 -- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 msgr2=0x7f396c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 0x7f396c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 -- 172.21.15.73:0/749385400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3964009a70 con 0x7f396c0cd580 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f3961d9b640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 0x7f396c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396a59c640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 0x7f396c1f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396ad9d640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f396401a550 tx=0x7f39640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640aed60 con 0x7f396c0cd580 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3964009450 con 0x7f396c0cd580 2023-12-19T16:15:44.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c0c38e0 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640b7630 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c1f5780 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c074050 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39640b4050 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f396411e3b0 con 0x7f396c0cd580 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.405+0000 7f396a59c640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.409+0000 7f396a59c640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 0x7f394c067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f395c005890 tx=0x7f395c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.409+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39640ebcd0 con 0x7f396c0cd580 2023-12-19T16:15:44.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.561+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f396c0ca380 con 0x7f394c065a60 2023-12-19T16:15:44.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.581+0000 7f39637fe640 1 -- 172.21.15.73:0/749385400 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264613 (secure 0 0 0) 0x7f395c0013e0 con 0x7f394c065a60 2023-12-19T16:15:44.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:15:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 msgr2=0x7f394c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 0x7f394c067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f395c005890 tx=0x7f395c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 msgr2=0x7f396c0c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f396401a550 tx=0x7f39640196c0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 shutdown_connections 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f394c065a60 0x7f394c067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f396c0cd580 0x7f396c0c43c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f396c0cbe90 0x7f396c0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 --2- 172.21.15.73:0/749385400 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f396c06ddf0 0x7f396c1f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 >> 172.21.15.73:0/749385400 conn(0x7f396c0b0270 msgr2=0x7f396c0ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 shutdown_connections 2023-12-19T16:15:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.585+0000 7f3970f60640 1 -- 172.21.15.73:0/749385400 wait complete. 2023-12-19T16:15:44.608 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T16:15:44.444121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218596,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756124,"statfs":{"total":773094113280,"available":772870270976,"internally_reserved":0,"allocated":3051520,"data_stored":1804888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.317688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196525+0000","last_change":"2023-12-19T16:15:40.564959+0000","last_active":"2023-12-19T16:15:42.196525+0000","last_peered":"2023-12-19T16:15:42.196525+0000","last_clean":"2023-12-19T16:15:42.196525+0000","last_became_active":"2023-12-19T16:15:40.564702+0000","last_became_peered":"2023-12-19T16:15:40.564702+0000","last_unstale":"2023-12-19T16:15:42.196525+0000","last_undegraded":"2023-12-19T16:15:42.196525+0000","last_fullsized":"2023-12-19T16:15:42.196525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195250+0000","last_change":"2023-12-19T16:15:40.576480+0000","last_active":"2023-12-19T16:15:42.195250+0000","last_peered":"2023-12-19T16:15:42.195250+0000","last_clean":"2023-12-19T16:15:42.195250+0000","last_became_active":"2023-12-19T16:15:40.574311+0000","last_became_peered":"2023-12-19T16:15:40.574311+0000","last_unstale":"2023-12-19T16:15:42.195250+0000","last_undegraded":"2023-12-19T16:15:42.195250+0000","last_fullsized":"2023-12-19T16:15:42.195250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195258+0000","last_change":"2023-12-19T16:15:40.573376+0000","last_active":"2023-12-19T16:15:42.195258+0000","last_peered":"2023-12-19T16:15:42.195258+0000","last_clean":"2023-12-19T16:15:42.195258+0000","last_became_active":"2023-12-19T16:15:40.573039+0000","last_became_peered":"2023-12-19T16:15:40.573039+0000","last_unstale":"2023-12-19T16:15:42.195258+0000","last_undegraded":"2023-12-19T16:15:42.195258+0000","last_fullsized":"2023-12-19T16:15:42.195258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541887+0000","last_change":"2023-12-19T16:15:40.564321+0000","last_active":"2023-12-19T16:15:41.541887+0000","last_peered":"2023-12-19T16:15:41.541887+0000","last_clean":"2023-12-19T16:15:41.541887+0000","last_became_active":"2023-12-19T16:15:40.564109+0000","last_became_peered":"2023-12-19T16:15:40.564109+0000","last_unstale":"2023-12-19T16:15:41.541887+0000","last_undegraded":"2023-12-19T16:15:41.541887+0000","last_fullsized":"2023-12-19T16:15:41.541887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:43.388901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196365+0000","last_change":"2023-12-19T16:15:40.573886+0000","last_active":"2023-12-19T16:15:42.196365+0000","last_peered":"2023-12-19T16:15:42.196365+0000","last_clean":"2023-12-19T16:15:42.196365+0000","last_became_active":"2023-12-19T16:15:40.573554+0000","last_became_peered":"2023-12-19T16:15:40.573554+0000","last_unstale":"2023-12-19T16:15:42.196365+0000","last_undegraded":"2023-12-19T16:15:42.196365+0000","last_fullsized":"2023-12-19T16:15:42.196365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541688+0000","last_change":"2023-12-19T16:15:40.565954+0000","last_active":"2023-12-19T16:15:41.541688+0000","last_peered":"2023-12-19T16:15:41.541688+0000","last_clean":"2023-12-19T16:15:41.541688+0000","last_became_active":"2023-12-19T16:15:40.563221+0000","last_became_peered":"2023-12-19T16:15:40.563221+0000","last_unstale":"2023-12-19T16:15:41.541688+0000","last_undegraded":"2023-12-19T16:15:41.541688+0000","last_fullsized":"2023-12-19T16:15:41.541688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196120+0000","last_change":"2023-12-19T16:15:40.551369+0000","last_active":"2023-12-19T16:15:42.196120+0000","last_peered":"2023-12-19T16:15:42.196120+0000","last_clean":"2023-12-19T16:15:42.196120+0000","last_became_active":"2023-12-19T16:15:40.551122+0000","last_became_peered":"2023-12-19T16:15:40.551122+0000","last_unstale":"2023-12-19T16:15:42.196120+0000","last_undegraded":"2023-12-19T16:15:42.196120+0000","last_fullsized":"2023-12-19T16:15:42.196120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195380+0000","last_change":"2023-12-19T16:15:40.568549+0000","last_active":"2023-12-19T16:15:42.195380+0000","last_peered":"2023-12-19T16:15:42.195380+0000","last_clean":"2023-12-19T16:15:42.195380+0000","last_became_active":"2023-12-19T16:15:40.567804+0000","last_became_peered":"2023-12-19T16:15:40.567804+0000","last_unstale":"2023-12-19T16:15:42.195380+0000","last_undegraded":"2023-12-19T16:15:42.195380+0000","last_fullsized":"2023-12-19T16:15:42.195380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196432+0000","last_change":"2023-12-19T16:15:40.542905+0000","last_active":"2023-12-19T16:15:42.196432+0000","last_peered":"2023-12-19T16:15:42.196432+0000","last_clean":"2023-12-19T16:15:42.196432+0000","last_became_active":"2023-12-19T16:15:40.542177+0000","last_became_peered":"2023-12-19T16:15:40.542177+0000","last_unstale":"2023-12-19T16:15:42.196432+0000","last_undegraded":"2023-12-19T16:15:42.196432+0000","last_fullsized":"2023-12-19T16:15:42.196432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196704+0000","last_change":"2023-12-19T16:15:40.554175+0000","last_active":"2023-12-19T16:15:42.196704+0000","last_peered":"2023-12-19T16:15:42.196704+0000","last_clean":"2023-12-19T16:15:42.196704+0000","last_became_active":"2023-12-19T16:15:40.553928+0000","last_became_peered":"2023-12-19T16:15:40.553928+0000","last_unstale":"2023-12-19T16:15:42.196704+0000","last_undegraded":"2023-12-19T16:15:42.196704+0000","last_fullsized":"2023-12-19T16:15:42.196704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196135+0000","last_change":"2023-12-19T16:15:40.566546+0000","last_active":"2023-12-19T16:15:42.196135+0000","last_peered":"2023-12-19T16:15:42.196135+0000","last_clean":"2023-12-19T16:15:42.196135+0000","last_became_active":"2023-12-19T16:15:40.566340+0000","last_became_peered":"2023-12-19T16:15:40.566340+0000","last_unstale":"2023-12-19T16:15:42.196135+0000","last_undegraded":"2023-12-19T16:15:42.196135+0000","last_fullsized":"2023-12-19T16:15:42.196135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196623+0000","last_change":"2023-12-19T16:15:40.556322+0000","last_active":"2023-12-19T16:15:42.196623+0000","last_peered":"2023-12-19T16:15:42.196623+0000","last_clean":"2023-12-19T16:15:42.196623+0000","last_became_active":"2023-12-19T16:15:40.555847+0000","last_became_peered":"2023-12-19T16:15:40.555847+0000","last_unstale":"2023-12-19T16:15:42.196623+0000","last_undegraded":"2023-12-19T16:15:42.196623+0000","last_fullsized":"2023-12-19T16:15:42.196623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195837+0000","last_change":"2023-12-19T16:15:40.554846+0000","last_active":"2023-12-19T16:15:42.195837+0000","last_peered":"2023-12-19T16:15:42.195837+0000","last_clean":"2023-12-19T16:15:42.195837+0000","last_became_active":"2023-12-19T16:15:40.554558+0000","last_became_peered":"2023-12-19T16:15:40.554558+0000","last_unstale":"2023-12-19T16:15:42.195837+0000","last_undegraded":"2023-12-19T16:15:42.195837+0000","last_fullsized":"2023-12-19T16:15:42.195837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195005+0000","last_change":"2023-12-19T16:15:40.556072+0000","last_active":"2023-12-19T16:15:42.195005+0000","last_peered":"2023-12-19T16:15:42.195005+0000","last_clean":"2023-12-19T16:15:42.195005+0000","last_became_active":"2023-12-19T16:15:40.555805+0000","last_became_peered":"2023-12-19T16:15:40.555805+0000","last_unstale":"2023-12-19T16:15:42.195005+0000","last_undegraded":"2023-12-19T16:15:42.195005+0000","last_fullsized":"2023-12-19T16:15:42.195005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195192+0000","last_change":"2023-12-19T16:15:40.572960+0000","last_active":"2023-12-19T16:15:42.195192+0000","last_peered":"2023-12-19T16:15:42.195192+0000","last_clean":"2023-12-19T16:15:42.195192+0000","last_became_active":"2023-12-19T16:15:40.572640+0000","last_became_peered":"2023-12-19T16:15:40.572640+0000","last_unstale":"2023-12-19T16:15:42.195192+0000","last_undegraded":"2023-12-19T16:15:42.195192+0000","last_fullsized":"2023-12-19T16:15:42.195192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774645+0000","last_change":"2023-12-19T16:15:40.554309+0000","last_active":"2023-12-19T16:15:41.774645+0000","last_peered":"2023-12-19T16:15:41.774645+0000","last_clean":"2023-12-19T16:15:41.774645+0000","last_became_active":"2023-12-19T16:15:40.552766+0000","last_became_peered":"2023-12-19T16:15:40.552766+0000","last_unstale":"2023-12-19T16:15:41.774645+0000","last_undegraded":"2023-12-19T16:15:41.774645+0000","last_fullsized":"2023-12-19T16:15:41.774645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775218+0000","last_change":"2023-12-19T16:15:40.553698+0000","last_active":"2023-12-19T16:15:41.775218+0000","last_peered":"2023-12-19T16:15:41.775218+0000","last_clean":"2023-12-19T16:15:41.775218+0000","last_became_active":"2023-12-19T16:15:40.553379+0000","last_became_peered":"2023-12-19T16:15:40.553379+0000","last_unstale":"2023-12-19T16:15:41.775218+0000","last_undegraded":"2023-12-19T16:15:41.775218+0000","last_fullsized":"2023-12-19T16:15:41.775218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:16.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544284+0000","last_change":"2023-12-19T16:15:40.556547+0000","last_active":"2023-12-19T16:15:41.544284+0000","last_peered":"2023-12-19T16:15:41.544284+0000","last_clean":"2023-12-19T16:15:41.544284+0000","last_became_active":"2023-12-19T16:15:40.555905+0000","last_became_peered":"2023-12-19T16:15:40.555905+0000","last_unstale":"2023-12-19T16:15:41.544284+0000","last_undegraded":"2023-12-19T16:15:41.544284+0000","last_fullsized":"2023-12-19T16:15:41.544284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775141+0000","last_change":"2023-12-19T16:15:40.560248+0000","last_active":"2023-12-19T16:15:41.775141+0000","last_peered":"2023-12-19T16:15:41.775141+0000","last_clean":"2023-12-19T16:15:41.775141+0000","last_became_active":"2023-12-19T16:15:40.548053+0000","last_became_peered":"2023-12-19T16:15:40.548053+0000","last_unstale":"2023-12-19T16:15:41.775141+0000","last_undegraded":"2023-12-19T16:15:41.775141+0000","last_fullsized":"2023-12-19T16:15:41.775141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:42.987632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196292+0000","last_change":"2023-12-19T16:15:40.556318+0000","last_active":"2023-12-19T16:15:42.196292+0000","last_peered":"2023-12-19T16:15:42.196292+0000","last_clean":"2023-12-19T16:15:42.196292+0000","last_became_active":"2023-12-19T16:15:40.555536+0000","last_became_peered":"2023-12-19T16:15:40.555536+0000","last_unstale":"2023-12-19T16:15:42.196292+0000","last_undegraded":"2023-12-19T16:15:42.196292+0000","last_fullsized":"2023-12-19T16:15:42.196292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563852+0000","last_change":"2023-12-19T16:15:40.552448+0000","last_active":"2023-12-19T16:15:40.563852+0000","last_peered":"2023-12-19T16:15:40.563852+0000","last_clean":"2023-12-19T16:15:40.563852+0000","last_became_active":"2023-12-19T16:15:40.552127+0000","last_became_peered":"2023-12-19T16:15:40.552127+0000","last_unstale":"2023-12-19T16:15:40.563852+0000","last_undegraded":"2023-12-19T16:15:40.563852+0000","last_fullsized":"2023-12-19T16:15:40.563852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:33.400230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195779+0000","last_change":"2023-12-19T16:15:40.549822+0000","last_active":"2023-12-19T16:15:42.195779+0000","last_peered":"2023-12-19T16:15:42.195779+0000","last_clean":"2023-12-19T16:15:42.195779+0000","last_became_active":"2023-12-19T16:15:40.548780+0000","last_became_peered":"2023-12-19T16:15:40.548780+0000","last_unstale":"2023-12-19T16:15:42.195779+0000","last_undegraded":"2023-12-19T16:15:42.195779+0000","last_fullsized":"2023-12-19T16:15:42.195779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:41.432356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195237+0000","last_change":"2023-12-19T16:15:40.569571+0000","last_active":"2023-12-19T16:15:42.195237+0000","last_peered":"2023-12-19T16:15:42.195237+0000","last_clean":"2023-12-19T16:15:42.195237+0000","last_became_active":"2023-12-19T16:15:40.566982+0000","last_became_peered":"2023-12-19T16:15:40.566982+0000","last_unstale":"2023-12-19T16:15:42.195237+0000","last_undegraded":"2023-12-19T16:15:42.195237+0000","last_fullsized":"2023-12-19T16:15:42.195237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.569324+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.568945+0000","last_became_peered":"2023-12-19T16:15:40.568945+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:04.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195417+0000","last_change":"2023-12-19T16:15:40.573746+0000","last_active":"2023-12-19T16:15:42.195417+0000","last_peered":"2023-12-19T16:15:42.195417+0000","last_clean":"2023-12-19T16:15:42.195417+0000","last_became_active":"2023-12-19T16:15:40.573442+0000","last_became_peered":"2023-12-19T16:15:40.573442+0000","last_unstale":"2023-12-19T16:15:42.195417+0000","last_undegraded":"2023-12-19T16:15:42.195417+0000","last_fullsized":"2023-12-19T16:15:42.195417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542041+0000","last_change":"2023-12-19T16:15:40.566429+0000","last_active":"2023-12-19T16:15:41.542041+0000","last_peered":"2023-12-19T16:15:41.542041+0000","last_clean":"2023-12-19T16:15:41.542041+0000","last_became_active":"2023-12-19T16:15:40.565983+0000","last_became_peered":"2023-12-19T16:15:40.565983+0000","last_unstale":"2023-12-19T16:15:41.542041+0000","last_undegraded":"2023-12-19T16:15:41.542041+0000","last_fullsized":"2023-12-19T16:15:41.542041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195908+0000","last_change":"2023-12-19T16:15:40.565357+0000","last_active":"2023-12-19T16:15:42.195908+0000","last_peered":"2023-12-19T16:15:42.195908+0000","last_clean":"2023-12-19T16:15:42.195908+0000","last_became_active":"2023-12-19T16:15:40.565074+0000","last_became_peered":"2023-12-19T16:15:40.565074+0000","last_unstale":"2023-12-19T16:15:42.195908+0000","last_undegraded":"2023-12-19T16:15:42.195908+0000","last_fullsized":"2023-12-19T16:15:42.195908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195836+0000","last_change":"2023-12-19T16:15:40.555405+0000","last_active":"2023-12-19T16:15:42.195836+0000","last_peered":"2023-12-19T16:15:42.195836+0000","last_clean":"2023-12-19T16:15:42.195836+0000","last_became_active":"2023-12-19T16:15:40.555000+0000","last_became_peered":"2023-12-19T16:15:40.555000+0000","last_unstale":"2023-12-19T16:15:42.195836+0000","last_undegraded":"2023-12-19T16:15:42.195836+0000","last_fullsized":"2023-12-19T16:15:42.195836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:06.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195687+0000","last_change":"2023-12-19T16:15:40.573526+0000","last_active":"2023-12-19T16:15:42.195687+0000","last_peered":"2023-12-19T16:15:42.195687+0000","last_clean":"2023-12-19T16:15:42.195687+0000","last_became_active":"2023-12-19T16:15:40.572779+0000","last_became_peered":"2023-12-19T16:15:40.572779+0000","last_unstale":"2023-12-19T16:15:42.195687+0000","last_undegraded":"2023-12-19T16:15:42.195687+0000","last_fullsized":"2023-12-19T16:15:42.195687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:37.149682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774761+0000","last_change":"2023-12-19T16:15:40.574985+0000","last_active":"2023-12-19T16:15:41.774761+0000","last_peered":"2023-12-19T16:15:41.774761+0000","last_clean":"2023-12-19T16:15:41.774761+0000","last_became_active":"2023-12-19T16:15:40.574724+0000","last_became_peered":"2023-12-19T16:15:40.574724+0000","last_unstale":"2023-12-19T16:15:41.774761+0000","last_undegraded":"2023-12-19T16:15:41.774761+0000","last_fullsized":"2023-12-19T16:15:41.774761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:41.216724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543806+0000","last_change":"2023-12-19T16:15:40.550561+0000","last_active":"2023-12-19T16:15:41.543806+0000","last_peered":"2023-12-19T16:15:41.543806+0000","last_clean":"2023-12-19T16:15:41.543806+0000","last_became_active":"2023-12-19T16:15:40.549817+0000","last_became_peered":"2023-12-19T16:15:40.549817+0000","last_unstale":"2023-12-19T16:15:41.543806+0000","last_undegraded":"2023-12-19T16:15:41.543806+0000","last_fullsized":"2023-12-19T16:15:41.543806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541700+0000","last_change":"2023-12-19T16:15:40.559294+0000","last_active":"2023-12-19T16:15:41.541700+0000","last_peered":"2023-12-19T16:15:41.541700+0000","last_clean":"2023-12-19T16:15:41.541700+0000","last_became_active":"2023-12-19T16:15:40.559007+0000","last_became_peered":"2023-12-19T16:15:40.559007+0000","last_unstale":"2023-12-19T16:15:41.541700+0000","last_undegraded":"2023-12-19T16:15:41.541700+0000","last_fullsized":"2023-12-19T16:15:41.541700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195827+0000","last_change":"2023-12-19T16:15:40.574997+0000","last_active":"2023-12-19T16:15:42.195827+0000","last_peered":"2023-12-19T16:15:42.195827+0000","last_clean":"2023-12-19T16:15:42.195827+0000","last_became_active":"2023-12-19T16:15:40.574713+0000","last_became_peered":"2023-12-19T16:15:40.574713+0000","last_unstale":"2023-12-19T16:15:42.195827+0000","last_undegraded":"2023-12-19T16:15:42.195827+0000","last_fullsized":"2023-12-19T16:15:42.195827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195918+0000","last_change":"2023-12-19T16:15:40.161104+0000","last_active":"2023-12-19T16:15:42.195918+0000","last_peered":"2023-12-19T16:15:42.195918+0000","last_clean":"2023-12-19T16:15:42.195918+0000","last_became_active":"2023-12-19T16:15:40.160769+0000","last_became_peered":"2023-12-19T16:15:40.160769+0000","last_unstale":"2023-12-19T16:15:42.195918+0000","last_undegraded":"2023-12-19T16:15:42.195918+0000","last_fullsized":"2023-12-19T16:15:42.195918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.558231+0000","last_change":"2023-12-19T16:15:40.549947+0000","last_active":"2023-12-19T16:15:40.558231+0000","last_peered":"2023-12-19T16:15:40.558231+0000","last_clean":"2023-12-19T16:15:40.558231+0000","last_became_active":"2023-12-19T16:15:40.548174+0000","last_became_peered":"2023-12-19T16:15:40.548174+0000","last_unstale":"2023-12-19T16:15:40.558231+0000","last_undegraded":"2023-12-19T16:15:40.558231+0000","last_fullsized":"2023-12-19T16:15:40.558231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:13.136180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774874+0000","last_change":"2023-12-19T16:15:40.171997+0000","last_active":"2023-12-19T16:15:41.774874+0000","last_peered":"2023-12-19T16:15:41.774874+0000","last_clean":"2023-12-19T16:15:41.774874+0000","last_became_active":"2023-12-19T16:15:40.171706+0000","last_became_peered":"2023-12-19T16:15:40.171706+0000","last_unstale":"2023-12-19T16:15:41.774874+0000","last_undegraded":"2023-12-19T16:15:41.774874+0000","last_fullsized":"2023-12-19T16:15:41.774874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:04.965195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194944+0000","last_change":"2023-12-19T16:15:40.153875+0000","last_active":"2023-12-19T16:15:42.194944+0000","last_peered":"2023-12-19T16:15:42.194944+0000","last_clean":"2023-12-19T16:15:42.194944+0000","last_became_active":"2023-12-19T16:15:40.153373+0000","last_became_peered":"2023-12-19T16:15:40.153373+0000","last_unstale":"2023-12-19T16:15:42.194944+0000","last_undegraded":"2023-12-19T16:15:42.194944+0000","last_fullsized":"2023-12-19T16:15:42.194944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.568164+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.567046+0000","last_became_peered":"2023-12-19T16:15:40.567046+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774782+0000","last_change":"2023-12-19T16:15:40.167038+0000","last_active":"2023-12-19T16:15:41.774782+0000","last_peered":"2023-12-19T16:15:41.774782+0000","last_clean":"2023-12-19T16:15:41.774782+0000","last_became_active":"2023-12-19T16:15:40.166736+0000","last_became_peered":"2023-12-19T16:15:40.166736+0000","last_unstale":"2023-12-19T16:15:41.774782+0000","last_undegraded":"2023-12-19T16:15:41.774782+0000","last_fullsized":"2023-12-19T16:15:41.774782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:33.645727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.552113+0000","last_change":"2023-12-19T16:15:40.544723+0000","last_active":"2023-12-19T16:15:40.552113+0000","last_peered":"2023-12-19T16:15:40.552113+0000","last_clean":"2023-12-19T16:15:40.552113+0000","last_became_active":"2023-12-19T16:15:40.543779+0000","last_became_peered":"2023-12-19T16:15:40.543779+0000","last_unstale":"2023-12-19T16:15:40.552113+0000","last_undegraded":"2023-12-19T16:15:40.552113+0000","last_fullsized":"2023-12-19T16:15:40.552113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:36:03.153648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.151962+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.151615+0000","last_became_peered":"2023-12-19T16:15:40.151615+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542009+0000","last_change":"2023-12-19T16:15:40.565718+0000","last_active":"2023-12-19T16:15:41.542009+0000","last_peered":"2023-12-19T16:15:41.542009+0000","last_clean":"2023-12-19T16:15:41.542009+0000","last_became_active":"2023-12-19T16:15:40.565454+0000","last_became_peered":"2023-12-19T16:15:40.565454+0000","last_unstale":"2023-12-19T16:15:41.542009+0000","last_undegraded":"2023-12-19T16:15:41.542009+0000","last_fullsized":"2023-12-19T16:15:41.542009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.166745+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.166441+0000","last_became_peered":"2023-12-19T16:15:40.166441+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:18.251526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195536+0000","last_change":"2023-12-19T16:15:40.572844+0000","last_active":"2023-12-19T16:15:42.195536+0000","last_peered":"2023-12-19T16:15:42.195536+0000","last_clean":"2023-12-19T16:15:42.195536+0000","last_became_active":"2023-12-19T16:15:40.572602+0000","last_became_peered":"2023-12-19T16:15:40.572602+0000","last_unstale":"2023-12-19T16:15:42.195536+0000","last_undegraded":"2023-12-19T16:15:42.195536+0000","last_fullsized":"2023-12-19T16:15:42.195536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544172+0000","last_change":"2023-12-19T16:15:40.154528+0000","last_active":"2023-12-19T16:15:41.544172+0000","last_peered":"2023-12-19T16:15:41.544172+0000","last_clean":"2023-12-19T16:15:41.544172+0000","last_became_active":"2023-12-19T16:15:40.154244+0000","last_became_peered":"2023-12-19T16:15:40.154244+0000","last_unstale":"2023-12-19T16:15:41.544172+0000","last_undegraded":"2023-12-19T16:15:41.544172+0000","last_fullsized":"2023-12-19T16:15:41.544172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774964+0000","last_change":"2023-12-19T16:15:40.553550+0000","last_active":"2023-12-19T16:15:41.774964+0000","last_peered":"2023-12-19T16:15:41.774964+0000","last_clean":"2023-12-19T16:15:41.774964+0000","last_became_active":"2023-12-19T16:15:40.553276+0000","last_became_peered":"2023-12-19T16:15:40.553276+0000","last_unstale":"2023-12-19T16:15:41.774964+0000","last_undegraded":"2023-12-19T16:15:41.774964+0000","last_fullsized":"2023-12-19T16:15:41.774964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541934+0000","last_change":"2023-12-19T16:15:40.156756+0000","last_active":"2023-12-19T16:15:41.541934+0000","last_peered":"2023-12-19T16:15:41.541934+0000","last_clean":"2023-12-19T16:15:41.541934+0000","last_became_active":"2023-12-19T16:15:40.155859+0000","last_became_peered":"2023-12-19T16:15:40.155859+0000","last_unstale":"2023-12-19T16:15:41.541934+0000","last_undegraded":"2023-12-19T16:15:41.541934+0000","last_fullsized":"2023-12-19T16:15:41.541934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:32.050629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196089+0000","last_change":"2023-12-19T16:15:40.561493+0000","last_active":"2023-12-19T16:15:42.196089+0000","last_peered":"2023-12-19T16:15:42.196089+0000","last_clean":"2023-12-19T16:15:42.196089+0000","last_became_active":"2023-12-19T16:15:40.561194+0000","last_became_peered":"2023-12-19T16:15:40.561194+0000","last_unstale":"2023-12-19T16:15:42.196089+0000","last_undegraded":"2023-12-19T16:15:42.196089+0000","last_fullsized":"2023-12-19T16:15:42.196089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544306+0000","last_change":"2023-12-19T16:15:40.166564+0000","last_active":"2023-12-19T16:15:41.544306+0000","last_peered":"2023-12-19T16:15:41.544306+0000","last_clean":"2023-12-19T16:15:41.544306+0000","last_became_active":"2023-12-19T16:15:40.166232+0000","last_became_peered":"2023-12-19T16:15:40.166232+0000","last_unstale":"2023-12-19T16:15:41.544306+0000","last_undegraded":"2023-12-19T16:15:41.544306+0000","last_fullsized":"2023-12-19T16:15:41.544306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195585+0000","last_change":"2023-12-19T16:15:40.558430+0000","last_active":"2023-12-19T16:15:42.195585+0000","last_peered":"2023-12-19T16:15:42.195585+0000","last_clean":"2023-12-19T16:15:42.195585+0000","last_became_active":"2023-12-19T16:15:40.558153+0000","last_became_peered":"2023-12-19T16:15:40.558153+0000","last_unstale":"2023-12-19T16:15:42.195585+0000","last_undegraded":"2023-12-19T16:15:42.195585+0000","last_fullsized":"2023-12-19T16:15:42.195585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:14:36.494631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774898+0000","last_change":"2023-12-19T16:15:40.163849+0000","last_active":"2023-12-19T16:15:41.774898+0000","last_peered":"2023-12-19T16:15:41.774898+0000","last_clean":"2023-12-19T16:15:41.774898+0000","last_became_active":"2023-12-19T16:15:40.163576+0000","last_became_peered":"2023-12-19T16:15:40.163576+0000","last_unstale":"2023-12-19T16:15:41.774898+0000","last_undegraded":"2023-12-19T16:15:41.774898+0000","last_fullsized":"2023-12-19T16:15:41.774898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774801+0000","last_change":"2023-12-19T16:15:40.559502+0000","last_active":"2023-12-19T16:15:41.774801+0000","last_peered":"2023-12-19T16:15:41.774801+0000","last_clean":"2023-12-19T16:15:41.774801+0000","last_became_active":"2023-12-19T16:15:40.559273+0000","last_became_peered":"2023-12-19T16:15:40.559273+0000","last_unstale":"2023-12-19T16:15:41.774801+0000","last_undegraded":"2023-12-19T16:15:41.774801+0000","last_fullsized":"2023-12-19T16:15:41.774801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:53.305645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196023+0000","last_change":"2023-12-19T16:15:40.166877+0000","last_active":"2023-12-19T16:15:42.196023+0000","last_peered":"2023-12-19T16:15:42.196023+0000","last_clean":"2023-12-19T16:15:42.196023+0000","last_became_active":"2023-12-19T16:15:40.166506+0000","last_became_peered":"2023-12-19T16:15:40.166506+0000","last_unstale":"2023-12-19T16:15:42.196023+0000","last_undegraded":"2023-12-19T16:15:42.196023+0000","last_fullsized":"2023-12-19T16:15:42.196023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195757+0000","last_change":"2023-12-19T16:15:40.569727+0000","last_active":"2023-12-19T16:15:42.195757+0000","last_peered":"2023-12-19T16:15:42.195757+0000","last_clean":"2023-12-19T16:15:42.195757+0000","last_became_active":"2023-12-19T16:15:40.569430+0000","last_became_peered":"2023-12-19T16:15:40.569430+0000","last_unstale":"2023-12-19T16:15:42.195757+0000","last_undegraded":"2023-12-19T16:15:42.195757+0000","last_fullsized":"2023-12-19T16:15:42.195757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.570619+0000","last_change":"2023-12-19T16:15:40.150626+0000","last_active":"2023-12-19T16:15:40.570619+0000","last_peered":"2023-12-19T16:15:40.570619+0000","last_clean":"2023-12-19T16:15:40.570619+0000","last_became_active":"2023-12-19T16:15:40.150345+0000","last_became_peered":"2023-12-19T16:15:40.150345+0000","last_unstale":"2023-12-19T16:15:40.570619+0000","last_undegraded":"2023-12-19T16:15:40.570619+0000","last_fullsized":"2023-12-19T16:15:40.570619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:49.556556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.550692+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.550433+0000","last_became_peered":"2023-12-19T16:15:40.550433+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:45:06.826275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196683+0000","last_change":"2023-12-19T16:15:40.167815+0000","last_active":"2023-12-19T16:15:42.196683+0000","last_peered":"2023-12-19T16:15:42.196683+0000","last_clean":"2023-12-19T16:15:42.196683+0000","last_became_active":"2023-12-19T16:15:40.167149+0000","last_became_peered":"2023-12-19T16:15:40.167149+0000","last_unstale":"2023-12-19T16:15:42.196683+0000","last_undegraded":"2023-12-19T16:15:42.196683+0000","last_fullsized":"2023-12-19T16:15:42.196683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542057+0000","last_change":"2023-12-19T16:15:40.560268+0000","last_active":"2023-12-19T16:15:41.542057+0000","last_peered":"2023-12-19T16:15:41.542057+0000","last_clean":"2023-12-19T16:15:41.542057+0000","last_became_active":"2023-12-19T16:15:40.559853+0000","last_became_peered":"2023-12-19T16:15:40.559853+0000","last_unstale":"2023-12-19T16:15:41.542057+0000","last_undegraded":"2023-12-19T16:15:41.542057+0000","last_fullsized":"2023-12-19T16:15:41.542057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.567796+0000","last_change":"2023-12-19T16:15:40.160008+0000","last_active":"2023-12-19T16:15:40.567796+0000","last_peered":"2023-12-19T16:15:40.567796+0000","last_clean":"2023-12-19T16:15:40.567796+0000","last_became_active":"2023-12-19T16:15:40.159521+0000","last_became_peered":"2023-12-19T16:15:40.159521+0000","last_unstale":"2023-12-19T16:15:40.567796+0000","last_undegraded":"2023-12-19T16:15:40.567796+0000","last_fullsized":"2023-12-19T16:15:40.567796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:50.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196655+0000","last_change":"2023-12-19T16:15:40.555956+0000","last_active":"2023-12-19T16:15:42.196655+0000","last_peered":"2023-12-19T16:15:42.196655+0000","last_clean":"2023-12-19T16:15:42.196655+0000","last_became_active":"2023-12-19T16:15:40.555515+0000","last_became_peered":"2023-12-19T16:15:40.555515+0000","last_unstale":"2023-12-19T16:15:42.196655+0000","last_undegraded":"2023-12-19T16:15:42.196655+0000","last_fullsized":"2023-12-19T16:15:42.196655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195286+0000","last_change":"2023-12-19T16:15:40.161341+0000","last_active":"2023-12-19T16:15:42.195286+0000","last_peered":"2023-12-19T16:15:42.195286+0000","last_clean":"2023-12-19T16:15:42.195286+0000","last_became_active":"2023-12-19T16:15:40.160718+0000","last_became_peered":"2023-12-19T16:15:40.160718+0000","last_unstale":"2023-12-19T16:15:42.195286+0000","last_undegraded":"2023-12-19T16:15:42.195286+0000","last_fullsized":"2023-12-19T16:15:42.195286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196516+0000","last_change":"2023-12-19T16:15:40.561843+0000","last_active":"2023-12-19T16:15:42.196516+0000","last_peered":"2023-12-19T16:15:42.196516+0000","last_clean":"2023-12-19T16:15:42.196516+0000","last_became_active":"2023-12-19T16:15:40.561455+0000","last_became_peered":"2023-12-19T16:15:40.561455+0000","last_unstale":"2023-12-19T16:15:42.196516+0000","last_undegraded":"2023-12-19T16:15:42.196516+0000","last_fullsized":"2023-12-19T16:15:42.196516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195860+0000","last_change":"2023-12-19T16:15:40.170958+0000","last_active":"2023-12-19T16:15:42.195860+0000","last_peered":"2023-12-19T16:15:42.195860+0000","last_clean":"2023-12-19T16:15:42.195860+0000","last_became_active":"2023-12-19T16:15:40.170735+0000","last_became_peered":"2023-12-19T16:15:40.170735+0000","last_unstale":"2023-12-19T16:15:42.195860+0000","last_undegraded":"2023-12-19T16:15:42.195860+0000","last_fullsized":"2023-12-19T16:15:42.195860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775038+0000","last_change":"2023-12-19T16:15:40.557532+0000","last_active":"2023-12-19T16:15:41.775038+0000","last_peered":"2023-12-19T16:15:41.775038+0000","last_clean":"2023-12-19T16:15:41.775038+0000","last_became_active":"2023-12-19T16:15:40.549277+0000","last_became_peered":"2023-12-19T16:15:40.549277+0000","last_unstale":"2023-12-19T16:15:41.775038+0000","last_undegraded":"2023-12-19T16:15:41.775038+0000","last_fullsized":"2023-12-19T16:15:41.775038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:42.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.533799+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:15:40.533799+0000","last_peered":"2023-12-19T16:15:40.533799+0000","last_clean":"2023-12-19T16:15:40.533799+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:15:40.533799+0000","last_undegraded":"2023-12-19T16:15:40.533799+0000","last_fullsized":"2023-12-19T16:15:40.533799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774904+0000","last_change":"2023-12-19T16:15:40.163049+0000","last_active":"2023-12-19T16:15:41.774904+0000","last_peered":"2023-12-19T16:15:41.774904+0000","last_clean":"2023-12-19T16:15:41.774904+0000","last_became_active":"2023-12-19T16:15:40.162399+0000","last_became_peered":"2023-12-19T16:15:40.162399+0000","last_unstale":"2023-12-19T16:15:41.774904+0000","last_undegraded":"2023-12-19T16:15:41.774904+0000","last_fullsized":"2023-12-19T16:15:41.774904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:42.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563323+0000","last_change":"2023-12-19T16:15:40.552618+0000","last_active":"2023-12-19T16:15:40.563323+0000","last_peered":"2023-12-19T16:15:40.563323+0000","last_clean":"2023-12-19T16:15:40.563323+0000","last_became_active":"2023-12-19T16:15:40.552192+0000","last_became_peered":"2023-12-19T16:15:40.552192+0000","last_unstale":"2023-12-19T16:15:40.563323+0000","last_undegraded":"2023-12-19T16:15:40.563323+0000","last_fullsized":"2023-12-19T16:15:40.563323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:28:34.037513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774770+0000","last_change":"2023-12-19T16:15:40.162386+0000","last_active":"2023-12-19T16:15:41.774770+0000","last_peered":"2023-12-19T16:15:41.774770+0000","last_clean":"2023-12-19T16:15:41.774770+0000","last_became_active":"2023-12-19T16:15:40.162130+0000","last_became_peered":"2023-12-19T16:15:40.162130+0000","last_unstale":"2023-12-19T16:15:41.774770+0000","last_undegraded":"2023-12-19T16:15:41.774770+0000","last_fullsized":"2023-12-19T16:15:41.774770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:39.071401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194943+0000","last_change":"2023-12-19T16:15:40.554293+0000","last_active":"2023-12-19T16:15:42.194943+0000","last_peered":"2023-12-19T16:15:42.194943+0000","last_clean":"2023-12-19T16:15:42.194943+0000","last_became_active":"2023-12-19T16:15:40.551755+0000","last_became_peered":"2023-12-19T16:15:40.551755+0000","last_unstale":"2023-12-19T16:15:42.194943+0000","last_undegraded":"2023-12-19T16:15:42.194943+0000","last_fullsized":"2023-12-19T16:15:42.194943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543821+0000","last_change":"2023-12-19T16:15:40.158318+0000","last_active":"2023-12-19T16:15:41.543821+0000","last_peered":"2023-12-19T16:15:41.543821+0000","last_clean":"2023-12-19T16:15:41.543821+0000","last_became_active":"2023-12-19T16:15:40.157613+0000","last_became_peered":"2023-12-19T16:15:40.157613+0000","last_unstale":"2023-12-19T16:15:41.543821+0000","last_undegraded":"2023-12-19T16:15:41.543821+0000","last_fullsized":"2023-12-19T16:15:41.543821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195229+0000","last_change":"2023-12-19T16:15:40.568353+0000","last_active":"2023-12-19T16:15:42.195229+0000","last_peered":"2023-12-19T16:15:42.195229+0000","last_clean":"2023-12-19T16:15:42.195229+0000","last_became_active":"2023-12-19T16:15:40.567479+0000","last_became_peered":"2023-12-19T16:15:40.567479+0000","last_unstale":"2023-12-19T16:15:42.195229+0000","last_undegraded":"2023-12-19T16:15:42.195229+0000","last_fullsized":"2023-12-19T16:15:42.195229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:33.311177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774968+0000","last_change":"2023-12-19T16:15:40.164928+0000","last_active":"2023-12-19T16:15:41.774968+0000","last_peered":"2023-12-19T16:15:41.774968+0000","last_clean":"2023-12-19T16:15:41.774968+0000","last_became_active":"2023-12-19T16:15:40.164705+0000","last_became_peered":"2023-12-19T16:15:40.164705+0000","last_unstale":"2023-12-19T16:15:41.774968+0000","last_undegraded":"2023-12-19T16:15:41.774968+0000","last_fullsized":"2023-12-19T16:15:41.774968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:39.741388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196456+0000","last_change":"2023-12-19T16:15:40.553255+0000","last_active":"2023-12-19T16:15:42.196456+0000","last_peered":"2023-12-19T16:15:42.196456+0000","last_clean":"2023-12-19T16:15:42.196456+0000","last_became_active":"2023-12-19T16:15:40.553001+0000","last_became_peered":"2023-12-19T16:15:40.553001+0000","last_unstale":"2023-12-19T16:15:42.196456+0000","last_undegraded":"2023-12-19T16:15:42.196456+0000","last_fullsized":"2023-12-19T16:15:42.196456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195083+0000","last_change":"2023-12-19T16:15:40.162669+0000","last_active":"2023-12-19T16:15:42.195083+0000","last_peered":"2023-12-19T16:15:42.195083+0000","last_clean":"2023-12-19T16:15:42.195083+0000","last_became_active":"2023-12-19T16:15:40.162323+0000","last_became_peered":"2023-12-19T16:15:40.162323+0000","last_unstale":"2023-12-19T16:15:42.195083+0000","last_undegraded":"2023-12-19T16:15:42.195083+0000","last_fullsized":"2023-12-19T16:15:42.195083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541911+0000","last_change":"2023-12-19T16:15:40.560616+0000","last_active":"2023-12-19T16:15:41.541911+0000","last_peered":"2023-12-19T16:15:41.541911+0000","last_clean":"2023-12-19T16:15:41.541911+0000","last_became_active":"2023-12-19T16:15:40.560305+0000","last_became_peered":"2023-12-19T16:15:40.560305+0000","last_unstale":"2023-12-19T16:15:41.541911+0000","last_undegraded":"2023-12-19T16:15:41.541911+0000","last_fullsized":"2023-12-19T16:15:41.541911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775144+0000","last_change":"2023-12-19T16:15:40.159112+0000","last_active":"2023-12-19T16:15:41.775144+0000","last_peered":"2023-12-19T16:15:41.775144+0000","last_clean":"2023-12-19T16:15:41.775144+0000","last_became_active":"2023-12-19T16:15:40.158745+0000","last_became_peered":"2023-12-19T16:15:40.158745+0000","last_unstale":"2023-12-19T16:15:41.775144+0000","last_undegraded":"2023-12-19T16:15:41.775144+0000","last_fullsized":"2023-12-19T16:15:41.775144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195766+0000","last_change":"2023-12-19T16:15:40.574613+0000","last_active":"2023-12-19T16:15:42.195766+0000","last_peered":"2023-12-19T16:15:42.195766+0000","last_clean":"2023-12-19T16:15:42.195766+0000","last_became_active":"2023-12-19T16:15:40.574349+0000","last_became_peered":"2023-12-19T16:15:40.574349+0000","last_unstale":"2023-12-19T16:15:42.195766+0000","last_undegraded":"2023-12-19T16:15:42.195766+0000","last_fullsized":"2023-12-19T16:15:42.195766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:48:11.094121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.536581+0000","last_change":"2023-12-19T16:15:40.170093+0000","last_active":"2023-12-19T16:15:40.536581+0000","last_peered":"2023-12-19T16:15:40.536581+0000","last_clean":"2023-12-19T16:15:40.536581+0000","last_became_active":"2023-12-19T16:15:40.169869+0000","last_became_peered":"2023-12-19T16:15:40.169869+0000","last_unstale":"2023-12-19T16:15:40.536581+0000","last_undegraded":"2023-12-19T16:15:40.536581+0000","last_fullsized":"2023-12-19T16:15:40.536581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:27.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563302+0000","last_change":"2023-12-19T16:15:40.555076+0000","last_active":"2023-12-19T16:15:40.563302+0000","last_peered":"2023-12-19T16:15:40.563302+0000","last_clean":"2023-12-19T16:15:40.563302+0000","last_became_active":"2023-12-19T16:15:40.553947+0000","last_became_peered":"2023-12-19T16:15:40.553947+0000","last_unstale":"2023-12-19T16:15:40.563302+0000","last_undegraded":"2023-12-19T16:15:40.563302+0000","last_fullsized":"2023-12-19T16:15:40.563302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:57.529437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775238+0000","last_change":"2023-12-19T16:15:40.169787+0000","last_active":"2023-12-19T16:15:41.775238+0000","last_peered":"2023-12-19T16:15:41.775238+0000","last_clean":"2023-12-19T16:15:41.775238+0000","last_became_active":"2023-12-19T16:15:40.169383+0000","last_became_peered":"2023-12-19T16:15:40.169383+0000","last_unstale":"2023-12-19T16:15:41.775238+0000","last_undegraded":"2023-12-19T16:15:41.775238+0000","last_fullsized":"2023-12-19T16:15:41.775238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:51.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.558196+0000","last_change":"2023-12-19T16:15:40.544924+0000","last_active":"2023-12-19T16:15:40.558196+0000","last_peered":"2023-12-19T16:15:40.558196+0000","last_clean":"2023-12-19T16:15:40.558196+0000","last_became_active":"2023-12-19T16:15:40.544590+0000","last_became_peered":"2023-12-19T16:15:40.544590+0000","last_unstale":"2023-12-19T16:15:40.558196+0000","last_undegraded":"2023-12-19T16:15:40.558196+0000","last_fullsized":"2023-12-19T16:15:40.558196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:10.724734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196014+0000","last_change":"2023-12-19T16:15:40.148785+0000","last_active":"2023-12-19T16:15:42.196014+0000","last_peered":"2023-12-19T16:15:42.196014+0000","last_clean":"2023-12-19T16:15:42.196014+0000","last_became_active":"2023-12-19T16:15:40.147904+0000","last_became_peered":"2023-12-19T16:15:40.147904+0000","last_unstale":"2023-12-19T16:15:42.196014+0000","last_undegraded":"2023-12-19T16:15:42.196014+0000","last_fullsized":"2023-12-19T16:15:42.196014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774747+0000","last_change":"2023-12-19T16:15:40.546029+0000","last_active":"2023-12-19T16:15:41.774747+0000","last_peered":"2023-12-19T16:15:41.774747+0000","last_clean":"2023-12-19T16:15:41.774747+0000","last_became_active":"2023-12-19T16:15:40.545475+0000","last_became_peered":"2023-12-19T16:15:40.545475+0000","last_unstale":"2023-12-19T16:15:41.774747+0000","last_undegraded":"2023-12-19T16:15:41.774747+0000","last_fullsized":"2023-12-19T16:15:41.774747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:39.910949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.535694+0000","last_change":"2023-12-19T16:15:40.148744+0000","last_active":"2023-12-19T16:15:40.535694+0000","last_peered":"2023-12-19T16:15:40.535694+0000","last_clean":"2023-12-19T16:15:40.535694+0000","last_became_active":"2023-12-19T16:15:40.148279+0000","last_became_peered":"2023-12-19T16:15:40.148279+0000","last_unstale":"2023-12-19T16:15:40.535694+0000","last_undegraded":"2023-12-19T16:15:40.535694+0000","last_fullsized":"2023-12-19T16:15:40.535694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:56:19.336029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.552953+0000","last_change":"2023-12-19T16:15:40.548298+0000","last_active":"2023-12-19T16:15:40.552953+0000","last_peered":"2023-12-19T16:15:40.552953+0000","last_clean":"2023-12-19T16:15:40.552953+0000","last_became_active":"2023-12-19T16:15:40.545774+0000","last_became_peered":"2023-12-19T16:15:40.545774+0000","last_unstale":"2023-12-19T16:15:40.552953+0000","last_undegraded":"2023-12-19T16:15:40.552953+0000","last_fullsized":"2023-12-19T16:15:40.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:45.938202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195660+0000","last_change":"2023-12-19T16:15:40.158974+0000","last_active":"2023-12-19T16:15:42.195660+0000","last_peered":"2023-12-19T16:15:42.195660+0000","last_clean":"2023-12-19T16:15:42.195660+0000","last_became_active":"2023-12-19T16:15:40.158129+0000","last_became_peered":"2023-12-19T16:15:40.158129+0000","last_unstale":"2023-12-19T16:15:42.195660+0000","last_undegraded":"2023-12-19T16:15:42.195660+0000","last_fullsized":"2023-12-19T16:15:42.195660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544242+0000","last_change":"2023-12-19T16:15:40.554888+0000","last_active":"2023-12-19T16:15:41.544242+0000","last_peered":"2023-12-19T16:15:41.544242+0000","last_clean":"2023-12-19T16:15:41.544242+0000","last_became_active":"2023-12-19T16:15:40.554560+0000","last_became_peered":"2023-12-19T16:15:40.554560+0000","last_unstale":"2023-12-19T16:15:41.544242+0000","last_undegraded":"2023-12-19T16:15:41.544242+0000","last_fullsized":"2023-12-19T16:15:41.544242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774905+0000","last_change":"2023-12-19T16:15:40.163081+0000","last_active":"2023-12-19T16:15:41.774905+0000","last_peered":"2023-12-19T16:15:41.774905+0000","last_clean":"2023-12-19T16:15:41.774905+0000","last_became_active":"2023-12-19T16:15:40.162817+0000","last_became_peered":"2023-12-19T16:15:40.162817+0000","last_unstale":"2023-12-19T16:15:41.774905+0000","last_undegraded":"2023-12-19T16:15:41.774905+0000","last_fullsized":"2023-12-19T16:15:41.774905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:46.268839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774815+0000","last_change":"2023-12-19T16:15:40.542899+0000","last_active":"2023-12-19T16:15:41.774815+0000","last_peered":"2023-12-19T16:15:41.774815+0000","last_clean":"2023-12-19T16:15:41.774815+0000","last_became_active":"2023-12-19T16:15:40.542005+0000","last_became_peered":"2023-12-19T16:15:40.542005+0000","last_unstale":"2023-12-19T16:15:41.774815+0000","last_undegraded":"2023-12-19T16:15:41.774815+0000","last_fullsized":"2023-12-19T16:15:41.774815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:22.119577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775029+0000","last_change":"2023-12-19T16:15:40.560771+0000","last_active":"2023-12-19T16:15:41.775029+0000","last_peered":"2023-12-19T16:15:41.775029+0000","last_clean":"2023-12-19T16:15:41.775029+0000","last_became_active":"2023-12-19T16:15:40.560543+0000","last_became_peered":"2023-12-19T16:15:40.560543+0000","last_unstale":"2023-12-19T16:15:41.775029+0000","last_undegraded":"2023-12-19T16:15:41.775029+0000","last_fullsized":"2023-12-19T16:15:41.775029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:39.453323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196607+0000","last_change":"2023-12-19T16:15:40.169041+0000","last_active":"2023-12-19T16:15:42.196607+0000","last_peered":"2023-12-19T16:15:42.196607+0000","last_clean":"2023-12-19T16:15:42.196607+0000","last_became_active":"2023-12-19T16:15:40.168466+0000","last_became_peered":"2023-12-19T16:15:40.168466+0000","last_unstale":"2023-12-19T16:15:42.196607+0000","last_undegraded":"2023-12-19T16:15:42.196607+0000","last_fullsized":"2023-12-19T16:15:42.196607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196263+0000","last_change":"2023-12-19T16:15:40.554186+0000","last_active":"2023-12-19T16:15:42.196263+0000","last_peered":"2023-12-19T16:15:42.196263+0000","last_clean":"2023-12-19T16:15:42.196263+0000","last_became_active":"2023-12-19T16:15:40.553941+0000","last_became_peered":"2023-12-19T16:15:40.553941+0000","last_unstale":"2023-12-19T16:15:42.196263+0000","last_undegraded":"2023-12-19T16:15:42.196263+0000","last_fullsized":"2023-12-19T16:15:42.196263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196177+0000","last_change":"2023-12-19T16:15:40.169576+0000","last_active":"2023-12-19T16:15:42.196177+0000","last_peered":"2023-12-19T16:15:42.196177+0000","last_clean":"2023-12-19T16:15:42.196177+0000","last_became_active":"2023-12-19T16:15:40.169336+0000","last_became_peered":"2023-12-19T16:15:40.169336+0000","last_unstale":"2023-12-19T16:15:42.196177+0000","last_undegraded":"2023-12-19T16:15:42.196177+0000","last_fullsized":"2023-12-19T16:15:42.196177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.576580+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.576231+0000","last_became_peered":"2023-12-19T16:15:40.576231+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195533+0000","last_change":"2023-12-19T16:15:40.162671+0000","last_active":"2023-12-19T16:15:42.195533+0000","last_peered":"2023-12-19T16:15:42.195533+0000","last_clean":"2023-12-19T16:15:42.195533+0000","last_became_active":"2023-12-19T16:15:40.162239+0000","last_became_peered":"2023-12-19T16:15:40.162239+0000","last_unstale":"2023-12-19T16:15:42.195533+0000","last_undegraded":"2023-12-19T16:15:42.195533+0000","last_fullsized":"2023-12-19T16:15:42.195533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195348+0000","last_change":"2023-12-19T16:15:40.573940+0000","last_active":"2023-12-19T16:15:42.195348+0000","last_peered":"2023-12-19T16:15:42.195348+0000","last_clean":"2023-12-19T16:15:42.195348+0000","last_became_active":"2023-12-19T16:15:40.573117+0000","last_became_peered":"2023-12-19T16:15:40.573117+0000","last_unstale":"2023-12-19T16:15:42.195348+0000","last_undegraded":"2023-12-19T16:15:42.195348+0000","last_fullsized":"2023-12-19T16:15:42.195348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.565046+0000","last_change":"2023-12-19T16:15:40.164711+0000","last_active":"2023-12-19T16:15:40.565046+0000","last_peered":"2023-12-19T16:15:40.565046+0000","last_clean":"2023-12-19T16:15:40.565046+0000","last_became_active":"2023-12-19T16:15:40.164283+0000","last_became_peered":"2023-12-19T16:15:40.164283+0000","last_unstale":"2023-12-19T16:15:40.565046+0000","last_undegraded":"2023-12-19T16:15:40.565046+0000","last_fullsized":"2023-12-19T16:15:40.565046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:49.298209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":81355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":0,"up_from":16,"seq":68719476741,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":73491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":663951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":75727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:44.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:44.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.781+0000 7f4927a41640 1 Processor -- start 2023-12-19T16:15:44.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.781+0000 7f4927a41640 1 -- start start 2023-12-19T16:15:44.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4927a41640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f492015dfc0 0x7f49200cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4927a41640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 0x7f49200c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4927a41640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200c9940 con 0x7f4920070130 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4927a41640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492006d720 con 0x7f492015dfc0 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4927a41640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492015e3a0 con 0x7f49200c8fa0 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f492015dfc0 0x7f49200cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f492015dfc0 0x7f49200cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58910/0 (socket says 172.21.15.73:58910) 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 -- 172.21.15.73:0/413172070 learned_addr learned my addr 172.21.15.73:0/413172070 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4924fdc640 1 --2- 172.21.15.73:0/413172070 >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 0x7f49200c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 -- 172.21.15.73:0/413172070 >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 msgr2=0x7f49200c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 --2- 172.21.15.73:0/413172070 >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 0x7f49200c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 -- 172.21.15.73:0/413172070 >> v1:172.21.15.162:6789/0 conn(0x7f4920070130 legacy=0x7f4920070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f49257dd640 1 -- 172.21.15.73:0/413172070 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492006c3a0 con 0x7f492015dfc0 2023-12-19T16:15:44.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.785+0000 7f4924fdc640 1 --2- 172.21.15.73:0/413172070 >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 0x7f49200c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:44.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f49257dd640 1 --2- 172.21.15.73:0/413172070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492015dfc0 0x7f49200cbac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49200ce680 tx=0x7f491c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb288bbc7973da0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4917fff640 1 -- 172.21.15.73:0/413172070 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0aa430 con 0x7f492015dfc0 2023-12-19T16:15:44.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4917fff640 1 -- 172.21.15.73:0/413172070 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0aa590 con 0x7f492015dfc0 2023-12-19T16:15:44.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4917fff640 1 -- 172.21.15.73:0/413172070 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0aa920 con 0x7f492015dfc0 2023-12-19T16:15:44.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- 172.21.15.73:0/413172070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492015dfc0 msgr2=0x7f49200cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 --2- 172.21.15.73:0/413172070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492015dfc0 0x7f49200cbac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49200ce680 tx=0x7f491c01c4d0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- 172.21.15.73:0/413172070 shutdown_connections 2023-12-19T16:15:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 --2- 172.21.15.73:0/413172070 >> v2:172.21.15.162:3300/0 conn(0x7f49200c8fa0 0x7f49200c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 --2- 172.21.15.73:0/413172070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f492015dfc0 0x7f49200cbac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- 172.21.15.73:0/413172070 >> 172.21.15.73:0/413172070 conn(0x7f49200b0270 msgr2=0x7f49200b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- 172.21.15.73:0/413172070 shutdown_connections 2023-12-19T16:15:44.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- 172.21.15.73:0/413172070 wait complete. 2023-12-19T16:15:44.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 Processor -- start 2023-12-19T16:15:44.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.789+0000 7f4927a41640 1 -- start start 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49200c8fa0 0x7f49200ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492015dfc0 0x7f49200afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492014aa20 con 0x7f4920070130 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200af5d0 con 0x7f49200c8fa0 2023-12-19T16:15:44.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200ae720 con 0x7f492015dfc0 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38796/0 (socket says 172.21.15.73:38796) 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 -- 172.21.15.73:0/2687510576 learned_addr learned my addr 172.21.15.73:0/2687510576 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4925fde640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492015dfc0 0x7f49200afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4924fdc640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49200c8fa0 0x7f49200ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 -- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492015dfc0 msgr2=0x7f49200afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492015dfc0 0x7f49200afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 -- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49200c8fa0 msgr2=0x7f49200ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49200c8fa0 0x7f49200ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 -- 172.21.15.73:0/2687510576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0094d0 con 0x7f4920070130 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f49257dd640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f491c01a100 tx=0x7f491c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0aa430 con 0x7f4920070130 2023-12-19T16:15:44.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c0b3800 con 0x7f4920070130 2023-12-19T16:15:44.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0b3bb0 con 0x7f4920070130 2023-12-19T16:15:44.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200ae9c0 con 0x7f4920070130 2023-12-19T16:15:44.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200aef80 con 0x7f4920070130 2023-12-19T16:15:44.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4920074050 con 0x7f4920070130 2023-12-19T16:15:44.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.793+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f491c0b3d10 con 0x7f4920070130 2023-12-19T16:15:44.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.797+0000 7f4915ffb640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 0x7f4904067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:44.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.797+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f491c11da50 con 0x7f4920070130 2023-12-19T16:15:44.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.797+0000 7f4924fdc640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 0x7f4904067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:44.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.797+0000 7f4924fdc640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 0x7f4904067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49200c2200 tx=0x7f4910008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.801+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f491c0eb420 con 0x7f4920070130 2023-12-19T16:15:44.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.945+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f492006cf20 con 0x7f4904065a60 2023-12-19T16:15:44.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.953+0000 7f4915ffb640 1 -- 172.21.15.73:0/2687510576 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264613 (secure 0 0 0) 0x7f4910009e60 con 0x7f4904065a60 2023-12-19T16:15:44.959 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:44.961 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 msgr2=0x7f4904067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 0x7f4904067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49200c2200 tx=0x7f4910008040 comp rx=0 tx=0).stop 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 msgr2=0x7f492014a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f491c01a100 tx=0x7f491c01ad10 comp rx=0 tx=0).stop 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 shutdown_connections 2023-12-19T16:15:44.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f492015dfc0 0x7f49200afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49200c8fa0 0x7f49200ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4904065a60 0x7f4904067f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 --2- 172.21.15.73:0/2687510576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4920070130 0x7f492014a4e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 >> 172.21.15.73:0/2687510576 conn(0x7f49200b0270 msgr2=0x7f49201571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 shutdown_connections 2023-12-19T16:15:44.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:44.957+0000 7f4927a41640 1 -- 172.21.15.73:0/2687510576 wait complete. 2023-12-19T16:15:44.978 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-12-19T16:15:44.444121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218596,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756124,"statfs":{"total":773094113280,"available":772870270976,"internally_reserved":0,"allocated":3051520,"data_stored":1804888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.317688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196525+0000","last_change":"2023-12-19T16:15:40.564959+0000","last_active":"2023-12-19T16:15:42.196525+0000","last_peered":"2023-12-19T16:15:42.196525+0000","last_clean":"2023-12-19T16:15:42.196525+0000","last_became_active":"2023-12-19T16:15:40.564702+0000","last_became_peered":"2023-12-19T16:15:40.564702+0000","last_unstale":"2023-12-19T16:15:42.196525+0000","last_undegraded":"2023-12-19T16:15:42.196525+0000","last_fullsized":"2023-12-19T16:15:42.196525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195250+0000","last_change":"2023-12-19T16:15:40.576480+0000","last_active":"2023-12-19T16:15:42.195250+0000","last_peered":"2023-12-19T16:15:42.195250+0000","last_clean":"2023-12-19T16:15:42.195250+0000","last_became_active":"2023-12-19T16:15:40.574311+0000","last_became_peered":"2023-12-19T16:15:40.574311+0000","last_unstale":"2023-12-19T16:15:42.195250+0000","last_undegraded":"2023-12-19T16:15:42.195250+0000","last_fullsized":"2023-12-19T16:15:42.195250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195258+0000","last_change":"2023-12-19T16:15:40.573376+0000","last_active":"2023-12-19T16:15:42.195258+0000","last_peered":"2023-12-19T16:15:42.195258+0000","last_clean":"2023-12-19T16:15:42.195258+0000","last_became_active":"2023-12-19T16:15:40.573039+0000","last_became_peered":"2023-12-19T16:15:40.573039+0000","last_unstale":"2023-12-19T16:15:42.195258+0000","last_undegraded":"2023-12-19T16:15:42.195258+0000","last_fullsized":"2023-12-19T16:15:42.195258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541887+0000","last_change":"2023-12-19T16:15:40.564321+0000","last_active":"2023-12-19T16:15:41.541887+0000","last_peered":"2023-12-19T16:15:41.541887+0000","last_clean":"2023-12-19T16:15:41.541887+0000","last_became_active":"2023-12-19T16:15:40.564109+0000","last_became_peered":"2023-12-19T16:15:40.564109+0000","last_unstale":"2023-12-19T16:15:41.541887+0000","last_undegraded":"2023-12-19T16:15:41.541887+0000","last_fullsized":"2023-12-19T16:15:41.541887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:43.388901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196365+0000","last_change":"2023-12-19T16:15:40.573886+0000","last_active":"2023-12-19T16:15:42.196365+0000","last_peered":"2023-12-19T16:15:42.196365+0000","last_clean":"2023-12-19T16:15:42.196365+0000","last_became_active":"2023-12-19T16:15:40.573554+0000","last_became_peered":"2023-12-19T16:15:40.573554+0000","last_unstale":"2023-12-19T16:15:42.196365+0000","last_undegraded":"2023-12-19T16:15:42.196365+0000","last_fullsized":"2023-12-19T16:15:42.196365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541688+0000","last_change":"2023-12-19T16:15:40.565954+0000","last_active":"2023-12-19T16:15:41.541688+0000","last_peered":"2023-12-19T16:15:41.541688+0000","last_clean":"2023-12-19T16:15:41.541688+0000","last_became_active":"2023-12-19T16:15:40.563221+0000","last_became_peered":"2023-12-19T16:15:40.563221+0000","last_unstale":"2023-12-19T16:15:41.541688+0000","last_undegraded":"2023-12-19T16:15:41.541688+0000","last_fullsized":"2023-12-19T16:15:41.541688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196120+0000","last_change":"2023-12-19T16:15:40.551369+0000","last_active":"2023-12-19T16:15:42.196120+0000","last_peered":"2023-12-19T16:15:42.196120+0000","last_clean":"2023-12-19T16:15:42.196120+0000","last_became_active":"2023-12-19T16:15:40.551122+0000","last_became_peered":"2023-12-19T16:15:40.551122+0000","last_unstale":"2023-12-19T16:15:42.196120+0000","last_undegraded":"2023-12-19T16:15:42.196120+0000","last_fullsized":"2023-12-19T16:15:42.196120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195380+0000","last_change":"2023-12-19T16:15:40.568549+0000","last_active":"2023-12-19T16:15:42.195380+0000","last_peered":"2023-12-19T16:15:42.195380+0000","last_clean":"2023-12-19T16:15:42.195380+0000","last_became_active":"2023-12-19T16:15:40.567804+0000","last_became_peered":"2023-12-19T16:15:40.567804+0000","last_unstale":"2023-12-19T16:15:42.195380+0000","last_undegraded":"2023-12-19T16:15:42.195380+0000","last_fullsized":"2023-12-19T16:15:42.195380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196432+0000","last_change":"2023-12-19T16:15:40.542905+0000","last_active":"2023-12-19T16:15:42.196432+0000","last_peered":"2023-12-19T16:15:42.196432+0000","last_clean":"2023-12-19T16:15:42.196432+0000","last_became_active":"2023-12-19T16:15:40.542177+0000","last_became_peered":"2023-12-19T16:15:40.542177+0000","last_unstale":"2023-12-19T16:15:42.196432+0000","last_undegraded":"2023-12-19T16:15:42.196432+0000","last_fullsized":"2023-12-19T16:15:42.196432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196704+0000","last_change":"2023-12-19T16:15:40.554175+0000","last_active":"2023-12-19T16:15:42.196704+0000","last_peered":"2023-12-19T16:15:42.196704+0000","last_clean":"2023-12-19T16:15:42.196704+0000","last_became_active":"2023-12-19T16:15:40.553928+0000","last_became_peered":"2023-12-19T16:15:40.553928+0000","last_unstale":"2023-12-19T16:15:42.196704+0000","last_undegraded":"2023-12-19T16:15:42.196704+0000","last_fullsized":"2023-12-19T16:15:42.196704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196135+0000","last_change":"2023-12-19T16:15:40.566546+0000","last_active":"2023-12-19T16:15:42.196135+0000","last_peered":"2023-12-19T16:15:42.196135+0000","last_clean":"2023-12-19T16:15:42.196135+0000","last_became_active":"2023-12-19T16:15:40.566340+0000","last_became_peered":"2023-12-19T16:15:40.566340+0000","last_unstale":"2023-12-19T16:15:42.196135+0000","last_undegraded":"2023-12-19T16:15:42.196135+0000","last_fullsized":"2023-12-19T16:15:42.196135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196623+0000","last_change":"2023-12-19T16:15:40.556322+0000","last_active":"2023-12-19T16:15:42.196623+0000","last_peered":"2023-12-19T16:15:42.196623+0000","last_clean":"2023-12-19T16:15:42.196623+0000","last_became_active":"2023-12-19T16:15:40.555847+0000","last_became_peered":"2023-12-19T16:15:40.555847+0000","last_unstale":"2023-12-19T16:15:42.196623+0000","last_undegraded":"2023-12-19T16:15:42.196623+0000","last_fullsized":"2023-12-19T16:15:42.196623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195837+0000","last_change":"2023-12-19T16:15:40.554846+0000","last_active":"2023-12-19T16:15:42.195837+0000","last_peered":"2023-12-19T16:15:42.195837+0000","last_clean":"2023-12-19T16:15:42.195837+0000","last_became_active":"2023-12-19T16:15:40.554558+0000","last_became_peered":"2023-12-19T16:15:40.554558+0000","last_unstale":"2023-12-19T16:15:42.195837+0000","last_undegraded":"2023-12-19T16:15:42.195837+0000","last_fullsized":"2023-12-19T16:15:42.195837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195005+0000","last_change":"2023-12-19T16:15:40.556072+0000","last_active":"2023-12-19T16:15:42.195005+0000","last_peered":"2023-12-19T16:15:42.195005+0000","last_clean":"2023-12-19T16:15:42.195005+0000","last_became_active":"2023-12-19T16:15:40.555805+0000","last_became_peered":"2023-12-19T16:15:40.555805+0000","last_unstale":"2023-12-19T16:15:42.195005+0000","last_undegraded":"2023-12-19T16:15:42.195005+0000","last_fullsized":"2023-12-19T16:15:42.195005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195192+0000","last_change":"2023-12-19T16:15:40.572960+0000","last_active":"2023-12-19T16:15:42.195192+0000","last_peered":"2023-12-19T16:15:42.195192+0000","last_clean":"2023-12-19T16:15:42.195192+0000","last_became_active":"2023-12-19T16:15:40.572640+0000","last_became_peered":"2023-12-19T16:15:40.572640+0000","last_unstale":"2023-12-19T16:15:42.195192+0000","last_undegraded":"2023-12-19T16:15:42.195192+0000","last_fullsized":"2023-12-19T16:15:42.195192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774645+0000","last_change":"2023-12-19T16:15:40.554309+0000","last_active":"2023-12-19T16:15:41.774645+0000","last_peered":"2023-12-19T16:15:41.774645+0000","last_clean":"2023-12-19T16:15:41.774645+0000","last_became_active":"2023-12-19T16:15:40.552766+0000","last_became_peered":"2023-12-19T16:15:40.552766+0000","last_unstale":"2023-12-19T16:15:41.774645+0000","last_undegraded":"2023-12-19T16:15:41.774645+0000","last_fullsized":"2023-12-19T16:15:41.774645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775218+0000","last_change":"2023-12-19T16:15:40.553698+0000","last_active":"2023-12-19T16:15:41.775218+0000","last_peered":"2023-12-19T16:15:41.775218+0000","last_clean":"2023-12-19T16:15:41.775218+0000","last_became_active":"2023-12-19T16:15:40.553379+0000","last_became_peered":"2023-12-19T16:15:40.553379+0000","last_unstale":"2023-12-19T16:15:41.775218+0000","last_undegraded":"2023-12-19T16:15:41.775218+0000","last_fullsized":"2023-12-19T16:15:41.775218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:16.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544284+0000","last_change":"2023-12-19T16:15:40.556547+0000","last_active":"2023-12-19T16:15:41.544284+0000","last_peered":"2023-12-19T16:15:41.544284+0000","last_clean":"2023-12-19T16:15:41.544284+0000","last_became_active":"2023-12-19T16:15:40.555905+0000","last_became_peered":"2023-12-19T16:15:40.555905+0000","last_unstale":"2023-12-19T16:15:41.544284+0000","last_undegraded":"2023-12-19T16:15:41.544284+0000","last_fullsized":"2023-12-19T16:15:41.544284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775141+0000","last_change":"2023-12-19T16:15:40.560248+0000","last_active":"2023-12-19T16:15:41.775141+0000","last_peered":"2023-12-19T16:15:41.775141+0000","last_clean":"2023-12-19T16:15:41.775141+0000","last_became_active":"2023-12-19T16:15:40.548053+0000","last_became_peered":"2023-12-19T16:15:40.548053+0000","last_unstale":"2023-12-19T16:15:41.775141+0000","last_undegraded":"2023-12-19T16:15:41.775141+0000","last_fullsized":"2023-12-19T16:15:41.775141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:42.987632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196292+0000","last_change":"2023-12-19T16:15:40.556318+0000","last_active":"2023-12-19T16:15:42.196292+0000","last_peered":"2023-12-19T16:15:42.196292+0000","last_clean":"2023-12-19T16:15:42.196292+0000","last_became_active":"2023-12-19T16:15:40.555536+0000","last_became_peered":"2023-12-19T16:15:40.555536+0000","last_unstale":"2023-12-19T16:15:42.196292+0000","last_undegraded":"2023-12-19T16:15:42.196292+0000","last_fullsized":"2023-12-19T16:15:42.196292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563852+0000","last_change":"2023-12-19T16:15:40.552448+0000","last_active":"2023-12-19T16:15:40.563852+0000","last_peered":"2023-12-19T16:15:40.563852+0000","last_clean":"2023-12-19T16:15:40.563852+0000","last_became_active":"2023-12-19T16:15:40.552127+0000","last_became_peered":"2023-12-19T16:15:40.552127+0000","last_unstale":"2023-12-19T16:15:40.563852+0000","last_undegraded":"2023-12-19T16:15:40.563852+0000","last_fullsized":"2023-12-19T16:15:40.563852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:33.400230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195779+0000","last_change":"2023-12-19T16:15:40.549822+0000","last_active":"2023-12-19T16:15:42.195779+0000","last_peered":"2023-12-19T16:15:42.195779+0000","last_clean":"2023-12-19T16:15:42.195779+0000","last_became_active":"2023-12-19T16:15:40.548780+0000","last_became_peered":"2023-12-19T16:15:40.548780+0000","last_unstale":"2023-12-19T16:15:42.195779+0000","last_undegraded":"2023-12-19T16:15:42.195779+0000","last_fullsized":"2023-12-19T16:15:42.195779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:41.432356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195237+0000","last_change":"2023-12-19T16:15:40.569571+0000","last_active":"2023-12-19T16:15:42.195237+0000","last_peered":"2023-12-19T16:15:42.195237+0000","last_clean":"2023-12-19T16:15:42.195237+0000","last_became_active":"2023-12-19T16:15:40.566982+0000","last_became_peered":"2023-12-19T16:15:40.566982+0000","last_unstale":"2023-12-19T16:15:42.195237+0000","last_undegraded":"2023-12-19T16:15:42.195237+0000","last_fullsized":"2023-12-19T16:15:42.195237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.569324+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.568945+0000","last_became_peered":"2023-12-19T16:15:40.568945+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:04.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195417+0000","last_change":"2023-12-19T16:15:40.573746+0000","last_active":"2023-12-19T16:15:42.195417+0000","last_peered":"2023-12-19T16:15:42.195417+0000","last_clean":"2023-12-19T16:15:42.195417+0000","last_became_active":"2023-12-19T16:15:40.573442+0000","last_became_peered":"2023-12-19T16:15:40.573442+0000","last_unstale":"2023-12-19T16:15:42.195417+0000","last_undegraded":"2023-12-19T16:15:42.195417+0000","last_fullsized":"2023-12-19T16:15:42.195417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542041+0000","last_change":"2023-12-19T16:15:40.566429+0000","last_active":"2023-12-19T16:15:41.542041+0000","last_peered":"2023-12-19T16:15:41.542041+0000","last_clean":"2023-12-19T16:15:41.542041+0000","last_became_active":"2023-12-19T16:15:40.565983+0000","last_became_peered":"2023-12-19T16:15:40.565983+0000","last_unstale":"2023-12-19T16:15:41.542041+0000","last_undegraded":"2023-12-19T16:15:41.542041+0000","last_fullsized":"2023-12-19T16:15:41.542041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195908+0000","last_change":"2023-12-19T16:15:40.565357+0000","last_active":"2023-12-19T16:15:42.195908+0000","last_peered":"2023-12-19T16:15:42.195908+0000","last_clean":"2023-12-19T16:15:42.195908+0000","last_became_active":"2023-12-19T16:15:40.565074+0000","last_became_peered":"2023-12-19T16:15:40.565074+0000","last_unstale":"2023-12-19T16:15:42.195908+0000","last_undegraded":"2023-12-19T16:15:42.195908+0000","last_fullsized":"2023-12-19T16:15:42.195908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195836+0000","last_change":"2023-12-19T16:15:40.555405+0000","last_active":"2023-12-19T16:15:42.195836+0000","last_peered":"2023-12-19T16:15:42.195836+0000","last_clean":"2023-12-19T16:15:42.195836+0000","last_became_active":"2023-12-19T16:15:40.555000+0000","last_became_peered":"2023-12-19T16:15:40.555000+0000","last_unstale":"2023-12-19T16:15:42.195836+0000","last_undegraded":"2023-12-19T16:15:42.195836+0000","last_fullsized":"2023-12-19T16:15:42.195836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:06.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195687+0000","last_change":"2023-12-19T16:15:40.573526+0000","last_active":"2023-12-19T16:15:42.195687+0000","last_peered":"2023-12-19T16:15:42.195687+0000","last_clean":"2023-12-19T16:15:42.195687+0000","last_became_active":"2023-12-19T16:15:40.572779+0000","last_became_peered":"2023-12-19T16:15:40.572779+0000","last_unstale":"2023-12-19T16:15:42.195687+0000","last_undegraded":"2023-12-19T16:15:42.195687+0000","last_fullsized":"2023-12-19T16:15:42.195687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:37.149682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774761+0000","last_change":"2023-12-19T16:15:40.574985+0000","last_active":"2023-12-19T16:15:41.774761+0000","last_peered":"2023-12-19T16:15:41.774761+0000","last_clean":"2023-12-19T16:15:41.774761+0000","last_became_active":"2023-12-19T16:15:40.574724+0000","last_became_peered":"2023-12-19T16:15:40.574724+0000","last_unstale":"2023-12-19T16:15:41.774761+0000","last_undegraded":"2023-12-19T16:15:41.774761+0000","last_fullsized":"2023-12-19T16:15:41.774761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:41.216724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543806+0000","last_change":"2023-12-19T16:15:40.550561+0000","last_active":"2023-12-19T16:15:41.543806+0000","last_peered":"2023-12-19T16:15:41.543806+0000","last_clean":"2023-12-19T16:15:41.543806+0000","last_became_active":"2023-12-19T16:15:40.549817+0000","last_became_peered":"2023-12-19T16:15:40.549817+0000","last_unstale":"2023-12-19T16:15:41.543806+0000","last_undegraded":"2023-12-19T16:15:41.543806+0000","last_fullsized":"2023-12-19T16:15:41.543806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541700+0000","last_change":"2023-12-19T16:15:40.559294+0000","last_active":"2023-12-19T16:15:41.541700+0000","last_peered":"2023-12-19T16:15:41.541700+0000","last_clean":"2023-12-19T16:15:41.541700+0000","last_became_active":"2023-12-19T16:15:40.559007+0000","last_became_peered":"2023-12-19T16:15:40.559007+0000","last_unstale":"2023-12-19T16:15:41.541700+0000","last_undegraded":"2023-12-19T16:15:41.541700+0000","last_fullsized":"2023-12-19T16:15:41.541700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195827+0000","last_change":"2023-12-19T16:15:40.574997+0000","last_active":"2023-12-19T16:15:42.195827+0000","last_peered":"2023-12-19T16:15:42.195827+0000","last_clean":"2023-12-19T16:15:42.195827+0000","last_became_active":"2023-12-19T16:15:40.574713+0000","last_became_peered":"2023-12-19T16:15:40.574713+0000","last_unstale":"2023-12-19T16:15:42.195827+0000","last_undegraded":"2023-12-19T16:15:42.195827+0000","last_fullsized":"2023-12-19T16:15:42.195827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195918+0000","last_change":"2023-12-19T16:15:40.161104+0000","last_active":"2023-12-19T16:15:42.195918+0000","last_peered":"2023-12-19T16:15:42.195918+0000","last_clean":"2023-12-19T16:15:42.195918+0000","last_became_active":"2023-12-19T16:15:40.160769+0000","last_became_peered":"2023-12-19T16:15:40.160769+0000","last_unstale":"2023-12-19T16:15:42.195918+0000","last_undegraded":"2023-12-19T16:15:42.195918+0000","last_fullsized":"2023-12-19T16:15:42.195918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.558231+0000","last_change":"2023-12-19T16:15:40.549947+0000","last_active":"2023-12-19T16:15:40.558231+0000","last_peered":"2023-12-19T16:15:40.558231+0000","last_clean":"2023-12-19T16:15:40.558231+0000","last_became_active":"2023-12-19T16:15:40.548174+0000","last_became_peered":"2023-12-19T16:15:40.548174+0000","last_unstale":"2023-12-19T16:15:40.558231+0000","last_undegraded":"2023-12-19T16:15:40.558231+0000","last_fullsized":"2023-12-19T16:15:40.558231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:13.136180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774874+0000","last_change":"2023-12-19T16:15:40.171997+0000","last_active":"2023-12-19T16:15:41.774874+0000","last_peered":"2023-12-19T16:15:41.774874+0000","last_clean":"2023-12-19T16:15:41.774874+0000","last_became_active":"2023-12-19T16:15:40.171706+0000","last_became_peered":"2023-12-19T16:15:40.171706+0000","last_unstale":"2023-12-19T16:15:41.774874+0000","last_undegraded":"2023-12-19T16:15:41.774874+0000","last_fullsized":"2023-12-19T16:15:41.774874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:04.965195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194944+0000","last_change":"2023-12-19T16:15:40.153875+0000","last_active":"2023-12-19T16:15:42.194944+0000","last_peered":"2023-12-19T16:15:42.194944+0000","last_clean":"2023-12-19T16:15:42.194944+0000","last_became_active":"2023-12-19T16:15:40.153373+0000","last_became_peered":"2023-12-19T16:15:40.153373+0000","last_unstale":"2023-12-19T16:15:42.194944+0000","last_undegraded":"2023-12-19T16:15:42.194944+0000","last_fullsized":"2023-12-19T16:15:42.194944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.568164+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.567046+0000","last_became_peered":"2023-12-19T16:15:40.567046+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774782+0000","last_change":"2023-12-19T16:15:40.167038+0000","last_active":"2023-12-19T16:15:41.774782+0000","last_peered":"2023-12-19T16:15:41.774782+0000","last_clean":"2023-12-19T16:15:41.774782+0000","last_became_active":"2023-12-19T16:15:40.166736+0000","last_became_peered":"2023-12-19T16:15:40.166736+0000","last_unstale":"2023-12-19T16:15:41.774782+0000","last_undegraded":"2023-12-19T16:15:41.774782+0000","last_fullsized":"2023-12-19T16:15:41.774782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:33.645727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.552113+0000","last_change":"2023-12-19T16:15:40.544723+0000","last_active":"2023-12-19T16:15:40.552113+0000","last_peered":"2023-12-19T16:15:40.552113+0000","last_clean":"2023-12-19T16:15:40.552113+0000","last_became_active":"2023-12-19T16:15:40.543779+0000","last_became_peered":"2023-12-19T16:15:40.543779+0000","last_unstale":"2023-12-19T16:15:40.552113+0000","last_undegraded":"2023-12-19T16:15:40.552113+0000","last_fullsized":"2023-12-19T16:15:40.552113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:36:03.153648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.151962+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.151615+0000","last_became_peered":"2023-12-19T16:15:40.151615+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542009+0000","last_change":"2023-12-19T16:15:40.565718+0000","last_active":"2023-12-19T16:15:41.542009+0000","last_peered":"2023-12-19T16:15:41.542009+0000","last_clean":"2023-12-19T16:15:41.542009+0000","last_became_active":"2023-12-19T16:15:40.565454+0000","last_became_peered":"2023-12-19T16:15:40.565454+0000","last_unstale":"2023-12-19T16:15:41.542009+0000","last_undegraded":"2023-12-19T16:15:41.542009+0000","last_fullsized":"2023-12-19T16:15:41.542009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.166745+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.166441+0000","last_became_peered":"2023-12-19T16:15:40.166441+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:18.251526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195536+0000","last_change":"2023-12-19T16:15:40.572844+0000","last_active":"2023-12-19T16:15:42.195536+0000","last_peered":"2023-12-19T16:15:42.195536+0000","last_clean":"2023-12-19T16:15:42.195536+0000","last_became_active":"2023-12-19T16:15:40.572602+0000","last_became_peered":"2023-12-19T16:15:40.572602+0000","last_unstale":"2023-12-19T16:15:42.195536+0000","last_undegraded":"2023-12-19T16:15:42.195536+0000","last_fullsized":"2023-12-19T16:15:42.195536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544172+0000","last_change":"2023-12-19T16:15:40.154528+0000","last_active":"2023-12-19T16:15:41.544172+0000","last_peered":"2023-12-19T16:15:41.544172+0000","last_clean":"2023-12-19T16:15:41.544172+0000","last_became_active":"2023-12-19T16:15:40.154244+0000","last_became_peered":"2023-12-19T16:15:40.154244+0000","last_unstale":"2023-12-19T16:15:41.544172+0000","last_undegraded":"2023-12-19T16:15:41.544172+0000","last_fullsized":"2023-12-19T16:15:41.544172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774964+0000","last_change":"2023-12-19T16:15:40.553550+0000","last_active":"2023-12-19T16:15:41.774964+0000","last_peered":"2023-12-19T16:15:41.774964+0000","last_clean":"2023-12-19T16:15:41.774964+0000","last_became_active":"2023-12-19T16:15:40.553276+0000","last_became_peered":"2023-12-19T16:15:40.553276+0000","last_unstale":"2023-12-19T16:15:41.774964+0000","last_undegraded":"2023-12-19T16:15:41.774964+0000","last_fullsized":"2023-12-19T16:15:41.774964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541934+0000","last_change":"2023-12-19T16:15:40.156756+0000","last_active":"2023-12-19T16:15:41.541934+0000","last_peered":"2023-12-19T16:15:41.541934+0000","last_clean":"2023-12-19T16:15:41.541934+0000","last_became_active":"2023-12-19T16:15:40.155859+0000","last_became_peered":"2023-12-19T16:15:40.155859+0000","last_unstale":"2023-12-19T16:15:41.541934+0000","last_undegraded":"2023-12-19T16:15:41.541934+0000","last_fullsized":"2023-12-19T16:15:41.541934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:32.050629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196089+0000","last_change":"2023-12-19T16:15:40.561493+0000","last_active":"2023-12-19T16:15:42.196089+0000","last_peered":"2023-12-19T16:15:42.196089+0000","last_clean":"2023-12-19T16:15:42.196089+0000","last_became_active":"2023-12-19T16:15:40.561194+0000","last_became_peered":"2023-12-19T16:15:40.561194+0000","last_unstale":"2023-12-19T16:15:42.196089+0000","last_undegraded":"2023-12-19T16:15:42.196089+0000","last_fullsized":"2023-12-19T16:15:42.196089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544306+0000","last_change":"2023-12-19T16:15:40.166564+0000","last_active":"2023-12-19T16:15:41.544306+0000","last_peered":"2023-12-19T16:15:41.544306+0000","last_clean":"2023-12-19T16:15:41.544306+0000","last_became_active":"2023-12-19T16:15:40.166232+0000","last_became_peered":"2023-12-19T16:15:40.166232+0000","last_unstale":"2023-12-19T16:15:41.544306+0000","last_undegraded":"2023-12-19T16:15:41.544306+0000","last_fullsized":"2023-12-19T16:15:41.544306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195585+0000","last_change":"2023-12-19T16:15:40.558430+0000","last_active":"2023-12-19T16:15:42.195585+0000","last_peered":"2023-12-19T16:15:42.195585+0000","last_clean":"2023-12-19T16:15:42.195585+0000","last_became_active":"2023-12-19T16:15:40.558153+0000","last_became_peered":"2023-12-19T16:15:40.558153+0000","last_unstale":"2023-12-19T16:15:42.195585+0000","last_undegraded":"2023-12-19T16:15:42.195585+0000","last_fullsized":"2023-12-19T16:15:42.195585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:14:36.494631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774898+0000","last_change":"2023-12-19T16:15:40.163849+0000","last_active":"2023-12-19T16:15:41.774898+0000","last_peered":"2023-12-19T16:15:41.774898+0000","last_clean":"2023-12-19T16:15:41.774898+0000","last_became_active":"2023-12-19T16:15:40.163576+0000","last_became_peered":"2023-12-19T16:15:40.163576+0000","last_unstale":"2023-12-19T16:15:41.774898+0000","last_undegraded":"2023-12-19T16:15:41.774898+0000","last_fullsized":"2023-12-19T16:15:41.774898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774801+0000","last_change":"2023-12-19T16:15:40.559502+0000","last_active":"2023-12-19T16:15:41.774801+0000","last_peered":"2023-12-19T16:15:41.774801+0000","last_clean":"2023-12-19T16:15:41.774801+0000","last_became_active":"2023-12-19T16:15:40.559273+0000","last_became_peered":"2023-12-19T16:15:40.559273+0000","last_unstale":"2023-12-19T16:15:41.774801+0000","last_undegraded":"2023-12-19T16:15:41.774801+0000","last_fullsized":"2023-12-19T16:15:41.774801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:53.305645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196023+0000","last_change":"2023-12-19T16:15:40.166877+0000","last_active":"2023-12-19T16:15:42.196023+0000","last_peered":"2023-12-19T16:15:42.196023+0000","last_clean":"2023-12-19T16:15:42.196023+0000","last_became_active":"2023-12-19T16:15:40.166506+0000","last_became_peered":"2023-12-19T16:15:40.166506+0000","last_unstale":"2023-12-19T16:15:42.196023+0000","last_undegraded":"2023-12-19T16:15:42.196023+0000","last_fullsized":"2023-12-19T16:15:42.196023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195757+0000","last_change":"2023-12-19T16:15:40.569727+0000","last_active":"2023-12-19T16:15:42.195757+0000","last_peered":"2023-12-19T16:15:42.195757+0000","last_clean":"2023-12-19T16:15:42.195757+0000","last_became_active":"2023-12-19T16:15:40.569430+0000","last_became_peered":"2023-12-19T16:15:40.569430+0000","last_unstale":"2023-12-19T16:15:42.195757+0000","last_undegraded":"2023-12-19T16:15:42.195757+0000","last_fullsized":"2023-12-19T16:15:42.195757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.570619+0000","last_change":"2023-12-19T16:15:40.150626+0000","last_active":"2023-12-19T16:15:40.570619+0000","last_peered":"2023-12-19T16:15:40.570619+0000","last_clean":"2023-12-19T16:15:40.570619+0000","last_became_active":"2023-12-19T16:15:40.150345+0000","last_became_peered":"2023-12-19T16:15:40.150345+0000","last_unstale":"2023-12-19T16:15:40.570619+0000","last_undegraded":"2023-12-19T16:15:40.570619+0000","last_fullsized":"2023-12-19T16:15:40.570619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:49.556556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.550692+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.550433+0000","last_became_peered":"2023-12-19T16:15:40.550433+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:45:06.826275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196683+0000","last_change":"2023-12-19T16:15:40.167815+0000","last_active":"2023-12-19T16:15:42.196683+0000","last_peered":"2023-12-19T16:15:42.196683+0000","last_clean":"2023-12-19T16:15:42.196683+0000","last_became_active":"2023-12-19T16:15:40.167149+0000","last_became_peered":"2023-12-19T16:15:40.167149+0000","last_unstale":"2023-12-19T16:15:42.196683+0000","last_undegraded":"2023-12-19T16:15:42.196683+0000","last_fullsized":"2023-12-19T16:15:42.196683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542057+0000","last_change":"2023-12-19T16:15:40.560268+0000","last_active":"2023-12-19T16:15:41.542057+0000","last_peered":"2023-12-19T16:15:41.542057+0000","last_clean":"2023-12-19T16:15:41.542057+0000","last_became_active":"2023-12-19T16:15:40.559853+0000","last_became_peered":"2023-12-19T16:15:40.559853+0000","last_unstale":"2023-12-19T16:15:41.542057+0000","last_undegraded":"2023-12-19T16:15:41.542057+0000","last_fullsized":"2023-12-19T16:15:41.542057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.567796+0000","last_change":"2023-12-19T16:15:40.160008+0000","last_active":"2023-12-19T16:15:40.567796+0000","last_peered":"2023-12-19T16:15:40.567796+0000","last_clean":"2023-12-19T16:15:40.567796+0000","last_became_active":"2023-12-19T16:15:40.159521+0000","last_became_peered":"2023-12-19T16:15:40.159521+0000","last_unstale":"2023-12-19T16:15:40.567796+0000","last_undegraded":"2023-12-19T16:15:40.567796+0000","last_fullsized":"2023-12-19T16:15:40.567796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:50.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196655+0000","last_change":"2023-12-19T16:15:40.555956+0000","last_active":"2023-12-19T16:15:42.196655+0000","last_peered":"2023-12-19T16:15:42.196655+0000","last_clean":"2023-12-19T16:15:42.196655+0000","last_became_active":"2023-12-19T16:15:40.555515+0000","last_became_peered":"2023-12-19T16:15:40.555515+0000","last_unstale":"2023-12-19T16:15:42.196655+0000","last_undegraded":"2023-12-19T16:15:42.196655+0000","last_fullsized":"2023-12-19T16:15:42.196655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195286+0000","last_change":"2023-12-19T16:15:40.161341+0000","last_active":"2023-12-19T16:15:42.195286+0000","last_peered":"2023-12-19T16:15:42.195286+0000","last_clean":"2023-12-19T16:15:42.195286+0000","last_became_active":"2023-12-19T16:15:40.160718+0000","last_became_peered":"2023-12-19T16:15:40.160718+0000","last_unstale":"2023-12-19T16:15:42.195286+0000","last_undegraded":"2023-12-19T16:15:42.195286+0000","last_fullsized":"2023-12-19T16:15:42.195286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196516+0000","last_change":"2023-12-19T16:15:40.561843+0000","last_active":"2023-12-19T16:15:42.196516+0000","last_peered":"2023-12-19T16:15:42.196516+0000","last_clean":"2023-12-19T16:15:42.196516+0000","last_became_active":"2023-12-19T16:15:40.561455+0000","last_became_peered":"2023-12-19T16:15:40.561455+0000","last_unstale":"2023-12-19T16:15:42.196516+0000","last_undegraded":"2023-12-19T16:15:42.196516+0000","last_fullsized":"2023-12-19T16:15:42.196516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195860+0000","last_change":"2023-12-19T16:15:40.170958+0000","last_active":"2023-12-19T16:15:42.195860+0000","last_peered":"2023-12-19T16:15:42.195860+0000","last_clean":"2023-12-19T16:15:42.195860+0000","last_became_active":"2023-12-19T16:15:40.170735+0000","last_became_peered":"2023-12-19T16:15:40.170735+0000","last_unstale":"2023-12-19T16:15:42.195860+0000","last_undegraded":"2023-12-19T16:15:42.195860+0000","last_fullsized":"2023-12-19T16:15:42.195860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775038+0000","last_change":"2023-12-19T16:15:40.557532+0000","last_active":"2023-12-19T16:15:41.775038+0000","last_peered":"2023-12-19T16:15:41.775038+0000","last_clean":"2023-12-19T16:15:41.775038+0000","last_became_active":"2023-12-19T16:15:40.549277+0000","last_became_peered":"2023-12-19T16:15:40.549277+0000","last_unstale":"2023-12-19T16:15:41.775038+0000","last_undegraded":"2023-12-19T16:15:41.775038+0000","last_fullsized":"2023-12-19T16:15:41.775038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:42.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.533799+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:15:40.533799+0000","last_peered":"2023-12-19T16:15:40.533799+0000","last_clean":"2023-12-19T16:15:40.533799+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:15:40.533799+0000","last_undegraded":"2023-12-19T16:15:40.533799+0000","last_fullsized":"2023-12-19T16:15:40.533799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774904+0000","last_change":"2023-12-19T16:15:40.163049+0000","last_active":"2023-12-19T16:15:41.774904+0000","last_peered":"2023-12-19T16:15:41.774904+0000","last_clean":"2023-12-19T16:15:41.774904+0000","last_became_active":"2023-12-19T16:15:40.162399+0000","last_became_peered":"2023-12-19T16:15:40.162399+0000","last_unstale":"2023-12-19T16:15:41.774904+0000","last_undegraded":"2023-12-19T16:15:41.774904+0000","last_fullsized":"2023-12-19T16:15:41.774904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:42.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563323+0000","last_change":"2023-12-19T16:15:40.552618+0000","last_active":"2023-12-19T16:15:40.563323+0000","last_peered":"2023-12-19T16:15:40.563323+0000","last_clean":"2023-12-19T16:15:40.563323+0000","last_became_active":"2023-12-19T16:15:40.552192+0000","last_became_peered":"2023-12-19T16:15:40.552192+0000","last_unstale":"2023-12-19T16:15:40.563323+0000","last_undegraded":"2023-12-19T16:15:40.563323+0000","last_fullsized":"2023-12-19T16:15:40.563323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:28:34.037513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774770+0000","last_change":"2023-12-19T16:15:40.162386+0000","last_active":"2023-12-19T16:15:41.774770+0000","last_peered":"2023-12-19T16:15:41.774770+0000","last_clean":"2023-12-19T16:15:41.774770+0000","last_became_active":"2023-12-19T16:15:40.162130+0000","last_became_peered":"2023-12-19T16:15:40.162130+0000","last_unstale":"2023-12-19T16:15:41.774770+0000","last_undegraded":"2023-12-19T16:15:41.774770+0000","last_fullsized":"2023-12-19T16:15:41.774770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:39.071401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194943+0000","last_change":"2023-12-19T16:15:40.554293+0000","last_active":"2023-12-19T16:15:42.194943+0000","last_peered":"2023-12-19T16:15:42.194943+0000","last_clean":"2023-12-19T16:15:42.194943+0000","last_became_active":"2023-12-19T16:15:40.551755+0000","last_became_peered":"2023-12-19T16:15:40.551755+0000","last_unstale":"2023-12-19T16:15:42.194943+0000","last_undegraded":"2023-12-19T16:15:42.194943+0000","last_fullsized":"2023-12-19T16:15:42.194943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543821+0000","last_change":"2023-12-19T16:15:40.158318+0000","last_active":"2023-12-19T16:15:41.543821+0000","last_peered":"2023-12-19T16:15:41.543821+0000","last_clean":"2023-12-19T16:15:41.543821+0000","last_became_active":"2023-12-19T16:15:40.157613+0000","last_became_peered":"2023-12-19T16:15:40.157613+0000","last_unstale":"2023-12-19T16:15:41.543821+0000","last_undegraded":"2023-12-19T16:15:41.543821+0000","last_fullsized":"2023-12-19T16:15:41.543821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195229+0000","last_change":"2023-12-19T16:15:40.568353+0000","last_active":"2023-12-19T16:15:42.195229+0000","last_peered":"2023-12-19T16:15:42.195229+0000","last_clean":"2023-12-19T16:15:42.195229+0000","last_became_active":"2023-12-19T16:15:40.567479+0000","last_became_peered":"2023-12-19T16:15:40.567479+0000","last_unstale":"2023-12-19T16:15:42.195229+0000","last_undegraded":"2023-12-19T16:15:42.195229+0000","last_fullsized":"2023-12-19T16:15:42.195229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:33.311177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774968+0000","last_change":"2023-12-19T16:15:40.164928+0000","last_active":"2023-12-19T16:15:41.774968+0000","last_peered":"2023-12-19T16:15:41.774968+0000","last_clean":"2023-12-19T16:15:41.774968+0000","last_became_active":"2023-12-19T16:15:40.164705+0000","last_became_peered":"2023-12-19T16:15:40.164705+0000","last_unstale":"2023-12-19T16:15:41.774968+0000","last_undegraded":"2023-12-19T16:15:41.774968+0000","last_fullsized":"2023-12-19T16:15:41.774968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:39.741388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196456+0000","last_change":"2023-12-19T16:15:40.553255+0000","last_active":"2023-12-19T16:15:42.196456+0000","last_peered":"2023-12-19T16:15:42.196456+0000","last_clean":"2023-12-19T16:15:42.196456+0000","last_became_active":"2023-12-19T16:15:40.553001+0000","last_became_peered":"2023-12-19T16:15:40.553001+0000","last_unstale":"2023-12-19T16:15:42.196456+0000","last_undegraded":"2023-12-19T16:15:42.196456+0000","last_fullsized":"2023-12-19T16:15:42.196456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195083+0000","last_change":"2023-12-19T16:15:40.162669+0000","last_active":"2023-12-19T16:15:42.195083+0000","last_peered":"2023-12-19T16:15:42.195083+0000","last_clean":"2023-12-19T16:15:42.195083+0000","last_became_active":"2023-12-19T16:15:40.162323+0000","last_became_peered":"2023-12-19T16:15:40.162323+0000","last_unstale":"2023-12-19T16:15:42.195083+0000","last_undegraded":"2023-12-19T16:15:42.195083+0000","last_fullsized":"2023-12-19T16:15:42.195083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541911+0000","last_change":"2023-12-19T16:15:40.560616+0000","last_active":"2023-12-19T16:15:41.541911+0000","last_peered":"2023-12-19T16:15:41.541911+0000","last_clean":"2023-12-19T16:15:41.541911+0000","last_became_active":"2023-12-19T16:15:40.560305+0000","last_became_peered":"2023-12-19T16:15:40.560305+0000","last_unstale":"2023-12-19T16:15:41.541911+0000","last_undegraded":"2023-12-19T16:15:41.541911+0000","last_fullsized":"2023-12-19T16:15:41.541911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775144+0000","last_change":"2023-12-19T16:15:40.159112+0000","last_active":"2023-12-19T16:15:41.775144+0000","last_peered":"2023-12-19T16:15:41.775144+0000","last_clean":"2023-12-19T16:15:41.775144+0000","last_became_active":"2023-12-19T16:15:40.158745+0000","last_became_peered":"2023-12-19T16:15:40.158745+0000","last_unstale":"2023-12-19T16:15:41.775144+0000","last_undegraded":"2023-12-19T16:15:41.775144+0000","last_fullsized":"2023-12-19T16:15:41.775144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195766+0000","last_change":"2023-12-19T16:15:40.574613+0000","last_active":"2023-12-19T16:15:42.195766+0000","last_peered":"2023-12-19T16:15:42.195766+0000","last_clean":"2023-12-19T16:15:42.195766+0000","last_became_active":"2023-12-19T16:15:40.574349+0000","last_became_peered":"2023-12-19T16:15:40.574349+0000","last_unstale":"2023-12-19T16:15:42.195766+0000","last_undegraded":"2023-12-19T16:15:42.195766+0000","last_fullsized":"2023-12-19T16:15:42.195766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:48:11.094121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.536581+0000","last_change":"2023-12-19T16:15:40.170093+0000","last_active":"2023-12-19T16:15:40.536581+0000","last_peered":"2023-12-19T16:15:40.536581+0000","last_clean":"2023-12-19T16:15:40.536581+0000","last_became_active":"2023-12-19T16:15:40.169869+0000","last_became_peered":"2023-12-19T16:15:40.169869+0000","last_unstale":"2023-12-19T16:15:40.536581+0000","last_undegraded":"2023-12-19T16:15:40.536581+0000","last_fullsized":"2023-12-19T16:15:40.536581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:27.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.563302+0000","last_change":"2023-12-19T16:15:40.555076+0000","last_active":"2023-12-19T16:15:40.563302+0000","last_peered":"2023-12-19T16:15:40.563302+0000","last_clean":"2023-12-19T16:15:40.563302+0000","last_became_active":"2023-12-19T16:15:40.553947+0000","last_became_peered":"2023-12-19T16:15:40.553947+0000","last_unstale":"2023-12-19T16:15:40.563302+0000","last_undegraded":"2023-12-19T16:15:40.563302+0000","last_fullsized":"2023-12-19T16:15:40.563302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:57.529437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775238+0000","last_change":"2023-12-19T16:15:40.169787+0000","last_active":"2023-12-19T16:15:41.775238+0000","last_peered":"2023-12-19T16:15:41.775238+0000","last_clean":"2023-12-19T16:15:41.775238+0000","last_became_active":"2023-12-19T16:15:40.169383+0000","last_became_peered":"2023-12-19T16:15:40.169383+0000","last_unstale":"2023-12-19T16:15:41.775238+0000","last_undegraded":"2023-12-19T16:15:41.775238+0000","last_fullsized":"2023-12-19T16:15:41.775238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:51.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.558196+0000","last_change":"2023-12-19T16:15:40.544924+0000","last_active":"2023-12-19T16:15:40.558196+0000","last_peered":"2023-12-19T16:15:40.558196+0000","last_clean":"2023-12-19T16:15:40.558196+0000","last_became_active":"2023-12-19T16:15:40.544590+0000","last_became_peered":"2023-12-19T16:15:40.544590+0000","last_unstale":"2023-12-19T16:15:40.558196+0000","last_undegraded":"2023-12-19T16:15:40.558196+0000","last_fullsized":"2023-12-19T16:15:40.558196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:10.724734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196014+0000","last_change":"2023-12-19T16:15:40.148785+0000","last_active":"2023-12-19T16:15:42.196014+0000","last_peered":"2023-12-19T16:15:42.196014+0000","last_clean":"2023-12-19T16:15:42.196014+0000","last_became_active":"2023-12-19T16:15:40.147904+0000","last_became_peered":"2023-12-19T16:15:40.147904+0000","last_unstale":"2023-12-19T16:15:42.196014+0000","last_undegraded":"2023-12-19T16:15:42.196014+0000","last_fullsized":"2023-12-19T16:15:42.196014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774747+0000","last_change":"2023-12-19T16:15:40.546029+0000","last_active":"2023-12-19T16:15:41.774747+0000","last_peered":"2023-12-19T16:15:41.774747+0000","last_clean":"2023-12-19T16:15:41.774747+0000","last_became_active":"2023-12-19T16:15:40.545475+0000","last_became_peered":"2023-12-19T16:15:40.545475+0000","last_unstale":"2023-12-19T16:15:41.774747+0000","last_undegraded":"2023-12-19T16:15:41.774747+0000","last_fullsized":"2023-12-19T16:15:41.774747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:39.910949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.535694+0000","last_change":"2023-12-19T16:15:40.148744+0000","last_active":"2023-12-19T16:15:40.535694+0000","last_peered":"2023-12-19T16:15:40.535694+0000","last_clean":"2023-12-19T16:15:40.535694+0000","last_became_active":"2023-12-19T16:15:40.148279+0000","last_became_peered":"2023-12-19T16:15:40.148279+0000","last_unstale":"2023-12-19T16:15:40.535694+0000","last_undegraded":"2023-12-19T16:15:40.535694+0000","last_fullsized":"2023-12-19T16:15:40.535694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:56:19.336029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.552953+0000","last_change":"2023-12-19T16:15:40.548298+0000","last_active":"2023-12-19T16:15:40.552953+0000","last_peered":"2023-12-19T16:15:40.552953+0000","last_clean":"2023-12-19T16:15:40.552953+0000","last_became_active":"2023-12-19T16:15:40.545774+0000","last_became_peered":"2023-12-19T16:15:40.545774+0000","last_unstale":"2023-12-19T16:15:40.552953+0000","last_undegraded":"2023-12-19T16:15:40.552953+0000","last_fullsized":"2023-12-19T16:15:40.552953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:45.938202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195660+0000","last_change":"2023-12-19T16:15:40.158974+0000","last_active":"2023-12-19T16:15:42.195660+0000","last_peered":"2023-12-19T16:15:42.195660+0000","last_clean":"2023-12-19T16:15:42.195660+0000","last_became_active":"2023-12-19T16:15:40.158129+0000","last_became_peered":"2023-12-19T16:15:40.158129+0000","last_unstale":"2023-12-19T16:15:42.195660+0000","last_undegraded":"2023-12-19T16:15:42.195660+0000","last_fullsized":"2023-12-19T16:15:42.195660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544242+0000","last_change":"2023-12-19T16:15:40.554888+0000","last_active":"2023-12-19T16:15:41.544242+0000","last_peered":"2023-12-19T16:15:41.544242+0000","last_clean":"2023-12-19T16:15:41.544242+0000","last_became_active":"2023-12-19T16:15:40.554560+0000","last_became_peered":"2023-12-19T16:15:40.554560+0000","last_unstale":"2023-12-19T16:15:41.544242+0000","last_undegraded":"2023-12-19T16:15:41.544242+0000","last_fullsized":"2023-12-19T16:15:41.544242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774905+0000","last_change":"2023-12-19T16:15:40.163081+0000","last_active":"2023-12-19T16:15:41.774905+0000","last_peered":"2023-12-19T16:15:41.774905+0000","last_clean":"2023-12-19T16:15:41.774905+0000","last_became_active":"2023-12-19T16:15:40.162817+0000","last_became_peered":"2023-12-19T16:15:40.162817+0000","last_unstale":"2023-12-19T16:15:41.774905+0000","last_undegraded":"2023-12-19T16:15:41.774905+0000","last_fullsized":"2023-12-19T16:15:41.774905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:46.268839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774815+0000","last_change":"2023-12-19T16:15:40.542899+0000","last_active":"2023-12-19T16:15:41.774815+0000","last_peered":"2023-12-19T16:15:41.774815+0000","last_clean":"2023-12-19T16:15:41.774815+0000","last_became_active":"2023-12-19T16:15:40.542005+0000","last_became_peered":"2023-12-19T16:15:40.542005+0000","last_unstale":"2023-12-19T16:15:41.774815+0000","last_undegraded":"2023-12-19T16:15:41.774815+0000","last_fullsized":"2023-12-19T16:15:41.774815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:22.119577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775029+0000","last_change":"2023-12-19T16:15:40.560771+0000","last_active":"2023-12-19T16:15:41.775029+0000","last_peered":"2023-12-19T16:15:41.775029+0000","last_clean":"2023-12-19T16:15:41.775029+0000","last_became_active":"2023-12-19T16:15:40.560543+0000","last_became_peered":"2023-12-19T16:15:40.560543+0000","last_unstale":"2023-12-19T16:15:41.775029+0000","last_undegraded":"2023-12-19T16:15:41.775029+0000","last_fullsized":"2023-12-19T16:15:41.775029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:39.453323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196607+0000","last_change":"2023-12-19T16:15:40.169041+0000","last_active":"2023-12-19T16:15:42.196607+0000","last_peered":"2023-12-19T16:15:42.196607+0000","last_clean":"2023-12-19T16:15:42.196607+0000","last_became_active":"2023-12-19T16:15:40.168466+0000","last_became_peered":"2023-12-19T16:15:40.168466+0000","last_unstale":"2023-12-19T16:15:42.196607+0000","last_undegraded":"2023-12-19T16:15:42.196607+0000","last_fullsized":"2023-12-19T16:15:42.196607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196263+0000","last_change":"2023-12-19T16:15:40.554186+0000","last_active":"2023-12-19T16:15:42.196263+0000","last_peered":"2023-12-19T16:15:42.196263+0000","last_clean":"2023-12-19T16:15:42.196263+0000","last_became_active":"2023-12-19T16:15:40.553941+0000","last_became_peered":"2023-12-19T16:15:40.553941+0000","last_unstale":"2023-12-19T16:15:42.196263+0000","last_undegraded":"2023-12-19T16:15:42.196263+0000","last_fullsized":"2023-12-19T16:15:42.196263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196177+0000","last_change":"2023-12-19T16:15:40.169576+0000","last_active":"2023-12-19T16:15:42.196177+0000","last_peered":"2023-12-19T16:15:42.196177+0000","last_clean":"2023-12-19T16:15:42.196177+0000","last_became_active":"2023-12-19T16:15:40.169336+0000","last_became_peered":"2023-12-19T16:15:40.169336+0000","last_unstale":"2023-12-19T16:15:42.196177+0000","last_undegraded":"2023-12-19T16:15:42.196177+0000","last_fullsized":"2023-12-19T16:15:42.196177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.576580+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.576231+0000","last_became_peered":"2023-12-19T16:15:40.576231+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195533+0000","last_change":"2023-12-19T16:15:40.162671+0000","last_active":"2023-12-19T16:15:42.195533+0000","last_peered":"2023-12-19T16:15:42.195533+0000","last_clean":"2023-12-19T16:15:42.195533+0000","last_became_active":"2023-12-19T16:15:40.162239+0000","last_became_peered":"2023-12-19T16:15:40.162239+0000","last_unstale":"2023-12-19T16:15:42.195533+0000","last_undegraded":"2023-12-19T16:15:42.195533+0000","last_fullsized":"2023-12-19T16:15:42.195533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195348+0000","last_change":"2023-12-19T16:15:40.573940+0000","last_active":"2023-12-19T16:15:42.195348+0000","last_peered":"2023-12-19T16:15:42.195348+0000","last_clean":"2023-12-19T16:15:42.195348+0000","last_became_active":"2023-12-19T16:15:40.573117+0000","last_became_peered":"2023-12-19T16:15:40.573117+0000","last_unstale":"2023-12-19T16:15:42.195348+0000","last_undegraded":"2023-12-19T16:15:42.195348+0000","last_fullsized":"2023-12-19T16:15:42.195348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.565046+0000","last_change":"2023-12-19T16:15:40.164711+0000","last_active":"2023-12-19T16:15:40.565046+0000","last_peered":"2023-12-19T16:15:40.565046+0000","last_clean":"2023-12-19T16:15:40.565046+0000","last_became_active":"2023-12-19T16:15:40.164283+0000","last_became_peered":"2023-12-19T16:15:40.164283+0000","last_unstale":"2023-12-19T16:15:40.565046+0000","last_undegraded":"2023-12-19T16:15:40.565046+0000","last_fullsized":"2023-12-19T16:15:40.565046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:49.298209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":81355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":0,"up_from":16,"seq":68719476741,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":73491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":819200,"data_stored":663951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":75727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:15:44.983 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T16:15:44.983 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T16:15:44.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T16:15:44.984 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T16:15:45.112 INFO:tasks.ceph.mds.b.smithi162.stderr:2023-12-19T16:15:45.108+0000 7f3741fd1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:15:45.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 Processor -- start 2023-12-19T16:15:45.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 -- start start 2023-12-19T16:15:45.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1418159830 0x7f141815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14180b40b0 0x7f14180cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f141815ad00 con 0x7f14180cda70 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f141815e110 con 0x7f14180b40b0 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141f6e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180cdf00 con 0x7f1418159830 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14180b40b0 0x7f14180cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14180b40b0 0x7f14180cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38802/0 (socket says 172.21.15.73:38802) 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 -- 172.21.15.73:0/127686939 learned_addr learned my addr 172.21.15.73:0/127686939 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141d481640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1418159830 0x7f141815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 -- 172.21.15.73:0/127686939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1418159830 msgr2=0x7f141815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1418159830 0x7f141815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 -- 172.21.15.73:0/127686939 >> v1:172.21.15.162:6789/0 conn(0x7f14180cda70 legacy=0x7f14180cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.157+0000 7f141cc80640 1 -- 172.21.15.73:0/127686939 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180ce2d0 con 0x7f14180b40b0 2023-12-19T16:15:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141cc80640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14180cd530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1408009870 tx=0x7f140801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549c772e06385aaf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f140ffff640 1 -- 172.21.15.73:0/127686939 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080ab680 con 0x7f14180b40b0 2023-12-19T16:15:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f140ffff640 1 -- 172.21.15.73:0/127686939 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14080ab7e0 con 0x7f14180b40b0 2023-12-19T16:15:45.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f140ffff640 1 -- 172.21.15.73:0/127686939 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14080abb70 con 0x7f14180b40b0 2023-12-19T16:15:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 -- 172.21.15.73:0/127686939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 msgr2=0x7f14180cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14180cd530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1408009870 tx=0x7f140801c480 comp rx=0 tx=0).stop 2023-12-19T16:15:45.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 -- 172.21.15.73:0/127686939 shutdown_connections 2023-12-19T16:15:45.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14180cd530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 --2- 172.21.15.73:0/127686939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1418159830 0x7f141815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 -- 172.21.15.73:0/127686939 >> 172.21.15.73:0/127686939 conn(0x7f14180b0270 msgr2=0x7f14180b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 -- 172.21.15.73:0/127686939 shutdown_connections 2023-12-19T16:15:45.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.161+0000 7f141f6e5640 1 -- 172.21.15.73:0/127686939 wait complete. 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 Processor -- start 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- start start 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 0x7f1418158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 0x7f1418158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418156b40 con 0x7f14180b40b0 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418152280 con 0x7f1418159830 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1418151cf0 con 0x7f14180cda70 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38816/0 (socket says 172.21.15.73:38816) 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 -- 172.21.15.73:0/846012566 learned_addr learned my addr 172.21.15.73:0/846012566 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141dc82640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 0x7f1418158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141cc80640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 0x7f1418158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 -- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 msgr2=0x7f1418158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 0x7f1418158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 -- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 msgr2=0x7f1418158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 0x7f1418158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 -- 172.21.15.73:0/846012566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080094d0 con 0x7f14180b40b0 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141cc80640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 0x7f1418158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141dc82640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 0x7f1418158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141d481640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f141400d830 tx=0x7f141400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400b6c0 con 0x7f14180b40b0 2023-12-19T16:15:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141400b820 con 0x7f14180b40b0 2023-12-19T16:15:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141400bb90 con 0x7f14180b40b0 2023-12-19T16:15:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1418155ec0 con 0x7f14180b40b0 2023-12-19T16:15:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1418156480 con 0x7f14180b40b0 2023-12-19T16:15:45.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.165+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14180adb00 con 0x7f14180b40b0 2023-12-19T16:15:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.169+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f141401e460 con 0x7f14180b40b0 2023-12-19T16:15:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.169+0000 7f140dffb640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.169+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1414083880 con 0x7f14180b40b0 2023-12-19T16:15:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.169+0000 7f141cc80640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.169+0000 7f141cc80640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 0x7f13fc067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14080af000 tx=0x7f14080a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.173+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14140512d0 con 0x7f14180b40b0 2023-12-19T16:15:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.361+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f141815da20 con 0x7f14180b40b0 2023-12-19T16:15:45.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.361+0000 7f140dffb640 1 -- 172.21.15.73:0/846012566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163362 (secure 0 0 0) 0x7f14140548f0 con 0x7f14180b40b0 2023-12-19T16:15:45.367 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 msgr2=0x7f13fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 0x7f13fc067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14080af000 tx=0x7f14080a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 msgr2=0x7f14181517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f141400d830 tx=0x7f141400dcf0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 shutdown_connections 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1418159830 0x7f1418158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180cda70 0x7f1418158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f13fc065a60 0x7f13fc067f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 --2- 172.21.15.73:0/846012566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180b40b0 0x7f14181517b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 >> 172.21.15.73:0/846012566 conn(0x7f14180b0270 msgr2=0x7f141806d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 shutdown_connections 2023-12-19T16:15:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.365+0000 7f141f6e5640 1 -- 172.21.15.73:0/846012566 wait complete. 2023-12-19T16:15:45.387 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"active_gid":4109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":38117},{"type":"v1","addr":"172.21.15.73:6833","nonce":38117}]},"active_addr":"172.21.15.73:6833/38117","active_change":"2023-12-19T16:15:20.425523+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1141594476}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":689900854}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3049288206}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2473573101}]}]} 2023-12-19T16:15:45.390 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T16:15:45.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T16:15:45.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 Processor -- start 2023-12-19T16:15:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 -- start start 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1dc159830 0x7fa1dc15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 0x7fa1dc0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc15ad00 con 0x7fa1dc0cda70 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc15e110 con 0x7fa1dc159830 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1e24d1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc0cdf00 con 0x7fa1dc0b40b0 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1dc159830 0x7fa1dc15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1dc159830 0x7fa1dc15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38820/0 (socket says 172.21.15.73:38820) 2023-12-19T16:15:45.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 -- 172.21.15.73:0/4193356751 learned_addr learned my addr 172.21.15.73:0/4193356751 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1db7fe640 1 --2- 172.21.15.73:0/4193356751 >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 0x7fa1dc0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 -- 172.21.15.73:0/4193356751 >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 msgr2=0x7fa1dc0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/4193356751 >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 0x7fa1dc0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 -- 172.21.15.73:0/4193356751 >> v1:172.21.15.162:6789/0 conn(0x7fa1dc0cda70 legacy=0x7fa1dc0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1dbfff640 1 -- 172.21.15.73:0/4193356751 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0ce2d0 con 0x7fa1dc159830 2023-12-19T16:15:45.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.525+0000 7fa1db7fe640 1 --2- 172.21.15.73:0/4193356751 >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 0x7fa1dc0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/4193356751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc159830 0x7fa1dc15a7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0b4520 tx=0x7fa1cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb022f552cde42d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1daffd640 1 -- 172.21.15.73:0/4193356751 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0ab600 con 0x7fa1dc159830 2023-12-19T16:15:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1daffd640 1 -- 172.21.15.73:0/4193356751 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0ab760 con 0x7fa1dc159830 2023-12-19T16:15:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1daffd640 1 -- 172.21.15.73:0/4193356751 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0abaf0 con 0x7fa1dc159830 2023-12-19T16:15:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 -- 172.21.15.73:0/4193356751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc159830 msgr2=0x7fa1dc15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/4193356751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc159830 0x7fa1dc15a7c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0b4520 tx=0x7fa1cc01c400 comp rx=0 tx=0).stop 2023-12-19T16:15:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 -- 172.21.15.73:0/4193356751 shutdown_connections 2023-12-19T16:15:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/4193356751 >> v2:172.21.15.162:3300/0 conn(0x7fa1dc0b40b0 0x7fa1dc0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/4193356751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc159830 0x7fa1dc15a7c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 -- 172.21.15.73:0/4193356751 >> 172.21.15.73:0/4193356751 conn(0x7fa1dc0b0270 msgr2=0x7fa1dc0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 -- 172.21.15.73:0/4193356751 shutdown_connections 2023-12-19T16:15:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.529+0000 7fa1e24d1640 1 -- 172.21.15.73:0/4193356751 wait complete. 2023-12-19T16:15:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 Processor -- start 2023-12-19T16:15:45.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- start start 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 0x7fa1dc154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 0x7fa1dc0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc165fd0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0b31d0 con 0x7fa1dc0b40b0 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1591d0 con 0x7fa1dc159830 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38822/0 (socket says 172.21.15.73:38822) 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 -- 172.21.15.73:0/1832877207 learned_addr learned my addr 172.21.15.73:0/1832877207 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e0a6e640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 0x7fa1dc0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 0x7fa1dc154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 -- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 msgr2=0x7fa1dc0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 0x7fa1dc0b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 -- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 msgr2=0x7fa1dc154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 0x7fa1dc154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 -- 172.21.15.73:0/1832877207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0094d0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 0x7fa1dc154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e0a6e640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 0x7fa1dc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1db7fe640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c7c0 tx=0x7fa1d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007a30 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0007b90 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc165910 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000ce70 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.533+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc1585c0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc0cf4b0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa1d00113f0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1d8ff9640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 0x7fa1c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1d0083630 con 0x7fa1dc0cda70 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 0x7fa1c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.537+0000 7fa1dbfff640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 0x7fa1c8067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0af000 tx=0x7fa1cc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.541+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa1d0050fe0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.693+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1dc0cbfc0 con 0x7fa1dc0cda70 2023-12-19T16:15:45.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.693+0000 7fa1d8ff9640 1 -- 172.21.15.73:0/1832877207 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fa1d0054600 con 0x7fa1dc0cda70 2023-12-19T16:15:45.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:45.698 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:45.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 msgr2=0x7fa1c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 0x7fa1c8067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc0af000 tx=0x7fa1cc008040 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 msgr2=0x7fa1dc0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000c7c0 tx=0x7fa1d000cc80 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 shutdown_connections 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1dc159830 0x7fa1dc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa1c8065a60 0x7fa1c8067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1dc0cda70 0x7fa1dc0b2160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 --2- 172.21.15.73:0/1832877207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1dc0b40b0 0x7fa1dc154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 >> 172.21.15.73:0/1832877207 conn(0x7fa1dc0b0270 msgr2=0x7fa1dc06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 shutdown_connections 2023-12-19T16:15:45.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.697+0000 7fa1e24d1640 1 -- 172.21.15.73:0/1832877207 wait complete. 2023-12-19T16:15:45.719 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T16:15:45.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:45.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 Processor -- start 2023-12-19T16:15:45.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 -- start start 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f00cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77f00ced20 0x7f77f006c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00b2e70 con 0x7f77f00cd050 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00b2260 con 0x7f77f00ced20 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77f4804640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00b2540 con 0x7f77f015c9d0 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.853+0000 7f77eeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77f00ced20 0x7f77f006c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77f00ced20 0x7f77f006c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38836/0 (socket says 172.21.15.73:38836) 2023-12-19T16:15:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 -- 172.21.15.73:0/4272708763 learned_addr learned my addr 172.21.15.73:0/4272708763 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77ef7fe640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f00cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 -- 172.21.15.73:0/4272708763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 msgr2=0x7f77f00cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f00cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 -- 172.21.15.73:0/4272708763 >> v1:172.21.15.162:6789/0 conn(0x7f77f00cd050 legacy=0x7f77f01606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 -- 172.21.15.73:0/4272708763 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00b2820 con 0x7f77f00ced20 2023-12-19T16:15:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77ef7fe640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:45.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77eeffd640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f006c810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbc93f8183c5615 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77ee7fc640 1 -- 172.21.15.73:0/4272708763 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40ab600 con 0x7f77f00ced20 2023-12-19T16:15:45.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77ee7fc640 1 -- 172.21.15.73:0/4272708763 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e40ab760 con 0x7f77f00ced20 2023-12-19T16:15:45.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.857+0000 7f77ee7fc640 1 -- 172.21.15.73:0/4272708763 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40abaf0 con 0x7f77f00ced20 2023-12-19T16:15:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- 172.21.15.73:0/4272708763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 msgr2=0x7f77f006c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f006c810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009870 tx=0x7f77e401c480 comp rx=0 tx=0).stop 2023-12-19T16:15:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- 172.21.15.73:0/4272708763 shutdown_connections 2023-12-19T16:15:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f006c810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- 172.21.15.73:0/4272708763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f00cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- 172.21.15.73:0/4272708763 >> 172.21.15.73:0/4272708763 conn(0x7f77f00658e0 msgr2=0x7f77f0065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- 172.21.15.73:0/4272708763 shutdown_connections 2023-12-19T16:15:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- 172.21.15.73:0/4272708763 wait complete. 2023-12-19T16:15:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 Processor -- start 2023-12-19T16:15:45.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- start start 2023-12-19T16:15:45.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f00cd050 0x7f77f01564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0157840 con 0x7f77f00ced20 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0156a20 con 0x7f77f00cd050 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77f4804640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f014a1a0 con 0x7f77f015c9d0 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77eeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77eeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38840/0 (socket says 172.21.15.73:38840) 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77eeffd640 1 -- 172.21.15.73:0/955400453 learned_addr learned my addr 172.21.15.73:0/955400453 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77ef7fe640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f00cd050 0x7f77f01564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.861+0000 7f77effff640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 -- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 msgr2=0x7f77f014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 -- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f00cd050 msgr2=0x7f77f01564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:45.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f00cd050 0x7f77f01564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:45.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 -- 172.21.15.73:0/955400453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40094d0 con 0x7f77f00ced20 2023-12-19T16:15:45.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77eeffd640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77e401a0b0 tx=0x7f77e401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40ab600 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e40b4800 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e40b4b90 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f00cd9f0 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f0156fa0 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f0159af0 con 0x7f77f00ced20 2023-12-19T16:15:45.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77e40b4cf0 con 0x7f77f00ced20 2023-12-19T16:15:45.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 0x7f77dc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:45.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77e411dba0 con 0x7f77f00ced20 2023-12-19T16:15:45.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.865+0000 7f77ef7fe640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 0x7f77dc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.869+0000 7f77ef7fe640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 0x7f77dc067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006e90 tx=0x7f77e0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:45.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:45.869+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77f0159af0 con 0x7f77f00ced20 2023-12-19T16:15:46.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.021+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77f0159af0 con 0x7f77f00ced20 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77d7fff640 1 -- 172.21.15.73:0/955400453 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f77f0159af0 con 0x7f77f00ced20 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:46.027 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 msgr2=0x7f77dc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 0x7f77dc067f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77e0006e90 tx=0x7f77e0008040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 msgr2=0x7f77f0149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77e401a0b0 tx=0x7f77e401acc0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 shutdown_connections 2023-12-19T16:15:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77f015c9d0 0x7f77f014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77dc065a60 0x7f77dc067f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77f00ced20 0x7f77f0149c60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 --2- 172.21.15.73:0/955400453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77f00cd050 0x7f77f01564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 >> 172.21.15.73:0/955400453 conn(0x7f77f00658e0 msgr2=0x7f77f01606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 shutdown_connections 2023-12-19T16:15:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.025+0000 7f77f4804640 1 -- 172.21.15.73:0/955400453 wait complete. 2023-12-19T16:15:46.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T16:15:46.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T16:15:46.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T16:15:46.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T16:15:46.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T16:15:46.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T16:15:46.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T16:15:46.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T16:15:46.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 Processor -- start 2023-12-19T16:15:46.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 -- start start 2023-12-19T16:15:46.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f021c0ac250 0x7f021c0ac680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f949f339640 1 Processor -- start 2023-12-19T16:15:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 -- start start 2023-12-19T16:15:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f021a7fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f021c0d0110 0x7f021c0cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42314/0 (socket says 172.21.15.73:42314) 2023-12-19T16:15:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f021a7fc640 1 -- 172.21.15.73:0/2724757598 learned_addr learned my addr 172.21.15.73:0/2724757598 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f021b7fe640 1 --2- 172.21.15.73:0/2724757598 >> v2:172.21.15.162:3300/0 conn(0x7f021c0ac250 0x7f021c0ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0ce340 con 0x7f021c15cf30 2023-12-19T16:15:46.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94900df2f0 0x7f9490007220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9490054140 0x7f94900e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9490005ee0 con 0x7f94900df2f0 2023-12-19T16:15:46.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94900e3a70 con 0x7f9490054140 2023-12-19T16:15:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f949f339640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9490006180 con 0x7f9490053ce0 2023-12-19T16:15:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37848/0 (socket says 172.21.15.73:37848) 2023-12-19T16:15:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 -- 172.21.15.73:0/201128694 learned_addr learned my addr 172.21.15.73:0/201128694 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949d8d6640 1 --2- 172.21.15.73:0/201128694 >> v2:172.21.15.162:3300/0 conn(0x7f9490054140 0x7f94900e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c15d310 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0ccb40 con 0x7f021c0ac250 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497164450 0 0) 0x7f021c15d310 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0204003530 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856237515 0 0) 0x7f0204003530 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 >> v2:172.21.15.162:3300/0 conn(0x7f021c0ac250 msgr2=0x7f021c0ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 --2- 172.21.15.73:0/2724757598 >> v2:172.21.15.162:3300/0 conn(0x7f021c0ac250 0x7f021c0ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 >> v1:172.21.15.73:6789/0 conn(0x7f021c15cf30 legacy=0x7f021c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0ae700 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f0210001680 con 0x7f021c0d0110 2023-12-19T16:15:46.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 >> v1:172.21.15.162:6789/0 conn(0x7f021c0d0110 legacy=0x7f021c0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204003980 0x7f0204003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0ccb40 con 0x7f0204003980 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020400c010 con 0x7f0204005190 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.293+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020400c1d0 con 0x7f02040047d0 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021b7fe640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021affd640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204003980 0x7f0204003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 -- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0204005190 msgr2=0x7f020400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 -- 172.21.15.73:0/2724757598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204003980 msgr2=0x7f0204003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204003980 0x7f0204003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.297+0000 7f021a7fc640 1 -- 172.21.15.73:0/2724757598 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0ae700 con 0x7f02040047d0 2023-12-19T16:15:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f021b7fe640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0204005190 0x7f020400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f021b7fe640 1 -- 172.21.15.73:0/2724757598 reap_dead start 2023-12-19T16:15:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 -- 172.21.15.73:0/201128694 >> v2:172.21.15.162:3300/0 conn(0x7f9490054140 msgr2=0x7f94900e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 --2- 172.21.15.73:0/201128694 >> v2:172.21.15.162:3300/0 conn(0x7f9490054140 0x7f94900e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 -- 172.21.15.73:0/201128694 >> v2:172.21.15.73:3300/0 conn(0x7f94900df2f0 msgr2=0x7f9490007220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 --2- 172.21.15.73:0/201128694 >> v2:172.21.15.73:3300/0 conn(0x7f94900df2f0 0x7f9490007220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f949c8d4640 1 -- 172.21.15.73:0/201128694 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490006460 con 0x7f9490053ce0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f021a7fc640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 0x7f0204004c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0210008150 tx=0x7f021001ce80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=352e27a07d9f4fbe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100a5bf0 con 0x7f02040047d0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02100a5d50 con 0x7f02040047d0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f0219ffb640 1 -- 172.21.15.73:0/2724757598 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100a5bf0 con 0x7f02040047d0 2023-12-19T16:15:46.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 msgr2=0x7f0204004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.301+0000 7f022142d640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 0x7f0204004c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0210008150 tx=0x7f021001ce80 comp rx=0 tx=0).stop 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 shutdown_connections 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 --2- 172.21.15.73:0/2724757598 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02040047d0 0x7f0204004c50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 >> 172.21.15.73:0/2724757598 conn(0x7f021c0cf620 msgr2=0x7f021c0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 shutdown_connections 2023-12-19T16:15:46.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 -- 172.21.15.73:0/2724757598 wait complete. 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949c8d4640 1 --2- 172.21.15.73:0/201128694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9490055770 tx=0x7f948801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d54adc85f67fbc02 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f948ffff640 1 -- 172.21.15.73:0/201128694 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ac410 con 0x7f9490053ce0 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f948ffff640 1 -- 172.21.15.73:0/201128694 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880ac570 con 0x7f9490053ce0 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f948ffff640 1 -- 172.21.15.73:0/201128694 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94880ac900 con 0x7f9490053ce0 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 -- 172.21.15.73:0/201128694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 msgr2=0x7f94900e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 --2- 172.21.15.73:0/201128694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9490055770 tx=0x7f948801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 -- 172.21.15.73:0/201128694 shutdown_connections 2023-12-19T16:15:46.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 --2- 172.21.15.73:0/201128694 >> v2:172.21.15.162:3300/0 conn(0x7f9490054140 0x7f94900e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 --2- 172.21.15.73:0/201128694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9490053ce0 0x7f94900e2cb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 --2- 172.21.15.73:0/201128694 >> v2:172.21.15.73:3300/0 conn(0x7f94900df2f0 0x7f9490007220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f949f339640 1 -- 172.21.15.73:0/201128694 >> 172.21.15.73:0/201128694 conn(0x7f9490054b10 msgr2=0x7f9490054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 Processor -- start 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f0b1d2a7640 1 Processor -- start 2023-12-19T16:15:46.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f0b1d2a7640 1 -- start start 2023-12-19T16:15:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.305+0000 7f022142d640 1 -- start start 2023-12-19T16:15:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f949f339640 1 -- 172.21.15.73:0/201128694 shutdown_connections 2023-12-19T16:15:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02040047d0 0x7f021c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f021c085700 0x7f021c145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 0x7f021c088160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c155960 con 0x7f02040047d0 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c160420 con 0x7f021c1461f0 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f022142d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c15f640 con 0x7f021c085700 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 0x7f021c088160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 0x7f021c088160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42204/0 (socket says 172.21.15.73:42204) 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 -- 172.21.15.73:0/1667747766 learned_addr learned my addr 172.21.15.73:0/1667747766 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 Processor -- start 2023-12-19T16:15:46.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 -- start start 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f949f339640 1 -- 172.21.15.73:0/201128694 wait complete. 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1d2a7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b1003a6f0 0x7f0b1004f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1d2a7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0b1004fd20 0x7f0b100066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1d2a7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10006210 con 0x7f0b100e3080 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1d2a7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100501b0 con 0x7f0b1004fd20 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1d2a7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10005ee0 con 0x7f0b1003a6f0 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b17fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0b100e3080 0x7f0b100538f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56540/0 (socket says 172.21.15.73:56540) 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b17fff640 1 -- 172.21.15.73:0/414597821 learned_addr learned my addr 172.21.15.73:0/414597821 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/414597821 >> v2:172.21.15.162:3300/0 conn(0x7f0b1004fd20 0x7f0b100066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 -- 172.21.15.73:0/1667747766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f021c085700 msgr2=0x7f021c145cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f021c085700 0x7f021c145cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 -- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02040047d0 msgr2=0x7f021c15f100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:15:46.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f949f339640 1 Processor -- start 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c2415b510 0x7f3c240cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b177fe640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b1003a6f0 0x7f0b1004f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1caa6640 1 -- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b1003a6f0 msgr2=0x7f0b1004f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b1003a6f0 0x7f0b1004f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1caa6640 1 -- 172.21.15.73:0/414597821 >> v1:172.21.15.73:6789/0 conn(0x7f0b100e3080 legacy=0x7f0b100538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f0b1caa6640 1 -- 172.21.15.73:0/414597821 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100e3460 con 0x7f0b1004fd20 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02040047d0 0x7f021c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c154a00 con 0x7f021c1461f0 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f949f339640 1 -- start start 2023-12-19T16:15:46.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c240cf880 0x7f3c240cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240d37c0 con 0x7f3c24146590 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240d0240 con 0x7f3c2415b510 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2bafc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2415b8f0 con 0x7f3c240cf880 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2a099640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3c24146590 0x7f3c24146a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42330/0 (socket says 172.21.15.73:42330) 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c2a099640 1 -- 172.21.15.73:0/937516452 learned_addr learned my addr 172.21.15.73:0/937516452 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f021b7fe640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 0x7f021c088160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0204004750 tx=0x7f0214010590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c29898640 1 --2- 172.21.15.73:0/937516452 >> v2:172.21.15.73:3300/0 conn(0x7f3c2415b510 0x7f3c240cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c29097640 1 --2- 172.21.15.73:0/937516452 >> v2:172.21.15.162:3300/0 conn(0x7f3c240cf880 0x7f3c240cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.309+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730998317 0 0) 0x7f3c240d37c0 con 0x7f3c24146590 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c10003530 con 0x7f3c24146590 2023-12-19T16:15:46.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021401b070 con 0x7f021c1461f0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400f040 con 0x7f021c1461f0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c154ce0 con 0x7f021c1461f0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400e050 con 0x7f021c1461f0 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562065457 0 0) 0x7f3c10003530 con 0x7f3c24146590 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 >> v2:172.21.15.162:3300/0 conn(0x7f3c240cf880 msgr2=0x7f3c240cfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 --2- 172.21.15.73:0/937516452 >> v2:172.21.15.162:3300/0 conn(0x7f3c240cf880 0x7f3c240cfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 >> v2:172.21.15.73:3300/0 conn(0x7f3c2415b510 msgr2=0x7f3c240cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 --2- 172.21.15.73:0/937516452 >> v2:172.21.15.73:3300/0 conn(0x7f3c2415b510 0x7f3c240cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c241614e0 con 0x7f3c24146590 2023-12-19T16:15:46.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f3c1c001a00 con 0x7f3c24146590 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 0x7f94900d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9490054140 0x7f94900372f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94900df2f0 0x7f949004aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94900eb950 con 0x7f9490054140 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9490037830 con 0x7f9490053ce0 2023-12-19T16:15:46.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94900da100 con 0x7f94900df2f0 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 >> v1:172.21.15.162:6789/0 conn(0x7f3c24146590 legacy=0x7f3c24146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c100039d0 0x7f3c10003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c100047d0 0x7f3c10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 0x7f3c1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240d0240 con 0x7f3c100047d0 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2415b8f0 con 0x7f3c100039d0 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1000c030 con 0x7f3c10005190 2023-12-19T16:15:46.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c29097640 1 --2- 172.21.15.73:0/937516452 >> v2:172.21.15.162:3300/0 conn(0x7f3c240cf880 0x7f3c240cfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 0x7f94900d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 0x7f94900d9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42234/0 (socket says 172.21.15.73:42234) 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 -- 172.21.15.73:0/116096706 learned_addr learned my addr 172.21.15.73:0/116096706 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d8d6640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94900df2f0 0x7f949004aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c1552a0 con 0x7f021c1461f0 2023-12-19T16:15:46.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 0x7f3c1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f0967ba6640 1 Processor -- start 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 -- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94900df2f0 msgr2=0x7f949004aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f94900df2f0 0x7f949004aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 -- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9490054140 msgr2=0x7f94900372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9490054140 0x7f94900372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880094d0 con 0x7f9490053ce0 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c29898640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c100039d0 0x7f3c10003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949d0d5640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 0x7f94900d9a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f949400b410 tx=0x7f949400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 -- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c100039d0 msgr2=0x7f3c10003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c100039d0 0x7f3c10003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 -- 172.21.15.73:0/937516452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c100047d0 msgr2=0x7f3c10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c100047d0 0x7f3c10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f3c2a099640 1 -- 172.21.15.73:0/937516452 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10003530 con 0x7f3c10005190 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011830 con 0x7f9490053ce0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494011990 con 0x7f9490053ce0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494011d40 con 0x7f9490053ce0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94900da3e0 con 0x7f9490053ce0 2023-12-19T16:15:46.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94900ebba0 con 0x7f9490053ce0 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0214015440 con 0x7f021c1461f0 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100066a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d098c90a7b0de2fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f021c0ae390 con 0x7f021c1461f0 2023-12-19T16:15:46.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0208065b60 0x7f0208068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b16ffd640 1 -- 172.21.15.73:0/414597821 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ad660 con 0x7f0b1004fd20 2023-12-19T16:15:46.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9478000fd0 con 0x7f9490053ce0 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b16ffd640 1 -- 172.21.15.73:0/414597821 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040ad7c0 con 0x7f0b1004fd20 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b16ffd640 1 -- 172.21.15.73:0/414597821 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040adb50 con 0x7f0b1004fd20 2023-12-19T16:15:46.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0214083660 con 0x7f021c1461f0 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f020806dd80 0x7f02080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0208070850 con 0x7f020806dd80 2023-12-19T16:15:46.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0214085bc0 con 0x7f021c1461f0 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f9a45266640 1 Processor -- start 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f9a45266640 1 -- start start 2023-12-19T16:15:46.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f021affd640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0208065b60 0x7f0208068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 msgr2=0x7f0b100066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100066a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c450 comp rx=0 tx=0).stop 2023-12-19T16:15:46.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.313+0000 7f0967ba6640 1 -- start start 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0967ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 0x7f09600adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0967ba6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600cc4b0 con 0x7f09600cb860 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0967ba6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600cc790 con 0x7f09600c1c10 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0967ba6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960165d70 con 0x7f0960165800 2023-12-19T16:15:46.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0965942640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f09600c1c10 0x7f09600cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42338/0 (socket says 172.21.15.73:42338) 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0965942640 1 -- 172.21.15.73:0/2110601244 learned_addr learned my addr 172.21.15.73:0/2110601244 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0965141640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09600cb860 0x7f09600c8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56546/0 (socket says 172.21.15.73:56546) 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f57aef18640 1 Processor -- start 2023-12-19T16:15:46.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f57aef18640 1 -- start start 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f949401a400 con 0x7f9490053ce0 2023-12-19T16:15:46.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f021a7fc640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f020806dd80 0x7f02080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f021a7fc640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f020806dd80 0x7f02080701a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 Processor -- start 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/414597821 shutdown_connections 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100066a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/414597821 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b1003a6f0 0x7f0b1004f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/414597821 >> 172.21.15.73:0/414597821 conn(0x7f0b10054b10 msgr2=0x7f0b10054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/414597821 shutdown_connections 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a45266640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 0x7f9a4015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a45266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a400ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a45266640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4015ad00 con 0x7f9a400b40b0 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a45266640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4015e110 con 0x7f9a40159830 2023-12-19T16:15:46.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a45266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ce2d0 con 0x7f9a400cdc40 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c2a099640 1 -- 172.21.15.73:0/937516452 reap_dead start 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f948dffb640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f947c065ab0 0x7f947c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9494083230 con 0x7f9490053ce0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f949c8d4640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f947c065ab0 0x7f947c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f948dffb640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f947c06dcd0 0x7f947c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f947c0707a0 con 0x7f947c06dcd0 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9494085940 con 0x7f9490053ce0 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c2a099640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 0x7f3c1000b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00a790 tx=0x7f3c1c01d2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33f7ec37e38ba8cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ac620 con 0x7f3c10005190 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a8070 con 0x7f3c10005190 2023-12-19T16:15:46.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c28896640 1 -- 172.21.15.73:0/937516452 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ac620 con 0x7f3c10005190 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 -- start start 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191415ae90 0x7f19140d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19140ad480 0x7f19140b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19140b0f50 con 0x7f19140ceed0 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19140cdce0 con 0x7f19140ad480 2023-12-19T16:15:46.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f191a6f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b0380 con 0x7f191415ae90 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1913fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f19140ceed0 0x7f19140cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42362/0 (socket says 172.21.15.73:42362) 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1913fff640 1 -- 172.21.15.73:0/2866106790 learned_addr learned my addr 172.21.15.73:0/2866106790 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0966143640 1 --2- 172.21.15.73:0/2110601244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 0x7f09600adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0966143640 1 -- 172.21.15.73:0/2110601244 >> v1:172.21.15.162:6789/0 conn(0x7f09600c1c10 legacy=0x7f09600cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0966143640 1 -- 172.21.15.73:0/2110601244 >> v1:172.21.15.73:6789/0 conn(0x7f09600cb860 legacy=0x7f09600c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.317+0000 7f0966143640 1 -- 172.21.15.73:0/2110601244 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600cca70 con 0x7f0960165800 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 0x7f9a4015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 0x7f9a4015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38884/0 (socket says 172.21.15.73:38884) 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3effd640 1 -- 172.21.15.73:0/891251619 learned_addr learned my addr 172.21.15.73:0/891251619 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3f7fe640 1 --2- 172.21.15.73:0/891251619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a400ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3f7fe640 1 -- 172.21.15.73:0/891251619 >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 msgr2=0x7f9a4015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3f7fe640 1 --2- 172.21.15.73:0/891251619 >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 0x7f9a4015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3f7fe640 1 -- 172.21.15.73:0/891251619 >> v1:172.21.15.162:6789/0 conn(0x7f9a400b40b0 legacy=0x7f9a400cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f9a3f7fe640 1 -- 172.21.15.73:0/891251619 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4015d490 con 0x7f9a400cdc40 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f949c8d4640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f947c065ab0 0x7f947c067f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94880ae000 tx=0x7f9488004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f949d8d6640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f947c06dcd0 0x7f947c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386089009 0 0) 0x7f19140b0f50 con 0x7f19140ceed0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18fc003530 con 0x7f19140ceed0 2023-12-19T16:15:46.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/414597821 wait complete. 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449860914 0 0) 0x7f18fc003530 con 0x7f19140ceed0 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191415ae90 msgr2=0x7f19140d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191415ae90 0x7f19140d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 >> v2:172.21.15.73:3300/0 conn(0x7f19140ad480 msgr2=0x7f19140b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 --2- 172.21.15.73:0/2866106790 >> v2:172.21.15.73:3300/0 conn(0x7f19140ad480 0x7f19140b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140b0620 con 0x7f19140ceed0 2023-12-19T16:15:46.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f1904001680 con 0x7f19140ceed0 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c2bafc640 1 -- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 msgr2=0x7f3c1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f3c2bafc640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 0x7f3c1000b990 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00a790 tx=0x7f3c1c01d2a0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f021affd640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0208065b60 0x7f0208068020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f021c06ab10 tx=0x7f020c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 >> v1:172.21.15.162:6789/0 conn(0x7f19140ceed0 legacy=0x7f19140cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18fc003980 0x7f18fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18fc0047d0 0x7f18fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc0052b0 0x7f18fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cdce0 con 0x7f18fc0052b0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140b0380 con 0x7f18fc0047d0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc00c210 con 0x7f18fc003980 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f0966143640 1 --2- 172.21.15.73:0/2110601244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 0x7f09600adc90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0958009dc0 tx=0x7f095801d390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9468d5970b9c666c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.321+0000 7f0964940640 1 -- 172.21.15.73:0/2110601244 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a5900 con 0x7f0960165800 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0964940640 1 -- 172.21.15.73:0/2110601244 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09580a5a60 con 0x7f0960165800 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0964940640 1 -- 172.21.15.73:0/2110601244 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a5df0 con 0x7f0960165800 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== osd.1 v2:172.21.15.73:6809/38195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0208070850 con 0x7f020806dd80 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f3c2bafc640 1 -- 172.21.15.73:0/937516452 shutdown_connections 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f3c2bafc640 1 --2- 172.21.15.73:0/937516452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c10005190 0x7f3c1000b990 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f3c2bafc640 1 -- 172.21.15.73:0/937516452 >> 172.21.15.73:0/937516452 conn(0x7f3c24065ce0 msgr2=0x7f3c240660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18fc003980 0x7f18fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1918c96640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc0052b0 0x7f18fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f19137fe640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18fc0047d0 0x7f18fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 Processor -- start 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 -- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18fc0047d0 msgr2=0x7f18fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18fc0047d0 0x7f18fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 -- 172.21.15.73:0/2866106790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc0052b0 msgr2=0x7f18fc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f18fc0052b0 0x7f18fc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f1913fff640 1 -- 172.21.15.73:0/2866106790 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140b0620 con 0x7f18fc003980 2023-12-19T16:15:46.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f3c2bafc640 1 -- 172.21.15.73:0/937516452 shutdown_connections 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f949d8d6640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f947c06dcd0 0x7f947c0700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f3c2bafc640 1 -- 172.21.15.73:0/937516452 wait complete. 2023-12-19T16:15:46.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 -- start start 2023-12-19T16:15:46.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 -- 172.21.15.73:0/2110601244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 msgr2=0x7f09600adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 --2- 172.21.15.73:0/2110601244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 0x7f09600adc90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0958009dc0 tx=0x7f095801d390 comp rx=0 tx=0).stop 2023-12-19T16:15:46.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 -- 172.21.15.73:0/2110601244 shutdown_connections 2023-12-19T16:15:46.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 --2- 172.21.15.73:0/2110601244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0960165800 0x7f09600adc90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 -- 172.21.15.73:0/2110601244 >> 172.21.15.73:0/2110601244 conn(0x7f09600b0270 msgr2=0x7f09600b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 -- 172.21.15.73:0/2110601244 shutdown_connections 2023-12-19T16:15:46.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1003a6f0 0x7f0b100d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100d84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0967ba6640 1 -- 172.21.15.73:0/2110601244 wait complete. 2023-12-19T16:15:46.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b100e3080 0x7f0b100d89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100d8010 con 0x7f0b1003a6f0 2023-12-19T16:15:46.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100d7120 con 0x7f0b1004fd20 2023-12-19T16:15:46.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1d2a7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100d7400 con 0x7f0b100e3080 2023-12-19T16:15:46.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f57aef18640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f57a80c99f0 0x7f57a815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100d84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b177fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100d84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42260/0 (socket says 172.21.15.73:42260) 2023-12-19T16:15:46.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b177fe640 1 -- 172.21.15.73:0/778373473 learned_addr learned my addr 172.21.15.73:0/778373473 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b100e3080 0x7f0b100d89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f57accb4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f57a80ada10 0x7f57a8070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56548/0 (socket says 172.21.15.73:56548) 2023-12-19T16:15:46.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f57accb4640 1 -- 172.21.15.73:0/2899810257 learned_addr learned my addr 172.21.15.73:0/2899810257 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f9a3f7fe640 1 --2- 172.21.15.73:0/891251619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a400ca080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a340097c0 tx=0x7f9a340207f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25a8a1792d6041e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f9a3dffb640 1 -- 172.21.15.73:0/891251619 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a9790 con 0x7f9a400cdc40 2023-12-19T16:15:46.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a8071320 con 0x7f57a80ada10 2023-12-19T16:15:46.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f9a3dffb640 1 -- 172.21.15.73:0/891251619 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340a98f0 con 0x7f9a400cdc40 2023-12-19T16:15:46.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.325+0000 7f9a3dffb640 1 -- 172.21.15.73:0/891251619 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a9c80 con 0x7f9a400cdc40 2023-12-19T16:15:46.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 -- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b100e3080 msgr2=0x7f0b100d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0b100e3080 0x7f0b100d89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 -- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1003a6f0 msgr2=0x7f0b100d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b1003a6f0 0x7f0b100d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04009420 con 0x7f0b1004fd20 2023-12-19T16:15:46.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80cd300 con 0x7f57a815c8d0 2023-12-19T16:15:46.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b177fe640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100d84a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00d800 tx=0x7f0b0c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== osd.0 v2:172.21.15.73:6824/38196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f947c0707a0 con 0x7f947c06dcd0 2023-12-19T16:15:46.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f1913fff640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18fc003980 0x7f18fc003da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f190400c260 tx=0x7f190401f3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac94d6960cf12c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0967ba6640 1 Processor -- start 2023-12-19T16:15:46.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0967ba6640 1 -- start start 2023-12-19T16:15:46.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00b6c0 con 0x7f0b1004fd20 2023-12-19T16:15:46.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00b820 con 0x7f0b1004fd20 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100d76e0 con 0x7f0b1004fd20 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/2899810257 >> v2:172.21.15.162:3300/0 conn(0x7f57a80c99f0 0x7f57a815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a815d2a0 con 0x7f57a80c99f0 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882863038 0 0) 0x7f57a80cd300 con 0x7f57a815c8d0 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5790003530 con 0x7f57a815c8d0 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220830104 0 0) 0x7f57a8071320 con 0x7f57a80ada10 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a80cd300 con 0x7f57a80ada10 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 -- 172.21.15.73:0/891251619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 msgr2=0x7f9a400ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 --2- 172.21.15.73:0/891251619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a400ca080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a340097c0 tx=0x7f9a340207f0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 -- 172.21.15.73:0/891251619 shutdown_connections 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 --2- 172.21.15.73:0/891251619 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a400ca080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 --2- 172.21.15.73:0/891251619 >> v2:172.21.15.73:3300/0 conn(0x7f9a40159830 0x7f9a4015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 -- 172.21.15.73:0/891251619 >> 172.21.15.73:0/891251619 conn(0x7f9a400b0270 msgr2=0x7f9a400b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 -- 172.21.15.73:0/891251619 shutdown_connections 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f9a45266640 1 -- 172.21.15.73:0/891251619 wait complete. 2023-12-19T16:15:46.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f3c2bafc640 1 Processor -- start 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904005ae0 con 0x7f18fc003980 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19040ab070 con 0x7f18fc003980 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f1912ffd640 1 -- 172.21.15.73:0/2866106790 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904007070 con 0x7f18fc003980 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00bb90 con 0x7f0b1004fd20 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100d7ca0 con 0x7f0b1004fd20 2023-12-19T16:15:46.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b10037c40 con 0x7f0b1004fd20 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1075280340 0 0) 0x7f5790003530 con 0x7f57a815c8d0 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 >> v2:172.21.15.162:3300/0 conn(0x7f57a80c99f0 msgr2=0x7f57a815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 --2- 172.21.15.73:0/2899810257 >> v2:172.21.15.162:3300/0 conn(0x7f57a80c99f0 0x7f57a815cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 >> v1:172.21.15.73:6789/0 conn(0x7f57a80ada10 legacy=0x7f57a8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80cd5e0 con 0x7f57a815c8d0 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f5798001680 con 0x7f57a815c8d0 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 >> v1:172.21.15.162:6789/0 conn(0x7f57a815c8d0 legacy=0x7f57a80c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004b70 0x7f5790004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790003770 0x7f5790003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 0x7f579000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40011c0 con 0x7f5790003770 2023-12-19T16:15:46.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815d2a0 con 0x7f5790004130 2023-12-19T16:15:46.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579000c160 con 0x7f5790004b70 2023-12-19T16:15:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0967ba6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09600c1c10 0x7f096014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f191a6f9640 1 -- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18fc003980 msgr2=0x7f18fc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f191a6f9640 1 --2- 172.21.15.73:0/2866106790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f18fc003980 0x7f18fc003da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f190400c260 tx=0x7f190401f3d0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0967ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 0x7f09600b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f0967ba6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0960165800 0x7f09600af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 0x7f579000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 0x7f09600b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57accb4640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004b70 0x7f5790004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f1918c96640 1 -- 172.21.15.73:0/2866106790 reap_dead start 2023-12-19T16:15:46.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f191a6f9640 1 -- 172.21.15.73:0/2866106790 shutdown_connections 2023-12-19T16:15:46.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.329+0000 7f191a6f9640 1 -- 172.21.15.73:0/2866106790 >> 172.21.15.73:0/2866106790 conn(0x7f19140d08f0 msgr2=0x7f19140d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 0x7f09600b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37908/0 (socket says 172.21.15.73:37908) 2023-12-19T16:15:46.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 -- 172.21.15.73:0/3096252069 learned_addr learned my addr 172.21.15.73:0/3096252069 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0967ba6640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600b3d40 con 0x7f09600c1c10 2023-12-19T16:15:46.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0967ba6640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600b30c0 con 0x7f0960165800 2023-12-19T16:15:46.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0966143640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0960165800 0x7f09600af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0967ba6640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600b33a0 con 0x7f09600cb860 2023-12-19T16:15:46.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 Processor -- start 2023-12-19T16:15:46.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f191a6f9640 1 -- 172.21.15.73:0/2866106790 shutdown_connections 2023-12-19T16:15:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f191a6f9640 1 -- 172.21.15.73:0/2866106790 wait complete. 2023-12-19T16:15:46.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965942640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09600c1c10 0x7f096014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 -- start start 2023-12-19T16:15:46.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 -- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0960165800 msgr2=0x7f09600af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0960165800 0x7f09600af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 -- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09600c1c10 msgr2=0x7f096014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09600c1c10 0x7f096014aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009a70 con 0x7f09600cb860 2023-12-19T16:15:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0966143640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0960165800 0x7f09600af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a400b40b0 0x7f9a40155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a401548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0965141640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 0x7f09600b26e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c490 tx=0x7f095c00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a40159830 0x7f9a40153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40153ae0 con 0x7f9a400b40b0 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40153dc0 con 0x7f9a40159830 2023-12-19T16:15:46.378 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a45266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a401540a0 con 0x7f9a400cdc40 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f579ffff640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790003770 0x7f5790003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57ad4b5640 1 -- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004b70 msgr2=0x7f5790004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004b70 0x7f5790004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57ad4b5640 1 -- 172.21.15.73:0/2899810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790003770 msgr2=0x7f5790003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790003770 0x7f5790003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f57ad4b5640 1 -- 172.21.15.73:0/2899810257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80cd5e0 con 0x7f5790004130 2023-12-19T16:15:46.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f579ffff640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5790003770 0x7f5790003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a40159830 0x7f9a40153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a40159830 0x7f9a40153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42290/0 (socket says 172.21.15.73:42290) 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3f7fe640 1 -- 172.21.15.73:0/1999075567 learned_addr learned my addr 172.21.15.73:0/1999075567 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a401548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b0c00bcf0 con 0x7f0b1004fd20 2023-12-19T16:15:46.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0afc065a60 0x7f0afc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b0c084160 con 0x7f0b1004fd20 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f0afc06dc80 0x7f0afc0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0afc070750 con 0x7f0afc06dc80 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b0c084510 con 0x7f0b1004fd20 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f0b17fff640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0afc065a60 0x7f0afc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 -- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a40159830 msgr2=0x7f9a40153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a40159830 0x7f9a40153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 -- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a400b40b0 msgr2=0x7f9a40155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a400b40b0 0x7f9a40155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f9a3e7fc640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009420 con 0x7f9a400cdc40 2023-12-19T16:15:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.333+0000 7f3c2bafc640 1 -- start start 2023-12-19T16:15:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f0afc06dc80 0x7f0afc0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a3e7fc640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a401548a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800c770 tx=0x7f9a3800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c007480 con 0x7f09600cb860 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c0075e0 con 0x7f09600cb860 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c004a10 con 0x7f09600cb860 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57ad4b5640 1 -- 172.21.15.73:0/2899810257 reap_dead start 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 0x7f579000b990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007360 tx=0x7f57a001ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=942ec243c2ef5733 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f191a6f9640 1 Processor -- start 2023-12-19T16:15:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0b1caa6640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f0afc06dc80 0x7f0afc0700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00a5c60 con 0x7f5790004130 2023-12-19T16:15:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a38003b80 con 0x7f9a400cdc40 2023-12-19T16:15:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a38003ce0 con 0x7f9a400cdc40 2023-12-19T16:15:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800aa70 con 0x7f9a400cdc40 2023-12-19T16:15:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4001d80 con 0x7f5790004130 2023-12-19T16:15:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f579f7fe640 1 -- 172.21.15.73:0/2899810257 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00a5c60 con 0x7f5790004130 2023-12-19T16:15:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0967ba6640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600b3680 con 0x7f09600cb860 2023-12-19T16:15:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0967ba6640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09600b4160 con 0x7f09600cb860 2023-12-19T16:15:46.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f191a6f9640 1 -- start start 2023-12-19T16:15:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== osd.5 v2:172.21.15.162:6809/38389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0afc070750 con 0x7f0afc06dc80 2023-12-19T16:15:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a40154380 con 0x7f9a400cdc40 2023-12-19T16:15:46.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40154de0 con 0x7f9a400cdc40 2023-12-19T16:15:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 msgr2=0x7f579000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 0x7f579000b990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007360 tx=0x7f57a001ce80 comp rx=0 tx=0).stop 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c10005190 0x7f3c24159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c240c57d0 0x7f3c240c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 0x7f3c240d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240caf30 con 0x7f3c10005190 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2415a290 con 0x7f3c240cbf20 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2bafc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2415ade0 con 0x7f3c240c57d0 2023-12-19T16:15:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 shutdown_connections 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 --2- 172.21.15.73:0/2899810257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5790004130 0x7f579000b990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 >> 172.21.15.73:0/2899810257 conn(0x7f57a80b0270 msgr2=0x7f57a80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 shutdown_connections 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2a099640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 0x7f3c240d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2a099640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 0x7f3c240d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42292/0 (socket says 172.21.15.73:42292) 2023-12-19T16:15:46.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2a099640 1 -- 172.21.15.73:0/2144429490 learned_addr learned my addr 172.21.15.73:0/2144429490 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f0b17fff640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0afc065a60 0x7f0afc067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b180639f0 tx=0x7f0b18066b30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f57aef18640 1 -- 172.21.15.73:0/2899810257 wait complete. 2023-12-19T16:15:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c29898640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c10005190 0x7f3c24159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c29097640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c240c57d0 0x7f3c240c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a40153c50 con 0x7f9a400cdc40 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.337+0000 7f3c2a099640 1 -- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c240c57d0 msgr2=0x7f3c240c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2a099640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c240c57d0 0x7f3c240c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2a099640 1 -- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c10005190 msgr2=0x7f3c24159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2a099640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c10005190 0x7f3c24159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2a099640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240cb160 con 0x7f3c240cbf20 2023-12-19T16:15:46.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c29898640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c10005190 0x7f3c24159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 0x7f191406c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f191406c560 0x7f191414d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f191414dd40 0x7f191413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191406c9c0 con 0x7f191414dd40 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914142470 con 0x7f191406c560 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f191a6f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191414f900 con 0x7f191414f520 2023-12-19T16:15:46.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9a3800abd0 con 0x7f9a400cdc40 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2a099640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 0x7f3c240d0480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01db40 tx=0x7f3c10005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b2070 con 0x7f3c240cbf20 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 0x7f191406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 0x7f191406c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37928/0 (socket says 172.21.15.73:37928) 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 -- 172.21.15.73:0/3532721572 learned_addr learned my addr 172.21.15.73:0/3532721572 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1918c96640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f191414dd40 0x7f191413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 -- 172.21.15.73:0/3532721572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f191406c560 msgr2=0x7f191414d800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f191406c560 0x7f191414d800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 -- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f191414dd40 msgr2=0x7f191413f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f191414dd40 0x7f191413f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140c4690 con 0x7f191414f520 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f095c004b70 con 0x7f09600cb860 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f093c000fd0 con 0x7f09600cb860 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f57aef18640 1 Processor -- start 2023-12-19T16:15:46.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f57aef18640 1 -- start start 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9a2c065b30 0x7f9a2c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a38082f40 con 0x7f9a400cdc40 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f9a2c06dd50 0x7f9a2c070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a2c070820 con 0x7f9a2c06dd50 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a38088530 con 0x7f9a400cdc40 2023-12-19T16:15:46.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a3effd640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9a2c065b30 0x7f9a2c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c240cb440 con 0x7f3c240cbf20 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240cba00 con 0x7f3c240cbf20 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c001880 con 0x7f3c240cbf20 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b2070 con 0x7f3c240cbf20 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f9a3f7fe640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f9a2c06dd50 0x7f9a2c070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.341+0000 7f1913fff640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 0x7f191406c020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f190401f200 tx=0x7f18fc005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f9a3f7fe640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f9a2c06dd50 0x7f9a2c070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904005ea0 con 0x7f191414f520 2023-12-19T16:15:46.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1904001500 con 0x7f191414f520 2023-12-19T16:15:46.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19040b6070 con 0x7f191414f520 2023-12-19T16:15:46.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191414e5c0 con 0x7f191414f520 2023-12-19T16:15:46.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914141e20 con 0x7f191414f520 2023-12-19T16:15:46.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 0x7f57a814c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a814cc70 0x7f57a80c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a80b1720 0x7f57a8154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 --> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f021c151410 con 0x7f020806dd80 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19140b0be0 con 0x7f191414f520 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f09567fc640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0944065a60 0x7f0944067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f095c0823a0 con 0x7f09600cb860 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 0x7f57a814c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 0x7f57a814c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37936/0 (socket says 172.21.15.73:37936) 2023-12-19T16:15:46.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a814ca70 con 0x7f57a80b1720 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80c23f0 con 0x7f57a814cc70 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 -- 172.21.15.73:0/549132730 learned_addr learned my addr 172.21.15.73:0/549132730 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80c26d0 con 0x7f5790004130 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f579ffff640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a814cc70 0x7f57a80c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 -- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a814cc70 msgr2=0x7f57a80c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a814cc70 0x7f57a80c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 -- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a80b1720 msgr2=0x7f57a8154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a80b1720 0x7f57a8154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80c29b0 con 0x7f5790004130 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57accb4640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 0x7f57a814c530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57a4007350 tx=0x7f57a4007810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== osd.7 v2:172.21.15.162:6808/38391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9a2c070820 con 0x7f9a2c06dd50 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f09567fc640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7f094406dc00 0x7f0944070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09440706d0 con 0x7f094406dc00 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a40108f0 con 0x7f5790004130 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4010a50 con 0x7f5790004130 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4010dc0 con 0x7f5790004130 2023-12-19T16:15:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a80c2c90 con 0x7f5790004130 2023-12-19T16:15:46.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f095c084980 con 0x7f09600cb860 2023-12-19T16:15:46.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a80b1ba0 con 0x7f5790004130 2023-12-19T16:15:46.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c0c000fd0 con 0x7f3c240cbf20 2023-12-19T16:15:46.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.345+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c1c0aa070 con 0x7f3c240cbf20 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19040ad020 con 0x7f191414f520 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f02037fe640 1 -- 172.21.15.73:0/1667747766 <== osd.1 v2:172.21.15.73:6809/38195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f021c151410 con 0x7f020806dd80 2023-12-19T16:15:46.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57a80c2560 con 0x7f5790004130 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f9a3effd640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9a2c065b30 0x7f9a2c067ff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000b240 tx=0x7f9a30006ea0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f0965942640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0944065a60 0x7f0944067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f020806dd80 msgr2=0x7f02080701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f020806dd80 0x7f02080701a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0208065b60 msgr2=0x7f0208068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c1a7fc640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c08065af0 0x7f3c08067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0208065b60 0x7f0208068020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f021c06ab10 tx=0x7f020c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 msgr2=0x7f021c088160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c1c0a5e40 con 0x7f3c240cbf20 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 --2- 172.21.15.73:0/1667747766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021c1461f0 0x7f021c088160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0204004750 tx=0x7f0214010590 comp rx=0 tx=0).stop 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f021b7fe640 1 -- 172.21.15.73:0/1667747766 reap_dead start 2023-12-19T16:15:46.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1900065a90 0x7f1900067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f0966143640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7f094406dc00 0x7f0944070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c1a7fc640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f3c0806dd10 0x7f3c08070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c080707e0 con 0x7f3c0806dd10 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1c11e570 con 0x7f3c240cbf20 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 shutdown_connections 2023-12-19T16:15:46.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 >> 172.21.15.73:0/1667747766 conn(0x7f021c0cf620 msgr2=0x7f021c088de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f190411fee0 con 0x7f191414f520 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7f190006dcb0 0x7f19000700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1900070780 con 0x7f190006dcb0 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1904122500 con 0x7f191414f520 2023-12-19T16:15:46.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1918c96640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7f190006dcb0 0x7f19000700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f0966143640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7f094406dc00 0x7f0944070020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57a4015430 con 0x7f5790004130 2023-12-19T16:15:46.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f3c29097640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f3c0806dd10 0x7f3c08070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f1918c96640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7f190006dcb0 0x7f19000700d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5794065a90 0x7f5794067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57a40862f0 con 0x7f5790004130 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7f579406dc30 0x7f5794070050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5794070700 con 0x7f579406dc30 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57a4088950 con 0x7f5790004130 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.349+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 shutdown_connections 2023-12-19T16:15:46.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f022142d640 1 -- 172.21.15.73:0/1667747766 wait complete. 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7f579406dc30 0x7f5794070050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== osd.3 v2:172.21.15.73:6808/38198 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1900070780 con 0x7f190006dcb0 2023-12-19T16:15:46.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f3c29097640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f3c0806dd10 0x7f3c08070130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f0965942640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0944065a60 0x7f0944067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0950018cb0 tx=0x7f0950018c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== osd.4 v2:172.21.15.162:6800/38388 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f09440706d0 con 0x7f094406dc00 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== osd.2 v2:172.21.15.73:6800/38197 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3c080707e0 con 0x7f3c0806dd10 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.353+0000 7f3c29898640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c08065af0 0x7f3c08067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.357+0000 7f3c29898640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c08065af0 0x7f3c08067fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009b60 tx=0x7f3c20008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.357+0000 7f57ad4b5640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7f579406dc30 0x7f5794070050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.357+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== osd.6 v2:172.21.15.162:6824/38390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5794070700 con 0x7f579406dc30 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f19137fe640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1900065a90 0x7f1900067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f579ffff640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5794065a90 0x7f5794067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f579ffff640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5794065a90 0x7f5794067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5798001ec0 tx=0x7f5798009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 --> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9478002cc0 con 0x7f947c06dcd0 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f19137fe640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1900065a90 0x7f1900067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f191413f600 tx=0x7f1908006f20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.361+0000 7f948dffb640 1 -- 172.21.15.73:0/116096706 <== osd.0 v2:172.21.15.73:6824/38196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9478002cc0 con 0x7f947c06dcd0 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f947c06dcd0 msgr2=0x7f947c0700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f947c06dcd0 0x7f947c0700f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f947c065ab0 msgr2=0x7f947c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f947c065ab0 0x7f947c067f70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94880ae000 tx=0x7f9488004740 comp rx=0 tx=0).stop 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 msgr2=0x7f94900d9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 --2- 172.21.15.73:0/116096706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9490053ce0 0x7f94900d9a70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f949400b410 tx=0x7f949400b8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949d8d6640 1 -- 172.21.15.73:0/116096706 reap_dead start 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 shutdown_connections 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 >> 172.21.15.73:0/116096706 conn(0x7f9490054b10 msgr2=0x7f94900de5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 shutdown_connections 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.365+0000 7f949f339640 1 -- 172.21.15.73:0/116096706 wait complete. 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 --> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b10054700 con 0x7f0afc06dc80 2023-12-19T16:15:46.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b14ff9640 1 -- 172.21.15.73:0/778373473 <== osd.5 v2:172.21.15.162:6809/38389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b040ad930 con 0x7f0afc06dc80 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f0afc06dc80 msgr2=0x7f0afc0700a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f0afc06dc80 0x7f0afc0700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0afc065a60 msgr2=0x7f0afc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0afc065a60 0x7f0afc067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b180639f0 tx=0x7f0b18066b30 comp rx=0 tx=0).stop 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 msgr2=0x7f0b100d84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.373+0000 7f0b1d2a7640 1 --2- 172.21.15.73:0/778373473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1004fd20 0x7f0b100d84a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00d800 tx=0x7f0b0c00dcc0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f0b1caa6640 1 -- 172.21.15.73:0/778373473 reap_dead start 2023-12-19T16:15:46.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 shutdown_connections 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 >> 172.21.15.73:0/778373473 conn(0x7f0b10054b10 msgr2=0x7f0b10004ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 --> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19140b0900 con 0x7f190006dcb0 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f1910ff9640 1 -- 172.21.15.73:0/3532721572 <== osd.3 v2:172.21.15.73:6808/38198 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f190c003df0 con 0x7f190006dcb0 2023-12-19T16:15:46.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 --> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a40159c10 con 0x7f9a2c06dd50 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a277fe640 1 -- 172.21.15.73:0/1999075567 <== osd.7 v2:172.21.15.162:6808/38391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a340a9a60 con 0x7f9a2c06dd50 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7f190006dcb0 msgr2=0x7f19000700d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7f190006dcb0 0x7f19000700d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f9a2c06dd50 msgr2=0x7f9a2c070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f9a2c06dd50 0x7f9a2c070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9a2c065b30 msgr2=0x7f9a2c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9a2c065b30 0x7f9a2c067ff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000b240 tx=0x7f9a30006ea0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 msgr2=0x7f9a401548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 --2- 172.21.15.73:0/1999075567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a400cdc40 0x7f9a401548a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800c770 tx=0x7f9a3800cc30 comp rx=0 tx=0).stop 2023-12-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a3f7fe640 1 -- 172.21.15.73:0/1999075567 reap_dead start 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 shutdown_connections 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f0b1d2a7640 1 -- 172.21.15.73:0/778373473 wait complete. 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 shutdown_connections 2023-12-19T16:15:46.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 >> 172.21.15.73:0/1999075567 conn(0x7f9a400b0270 msgr2=0x7f9a40070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1900065a90 msgr2=0x7f1900067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1900065a90 0x7f1900067f50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f191413f600 tx=0x7f1908006f20 comp rx=0 tx=0).stop 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 msgr2=0x7f191406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.377+0000 7f191a6f9640 1 --2- 172.21.15.73:0/3532721572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f191414f520 0x7f191406c020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f190401f200 tx=0x7f18fc005800 comp rx=0 tx=0).stop 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f1918c96640 1 -- 172.21.15.73:0/3532721572 reap_dead start 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 shutdown_connections 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 >> 172.21.15.73:0/3532721572 conn(0x7f19140d08f0 msgr2=0x7f191414fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 shutdown_connections 2023-12-19T16:15:46.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f9a45266640 1 -- 172.21.15.73:0/1999075567 wait complete. 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 shutdown_connections 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f191a6f9640 1 -- 172.21.15.73:0/3532721572 wait complete. 2023-12-19T16:15:46.423 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:46.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 --> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f093c002cc0 con 0x7f094406dc00 2023-12-19T16:15:46.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.381+0000 7f09567fc640 1 -- 172.21.15.73:0/3096252069 <== osd.4 v2:172.21.15.162:6800/38388 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f093c002cc0 con 0x7f094406dc00 2023-12-19T16:15:46.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:15:46.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7f094406dc00 msgr2=0x7f0944070020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7f094406dc00 0x7f0944070020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0944065a60 msgr2=0x7f0944067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0944065a60 0x7f0944067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0950018cb0 tx=0x7f0950018c00 comp rx=0 tx=0).stop 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 msgr2=0x7f09600b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0943fff640 1 --2- 172.21.15.73:0/3096252069 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09600cb860 0x7f09600b26e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c490 tx=0x7f095c00c950 comp rx=0 tx=0).stop 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f0966143640 1 -- 172.21.15.73:0/3096252069 reap_dead start 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 --> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c0c002cc0 con 0x7f3c0806dd10 2023-12-19T16:15:46.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c1a7fc640 1 -- 172.21.15.73:0/2144429490 <== osd.2 v2:172.21.15.73:6800/38197 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c0c002cc0 con 0x7f3c0806dd10 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f3c0806dd10 msgr2=0x7f3c08070130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f3c0806dd10 0x7f3c08070130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c08065af0 msgr2=0x7f3c08067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c08065af0 0x7f3c08067fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009b60 tx=0x7f3c20008040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 msgr2=0x7f3c240d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 --2- 172.21.15.73:0/2144429490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c240cbf20 0x7f3c240d0480 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01db40 tx=0x7f3c10005800 comp rx=0 tx=0).stop 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2a099640 1 -- 172.21.15.73:0/2144429490 reap_dead start 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 shutdown_connections 2023-12-19T16:15:46.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.385+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 >> 172.21.15.73:0/2144429490 conn(0x7f3c24065ce0 msgr2=0x7f3c24144eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 shutdown_connections 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 >> 172.21.15.73:0/3096252069 conn(0x7f09600b0270 msgr2=0x7f09600cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 shutdown_connections 2023-12-19T16:15:46.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f3c2bafc640 1 -- 172.21.15.73:0/2144429490 wait complete. 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 shutdown_connections 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f0943fff640 1 -- 172.21.15.73:0/3096252069 wait complete. 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 --> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57a8070410 con 0x7f579406dc30 2023-12-19T16:15:46.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f579d7fa640 1 -- 172.21.15.73:0/549132730 <== osd.6 v2:172.21.15.162:6824/38390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57a00a5b80 con 0x7f579406dc30 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7f579406dc30 msgr2=0x7f5794070050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.389+0000 7f57aef18640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7f579406dc30 0x7f5794070050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.393+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5794065a90 msgr2=0x7f5794067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.393+0000 7f57aef18640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5794065a90 0x7f5794067f50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5798001ec0 tx=0x7f5798009040 comp rx=0 tx=0).stop 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.393+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 msgr2=0x7f57a814c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.393+0000 7f57aef18640 1 --2- 172.21.15.73:0/549132730 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5790004130 0x7f57a814c530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f57a4007350 tx=0x7f57a4007810 comp rx=0 tx=0).stop 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.393+0000 7f57ad4b5640 1 -- 172.21.15.73:0/549132730 reap_dead start 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.397+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 shutdown_connections 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.397+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 >> 172.21.15.73:0/549132730 conn(0x7f57a80b0270 msgr2=0x7f57a80b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.397+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 shutdown_connections 2023-12-19T16:15:46.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.397+0000 7f57aef18640 1 -- 172.21.15.73:0/549132730 wait complete. 2023-12-19T16:15:46.432 INFO:teuthology.orchestra.run.smithi073.stdout:68719476742 2023-12-19T16:15:46.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:15:46.433 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2023-12-19T16:15:46.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:15:46.434 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:46.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:15:46.435 INFO:teuthology.orchestra.run.smithi073.stdout:60129542150 2023-12-19T16:15:46.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:15:46.436 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2023-12-19T16:15:46.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:15:46.437 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:46.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:15:46.438 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2023-12-19T16:15:46.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:15:46.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.709+0000 7fbbb428c640 1 Processor -- start 2023-12-19T16:15:46.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.709+0000 7fbbb428c640 1 -- start start 2023-12-19T16:15:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 Processor -- start 2023-12-19T16:15:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 -- start start 2023-12-19T16:15:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb428c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 0x7fbbac158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb428c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbbac0cb4c0 0x7fbbac0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb428c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbac0cbe60 con 0x7fbbac0aff90 2023-12-19T16:15:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb428c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbac070510 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb428c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac071fc0 con 0x7fbbac06a840 2023-12-19T16:15:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb2028640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 0x7fbbac158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb2028640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 0x7fbbac158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37942/0 (socket says 172.21.15.73:37942) 2023-12-19T16:15:46.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb2028640 1 -- 172.21.15.73:0/2316021710 learned_addr learned my addr 172.21.15.73:0/2316021710 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb1827640 1 --2- 172.21.15.73:0/2316021710 >> v2:172.21.15.162:3300/0 conn(0x7fbbac0cb4c0 0x7fbbac0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec900c9790 0x7fec90164ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec901650e0 0x7fec900cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900c1990 con 0x7fec900c93b0 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9006fe30 con 0x7fec900c9790 2023-12-19T16:15:46.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec9662d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec90165710 con 0x7fec901650e0 2023-12-19T16:15:46.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8ffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fec900c93b0 0x7fec900cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42386/0 (socket says 172.21.15.73:42386) 2023-12-19T16:15:46.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8ffff640 1 -- 172.21.15.73:0/1587851017 learned_addr learned my addr 172.21.15.73:0/1587851017 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec94bca640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec901650e0 0x7fec900cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035345128 0 0) 0x7fec900c1990 con 0x7fec900c93b0 2023-12-19T16:15:46.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb1827640 1 -- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 msgr2=0x7fbbac158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb1827640 1 --2- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 0x7fbbac158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb1827640 1 -- 172.21.15.73:0/2316021710 >> v1:172.21.15.73:6789/0 conn(0x7fbbac0aff90 legacy=0x7fbbac0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fbbb1827640 1 -- 172.21.15.73:0/2316021710 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac0cc410 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec7c003530 con 0x7fec900c93b0 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/1587851017 >> v2:172.21.15.73:3300/0 conn(0x7fec900c9790 0x7fec90164ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.713+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2441822698 0 0) 0x7fec7c003530 con 0x7fec900c93b0 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.717+0000 7fec8f7fe640 1 -- 172.21.15.73:0/1587851017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec901650e0 msgr2=0x7fec900cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.717+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec901650e0 0x7fec900cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.717+0000 7fec8f7fe640 1 -- 172.21.15.73:0/1587851017 >> v1:172.21.15.162:6789/0 conn(0x7fec900c93b0 legacy=0x7fec900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.717+0000 7fec8f7fe640 1 -- 172.21.15.73:0/1587851017 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec901659f0 con 0x7fec900c9790 2023-12-19T16:15:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb1827640 1 --2- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac0cb920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097c0 tx=0x7fbb9c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8885b97864929dea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 Processor -- start 2023-12-19T16:15:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb1026640 1 -- 172.21.15.73:0/2316021710 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0ab600 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb1026640 1 -- 172.21.15.73:0/2316021710 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0a7050 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb1026640 1 -- 172.21.15.73:0/2316021710 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0ab980 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 -- start start 2023-12-19T16:15:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec900c9790 0x7fec90164ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec800097c0 tx=0x7fec8001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f3ae85dec0c805 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb428c640 1 -- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac0cb4c0 msgr2=0x7fbbac0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb428c640 1 --2- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac0cb920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c0097c0 tx=0x7fbb9c01c380 comp rx=0 tx=0).stop 2023-12-19T16:15:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880019e0 con 0x7fec900c9790 2023-12-19T16:15:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800a7050 con 0x7fec900c9790 2023-12-19T16:15:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec8effd640 1 -- 172.21.15.73:0/1587851017 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800ab600 con 0x7fec900c9790 2023-12-19T16:15:46.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d940cc8c0 0x7f6d940ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 0x7f6d940cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940c8ae0 con 0x7f6d940c9510 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9415f990 con 0x7f6d940cc8c0 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d9a134640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940cbb90 con 0x7f6d940cae60 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d940cc8c0 0x7f6d940ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d98931640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 0x7f6d940cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d940cc8c0 0x7f6d940ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38982/0 (socket says 172.21.15.73:38982) 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 -- 172.21.15.73:0/2175299410 learned_addr learned my addr 172.21.15.73:0/2175299410 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 -- 172.21.15.73:0/2175299410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 msgr2=0x7f6d940cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 0x7f6d940cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 -- 172.21.15.73:0/2175299410 >> v1:172.21.15.162:6789/0 conn(0x7f6d940c9510 legacy=0x7f6d940c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d93fff640 1 -- 172.21.15.73:0/2175299410 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865066175 0 0) 0x7f6d940c8ae0 con 0x7f6d940c9510 2023-12-19T16:15:46.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d99132640 1 -- 172.21.15.73:0/2175299410 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940c8d10 con 0x7f6d940cc8c0 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec9662d640 1 -- 172.21.15.73:0/1587851017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec900c9790 msgr2=0x7fec90164ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fec9662d640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec900c9790 0x7fec90164ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec800097c0 tx=0x7fec8001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb428c640 1 -- 172.21.15.73:0/2316021710 shutdown_connections 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb428c640 1 --2- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac0cb920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7fbbb428c640 1 --2- 172.21.15.73:0/2316021710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac06a840 0x7fbbac158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fbbb428c640 1 -- 172.21.15.73:0/2316021710 >> 172.21.15.73:0/2316021710 conn(0x7fbbac069d20 msgr2=0x7fbbac06a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.721+0000 7f6d98931640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 0x7f6d940cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fbbb428c640 1 -- 172.21.15.73:0/2316021710 shutdown_connections 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 -- 172.21.15.73:0/1587851017 shutdown_connections 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec901650e0 0x7fec900cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 --2- 172.21.15.73:0/1587851017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec900c9790 0x7fec90164ba0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 -- 172.21.15.73:0/1587851017 >> 172.21.15.73:0/1587851017 conn(0x7fec90069d20 msgr2=0x7fec9006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 -- 172.21.15.73:0/1587851017 shutdown_connections 2023-12-19T16:15:46.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 -- 172.21.15.73:0/1587851017 wait complete. 2023-12-19T16:15:46.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fbbb428c640 1 -- 172.21.15.73:0/2316021710 wait complete. 2023-12-19T16:15:46.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7f86e9c11640 1 Processor -- start 2023-12-19T16:15:46.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 Processor -- start 2023-12-19T16:15:46.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7fec9662d640 1 -- start start 2023-12-19T16:15:46.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 Processor -- start 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 0x7fec900afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec901650e0 0x7fec9015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900aef30 con 0x7fec901650e0 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900af740 con 0x7fec900c9790 2023-12-19T16:15:46.732 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec9662d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9015aa60 con 0x7fec900c93b0 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 -- start start 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7ff916ec3640 1 Processor -- start 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7ff916ec3640 1 -- start start 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff916ec3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff910156770 0x7ff9100c9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff916ec3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91015cf50 0x7ff9100cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff916ec3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91015d590 con 0x7ff9100cae80 2023-12-19T16:15:46.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff916ec3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91015d3a0 con 0x7ff910156770 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff916ec3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff910156b50 con 0x7ff91015cf50 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff9156c0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff9100cae80 0x7ff91015c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56570/0 (socket says 172.21.15.73:56570) 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff9156c0640 1 -- 172.21.15.73:0/2987098486 learned_addr learned my addr 172.21.15.73:0/2987098486 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff9166c2640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91015cf50 0x7ff9100cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.725+0000 7f86e9c11640 1 -- start start 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e9c11640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f86e4159660 0x7f86e415de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e9c11640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e415d980 con 0x7f86e40aead0 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e9c11640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e415e350 con 0x7f86e40cbf40 2023-12-19T16:15:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e9c11640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e415aeb0 con 0x7f86e4159660 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fdf60012640 1 Processor -- start 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff915ec1640 1 --2- 172.21.15.73:0/2987098486 >> v2:172.21.15.73:3300/0 conn(0x7ff910156770 0x7ff9100c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff915ec1640 1 -- 172.21.15.73:0/2987098486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91015cf50 msgr2=0x7ff9100cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff915ec1640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91015cf50 0x7ff9100cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff915ec1640 1 -- 172.21.15.73:0/2987098486 >> v1:172.21.15.73:6789/0 conn(0x7ff9100cae80 legacy=0x7ff91015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7ff915ec1640 1 -- 172.21.15.73:0/2987098486 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100c8b80 con 0x7ff910156770 2023-12-19T16:15:46.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e2ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f86e40cbf40 0x7f86e40ae3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42402/0 (socket says 172.21.15.73:42402) 2023-12-19T16:15:46.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f86e4159660 0x7f86e415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fdf60012640 1 -- start start 2023-12-19T16:15:46.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f6d99132640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cc8c0 0x7f6d940ccca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d8001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1811a543fcd4b22 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f86e4159660 0x7f86e415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42330/0 (socket says 172.21.15.73:42330) 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e2ffd640 1 -- 172.21.15.73:0/3293966342 learned_addr learned my addr 172.21.15.73:0/3293966342 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 0x7fec900afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42320/0 (socket says 172.21.15.73:42320) 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 -- 172.21.15.73:0/3740794025 learned_addr learned my addr 172.21.15.73:0/3740794025 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac06a840 0x7fbbac1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1f8ba0 con 0x7fbbac0cb4c0 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1f8df0 con 0x7fbbac06a840 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb428c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbac1f90d0 con 0x7fbbac0aff90 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 -- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 msgr2=0x7fec900afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 0x7fec900afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 -- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec901650e0 msgr2=0x7fec9015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb1827640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb1827640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:37992/0 (socket says 172.21.15.73:37992) 2023-12-19T16:15:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fbbb1827640 1 -- 172.21.15.73:0/4070846808 learned_addr learned my addr 172.21.15.73:0/4070846808 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f86e27fc640 1 -- 172.21.15.73:0/3293966342 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408629192 0 0) 0x7f86e415e350 con 0x7f86e40cbf40 2023-12-19T16:15:46.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec901650e0 0x7fec9015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 -- 172.21.15.73:0/3740794025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009420 con 0x7fec900c9790 2023-12-19T16:15:46.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8ffff640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 0x7fec900afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7f6d93fff640 1 -- 172.21.15.73:0/2175299410 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800a8a30 con 0x7f6d940cc8c0 2023-12-19T16:15:46.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.729+0000 7fec8f7fe640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec8001aa70 tx=0x7fec80019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb2028640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac06a840 0x7fbbac1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f86e27fc640 1 -- 172.21.15.73:0/3293966342 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86cc003530 con 0x7f86e40cbf40 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f86e37fe640 1 -- 172.21.15.73:0/3293966342 >> v1:172.21.15.162:6789/0 conn(0x7f86e40cbf40 legacy=0x7f86e40ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb2829640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 -- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac06a840 msgr2=0x7fbbac1f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac06a840 0x7fbbac1f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 -- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 msgr2=0x7fbbac162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf60012640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 0x7fdf580cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf60012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 0x7fdf580b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf60012640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf580cdb00 con 0x7fdf5815cb20 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf60012640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580b1ec0 con 0x7fdf580cd180 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf60012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580d1f10 con 0x7fdf580b59b0 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d93fff640 1 -- 172.21.15.73:0/2175299410 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800a8b90 con 0x7f6d940cc8c0 2023-12-19T16:15:46.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d93fff640 1 -- 172.21.15.73:0/2175299410 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800a8a30 con 0x7f6d940cc8c0 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 -- 172.21.15.73:0/4070846808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c009420 con 0x7fbbac0aff90 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb2829640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f86e37fe640 1 -- 172.21.15.73:0/3293966342 >> v1:172.21.15.73:6789/0 conn(0x7f86e40aead0 legacy=0x7f86e4159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800ba070 con 0x7fec900c9790 2023-12-19T16:15:46.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800b4400 con 0x7fec900c9790 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800b47b0 con 0x7fec900c9790 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5d5ad640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 0x7fdf580cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5d5ad640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 0x7fdf580cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42352/0 (socket says 172.21.15.73:42352) 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5d5ad640 1 -- 172.21.15.73:0/3699657129 learned_addr learned my addr 172.21.15.73:0/3699657129 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fec9662d640 1 -- 172.21.15.73:0/3740794025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900af180 con 0x7fec900c9790 2023-12-19T16:15:46.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb1827640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c01cc20 tx=0x7fbb9c019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f8a57a8c640 1 Processor -- start 2023-12-19T16:15:46.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 -- 172.21.15.73:0/2175299410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cc8c0 msgr2=0x7f6d940ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cc8c0 0x7f6d940ccca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d8001ed30 comp rx=0 tx=0).stop 2023-12-19T16:15:46.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5e5af640 1 --2- 172.21.15.73:0/3699657129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 0x7fdf580b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 -- 172.21.15.73:0/2175299410 shutdown_connections 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cae60 0x7f6d940cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 --2- 172.21.15.73:0/2175299410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cc8c0 0x7f6d940ccca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 -- 172.21.15.73:0/2175299410 >> 172.21.15.73:0/2175299410 conn(0x7f6d94069ef0 msgr2=0x7f6d9406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f8a57a8c640 1 -- start start 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5cdac640 1 -- 172.21.15.73:0/3699657129 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701116516 0 0) 0x7fdf580cdb00 con 0x7fdf5815cb20 2023-12-19T16:15:46.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5cdac640 1 -- 172.21.15.73:0/3699657129 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf44003530 con 0x7fdf5815cb20 2023-12-19T16:15:46.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0b4600 con 0x7fbbac0aff90 2023-12-19T16:15:46.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9c0b4760 con 0x7fbbac0aff90 2023-12-19T16:15:46.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0b4b10 con 0x7fbbac0aff90 2023-12-19T16:15:46.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbac1f93b0 con 0x7fbbac0aff90 2023-12-19T16:15:46.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbac1f5370 con 0x7fbbac0aff90 2023-12-19T16:15:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 -- 172.21.15.73:0/2175299410 shutdown_connections 2023-12-19T16:15:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f6d9a134640 1 -- 172.21.15.73:0/2175299410 wait complete. 2023-12-19T16:15:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fec9662d640 1 -- 172.21.15.73:0/3740794025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90159d20 con 0x7fec900c9790 2023-12-19T16:15:46.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94005260 con 0x7fbbac0aff90 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff915ec1640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff910156770 0x7ff9100c9940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9100cbee0 tx=0x7ff90c01d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b929dfd473a73c0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7f86e37fe640 1 -- 172.21.15.73:0/3293966342 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e415a8f0 con 0x7f86e4159660 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5e5af640 1 -- 172.21.15.73:0/3699657129 >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 msgr2=0x7fdf580cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5e5af640 1 --2- 172.21.15.73:0/3699657129 >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 0x7fdf580cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5e5af640 1 -- 172.21.15.73:0/3699657129 >> v1:172.21.15.162:6789/0 conn(0x7fdf5815cb20 legacy=0x7fdf580d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.733+0000 7fdf5e5af640 1 -- 172.21.15.73:0/3699657129 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580d1af0 con 0x7fdf580b59b0 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a57a8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a500c1c10 0x7f8a500adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a57a8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500cc4b0 con 0x7f8a500cb860 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a57a8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500cc790 con 0x7f8a50165800 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a57a8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a50165d70 con 0x7f8a500c1c10 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f6d9a134640 1 Processor -- start 2023-12-19T16:15:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff914ebf640 1 -- 172.21.15.73:0/2987098486 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0b1600 con 0x7ff910156770 2023-12-19T16:15:46.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f6d9a134640 1 -- start start 2023-12-19T16:15:46.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff914ebf640 1 -- 172.21.15.73:0/2987098486 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c0b1760 con 0x7ff910156770 2023-12-19T16:15:46.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c005260 con 0x7fec900c9790 2023-12-19T16:15:46.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff914ebf640 1 -- 172.21.15.73:0/2987098486 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0b1600 con 0x7ff910156770 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a500c1c10 0x7f8a500adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a500c1c10 0x7f8a500adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42360/0 (socket says 172.21.15.73:42360) 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 -- 172.21.15.73:0/4132583985 learned_addr learned my addr 172.21.15.73:0/4132583985 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec800b2040 con 0x7fec900c9790 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb9c0b2040 con 0x7fbbac0aff90 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fbba2ffd640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 0x7fbb90067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 -- 172.21.15.73:0/2987098486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff910156770 msgr2=0x7ff9100c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff910156770 0x7ff9100c9940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9100cbee0 tx=0x7ff90c01d630 comp rx=0 tx=0).stop 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f86e37fe640 1 --2- 172.21.15.73:0/3293966342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e415de10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009de0 tx=0x7f86dc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c0d49d8a8d7bd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb9c11c9c0 con 0x7fbbac0aff90 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fbbb2028640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 0x7fbb90067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f6d9a134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f6d9a134640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 0x7f6d940ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f6d9a134640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 0x7f6d940c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 -- 172.21.15.73:0/2987098486 shutdown_connections 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91015cf50 0x7ff9100cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 --2- 172.21.15.73:0/2987098486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff910156770 0x7ff9100c9940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7ff916ec3640 1 -- 172.21.15.73:0/2987098486 >> 172.21.15.73:0/2987098486 conn(0x7ff91006a320 msgr2=0x7ff91006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7fdf5e5af640 1 --2- 172.21.15.73:0/3699657129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 0x7fdf580b5e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009d90 tx=0x7fdf5001f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48999a0a963b379a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a54826640 1 -- 172.21.15.73:0/4132583985 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170876608 0 0) 0x7f8a500cc790 con 0x7f8a50165800 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a54826640 1 -- 172.21.15.73:0/4132583985 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a3c003530 con 0x7f8a50165800 2023-12-19T16:15:46.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- 172.21.15.73:0/2987098486 shutdown_connections 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- 172.21.15.73:0/2987098486 wait complete. 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d9a134640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94156710 con 0x7f6d940cae60 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99132640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99132640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42362/0 (socket says 172.21.15.73:42362) 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99132640 1 -- 172.21.15.73:0/1894830617 learned_addr learned my addr 172.21.15.73:0/1894830617 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d98931640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 0x7f6d940ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d9a134640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9414fa60 con 0x7f6d940c9510 2023-12-19T16:15:46.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d9a134640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c7840 con 0x7f6d940cc8c0 2023-12-19T16:15:46.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7fbbb2028640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 0x7fbb90067fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbba800b340 tx=0x7fbba800f040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 0x7f6d940c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 -- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 msgr2=0x7f6d940ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 -- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 msgr2=0x7f6d940ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 0x7f6d940ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009a70 con 0x7f6d940cc8c0 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99132640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d98931640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 0x7f6d940ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f6d99933640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 0x7f6d940c5560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c3e0 tx=0x7f6d8c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7fec8cff9640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 0x7fec70067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec8011c9c0 con 0x7fec900c9790 2023-12-19T16:15:46.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 Processor -- start 2023-12-19T16:15:46.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7fec8ffff640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 0x7fec70067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- start start 2023-12-19T16:15:46.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7fec8ffff640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 0x7fec70067ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec88002240 tx=0x7fec88009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 -- 172.21.15.73:0/4132583985 >> v1:172.21.15.162:6789/0 conn(0x7f8a50165800 legacy=0x7f8a500cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 -- 172.21.15.73:0/4132583985 >> v1:172.21.15.73:6789/0 conn(0x7f8a500cb860 legacy=0x7f8a500c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.737+0000 7f8a55828640 1 -- 172.21.15.73:0/4132583985 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a500cca70 con 0x7f8a500c1c10 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91015cf50 0x7ff9100ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 0x7ff9100b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100af0d0 con 0x7ff9100cae80 2023-12-19T16:15:46.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9100ae5b0 con 0x7ff91015cf50 2023-12-19T16:15:46.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7f8a55828640 1 --2- 172.21.15.73:0/4132583985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500c1c10 0x7f8a500adc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009e50 tx=0x7f8a4801d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37425deaef3f22e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff916ec3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff910153f20 con 0x7ff910153a70 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff915ec1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff915ec1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39030/0 (socket says 172.21.15.73:39030) 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff915ec1640 1 -- 172.21.15.73:0/3549980946 learned_addr learned my addr 172.21.15.73:0/3549980946 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff9156c0640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91015cf50 0x7ff9100ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.741+0000 7ff9166c2640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 0x7ff9100b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 -- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91015cf50 msgr2=0x7ff9100ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91015cf50 0x7ff9100ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 -- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 msgr2=0x7ff9100b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 -- 172.21.15.73:0/3549980946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c009cb0 con 0x7ff910153a70 2023-12-19T16:15:46.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff915ec1640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9166c2640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 0x7ff9100b30c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff90800ebd0 tx=0x7ff90800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 Processor -- start 2023-12-19T16:15:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 -- start start 2023-12-19T16:15:46.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0054e0 con 0x7f6d940cc8c0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf5cdac640 1 -- 172.21.15.73:0/3699657129 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500af600 con 0x7fdf580b59b0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf5cdac640 1 -- 172.21.15.73:0/3699657129 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf500ab050 con 0x7fdf580b59b0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf5cdac640 1 -- 172.21.15.73:0/3699657129 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500af980 con 0x7fdf580b59b0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c003600 con 0x7f6d940cc8c0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0039f0 con 0x7f6d940cc8c0 2023-12-19T16:15:46.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f86e27fc640 1 -- 172.21.15.73:0/3293966342 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0a5810 con 0x7f86e4159660 2023-12-19T16:15:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90800cd20 con 0x7ff910153a70 2023-12-19T16:15:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90800f040 con 0x7ff910153a70 2023-12-19T16:15:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9080146c0 con 0x7ff910153a70 2023-12-19T16:15:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff916ec3640 1 -- 172.21.15.73:0/3549980946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9100b0490 con 0x7ff910153a70 2023-12-19T16:15:46.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb9c0ea4f0 con 0x7fbbac0aff90 2023-12-19T16:15:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d9a134640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d800094d0 con 0x7f6d940cc8c0 2023-12-19T16:15:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d9a134640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940cc6c0 con 0x7f6d940cc8c0 2023-12-19T16:15:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f86e27fc640 1 -- 172.21.15.73:0/3293966342 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc0a5970 con 0x7f86e4159660 2023-12-19T16:15:46.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f86e27fc640 1 -- 172.21.15.73:0/3293966342 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0a5d00 con 0x7f86e4159660 2023-12-19T16:15:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 -- 172.21.15.73:0/3699657129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 msgr2=0x7fdf580b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 --2- 172.21.15.73:0/3699657129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 0x7fdf580b5e20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf50009d90 tx=0x7fdf5001f170 comp rx=0 tx=0).stop 2023-12-19T16:15:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 -- 172.21.15.73:0/3699657129 shutdown_connections 2023-12-19T16:15:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 --2- 172.21.15.73:0/3699657129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580b59b0 0x7fdf580b5e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff916ec3640 1 -- 172.21.15.73:0/3549980946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9100aea10 con 0x7ff910153a70 2023-12-19T16:15:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 --2- 172.21.15.73:0/3699657129 >> v2:172.21.15.162:3300/0 conn(0x7fdf580cd180 0x7fdf580cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 -- 172.21.15.73:0/3699657129 >> 172.21.15.73:0/3699657129 conn(0x7fdf58065ce0 msgr2=0x7fdf580660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f8a54826640 1 -- 172.21.15.73:0/4132583985 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480a57a0 con 0x7f8a500c1c10 2023-12-19T16:15:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 0x7f5ebc0b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0b7250 con 0x7f5ebc0d1cb0 2023-12-19T16:15:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0b7530 con 0x7f5ebc0b47f0 2023-12-19T16:15:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec2b25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b7810 con 0x7f5ebc15cff0 2023-12-19T16:15:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f8a54826640 1 -- 172.21.15.73:0/4132583985 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480a5900 con 0x7f8a500c1c10 2023-12-19T16:15:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fec800ea4c0 con 0x7fec900c9790 2023-12-19T16:15:46.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f8a54826640 1 -- 172.21.15.73:0/4132583985 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480a5c90 con 0x7f8a500c1c10 2023-12-19T16:15:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 -- 172.21.15.73:0/3699657129 shutdown_connections 2023-12-19T16:15:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d70005260 con 0x7f6d940cc8c0 2023-12-19T16:15:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f86e9c11640 1 -- 172.21.15.73:0/3293966342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 msgr2=0x7f86e415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f86e9c11640 1 --2- 172.21.15.73:0/3293966342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e415de10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009de0 tx=0x7f86dc01c970 comp rx=0 tx=0).stop 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec08c1640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5ebc0b47f0 0x7f5ebc0b8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42438/0 (socket says 172.21.15.73:42438) 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7f5ec08c1640 1 -- 172.21.15.73:0/13522158 learned_addr learned my addr 172.21.15.73:0/13522158 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9100ae870 con 0x7ff910153a70 2023-12-19T16:15:46.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.745+0000 7fdf60012640 1 -- 172.21.15.73:0/3699657129 wait complete. 2023-12-19T16:15:46.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ec10c2640 1 --2- 172.21.15.73:0/13522158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 0x7f5ebc0b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801336450 0 0) 0x7f5ebc0b7530 con 0x7f5ebc0b47f0 2023-12-19T16:15:46.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 -- 172.21.15.73:0/4132583985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500c1c10 msgr2=0x7f8a500adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/4132583985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500c1c10 0x7f8a500adc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009e50 tx=0x7f8a4801d430 comp rx=0 tx=0).stop 2023-12-19T16:15:46.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f86e9c11640 1 -- 172.21.15.73:0/3293966342 shutdown_connections 2023-12-19T16:15:46.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eac003530 con 0x7f5ebc0b47f0 2023-12-19T16:15:46.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f86e9c11640 1 --2- 172.21.15.73:0/3293966342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e415de10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 -- 172.21.15.73:0/4132583985 shutdown_connections 2023-12-19T16:15:46.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f86e9c11640 1 -- 172.21.15.73:0/3293966342 >> 172.21.15.73:0/3293966342 conn(0x7f86e4071780 msgr2=0x7f86e4098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/4132583985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500c1c10 0x7f8a500adc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 -- 172.21.15.73:0/4132583985 >> 172.21.15.73:0/4132583985 conn(0x7f8a500b0270 msgr2=0x7f8a500b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6d8c003b50 con 0x7f6d940cc8c0 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f6d91ffb640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 0x7f6d78067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d8c082730 con 0x7f6d940cc8c0 2023-12-19T16:15:46.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f86e9c11640 1 -- 172.21.15.73:0/3293966342 shutdown_connections 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f86e9c11640 1 -- 172.21.15.73:0/3293966342 wait complete. 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7fdf60012640 1 Processor -- start 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7fdf60012640 1 -- start start 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7fdf60012640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 0x7fdf5815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ec10c2640 1 -- 172.21.15.73:0/13522158 >> v1:172.21.15.162:6789/0 conn(0x7f5ebc0b47f0 legacy=0x7f5ebc0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2726530019 0 0) 0x7f5eac003530 con 0x7f5ebc0b47f0 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ec10c2640 1 -- 172.21.15.73:0/13522158 >> v1:172.21.15.73:6789/0 conn(0x7f5ebc0d1cb0 legacy=0x7f5ebc15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f5ec10c2640 1 -- 172.21.15.73:0/13522158 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0b7af0 con 0x7f5ebc15cff0 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7fdf60012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 0x7fdf580c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7fdf60012640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf5815cb20 0x7fdf580b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7f8a57a8c640 1 -- 172.21.15.73:0/4132583985 shutdown_connections 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5d5ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 0x7fdf580c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5d5ad640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 0x7fdf580c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38034/0 (socket says 172.21.15.73:38034) 2023-12-19T16:15:46.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 0x7fdf5815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f8a57a8c640 1 -- 172.21.15.73:0/4132583985 wait complete. 2023-12-19T16:15:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf60012640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58070120 con 0x7fdf5815cb20 2023-12-19T16:15:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf60012640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58070400 con 0x7fdf580b59b0 2023-12-19T16:15:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf60012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580706e0 con 0x7fdf580cd180 2023-12-19T16:15:46.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 Processor -- start 2023-12-19T16:15:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5d5ad640 1 -- 172.21.15.73:0/840236609 learned_addr learned my addr 172.21.15.73:0/840236609 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5e5af640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf5815cb20 0x7fdf580b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 -- start start 2023-12-19T16:15:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.749+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff908014820 con 0x7ff910153a70 2023-12-19T16:15:46.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7ff9067fc640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 0x7ff8f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff908084360 con 0x7ff910153a70 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 -- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 msgr2=0x7fdf580c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 0x7fdf580c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 -- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf5815cb20 msgr2=0x7fdf580b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf5815cb20 0x7fdf580b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 -- 172.21.15.73:0/840236609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50009a70 con 0x7fdf580b59b0 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf5ddae640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 0x7fdf5815bf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c430 tx=0x7fdf5400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f6d99132640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 0x7f6d78067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7ff915ec1640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 0x7ff8f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54003600 con 0x7fdf580b59b0 2023-12-19T16:15:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54003760 con 0x7fdf580b59b0 2023-12-19T16:15:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54003b90 con 0x7fdf580b59b0 2023-12-19T16:15:46.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f5ec10c2640 1 --2- 172.21.15.73:0/13522158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 0x7f5ebc0b6c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009dc0 tx=0x7f5eb401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de6871bdbc724e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e40aead0 0x7f86e40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf580709c0 con 0x7fdf580b59b0 2023-12-19T16:15:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf580c5750 con 0x7fdf580b59b0 2023-12-19T16:15:46.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86e40cbf40 0x7f86e4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41639b0 con 0x7f86e40aead0 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c9330 con 0x7f86e4159660 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f8a57a8c640 1 Processor -- start 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e9c11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c9610 con 0x7f86e40cbf40 2023-12-19T16:15:46.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e3fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42394/0 (socket says 172.21.15.73:42394) 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e3fff640 1 -- 172.21.15.73:0/2341775353 learned_addr learned my addr 172.21.15.73:0/2341775353 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f86e2ffd640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86e40cbf40 0x7f86e4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e37fe640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e40aead0 0x7f86e40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7ff915ec1640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 0x7ff8f4067f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff90c000c10 tx=0x7ff90c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf58070e70 con 0x7fdf580b59b0 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 -- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86e40cbf40 msgr2=0x7f86e4157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86e40cbf40 0x7f86e4157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 -- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e40aead0 msgr2=0x7f86e40b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e40aead0 0x7f86e40b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 -- 172.21.15.73:0/2341775353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc009a70 con 0x7f86e4159660 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.753+0000 7f6d99132640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 0x7f6d78067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d80009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff908051e40 con 0x7ff910153a70 2023-12-19T16:15:46.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 -- start start 2023-12-19T16:15:46.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e3fff640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86d800c410 tx=0x7f86d800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8003600 con 0x7f86e4159660 2023-12-19T16:15:46.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8003760 con 0x7f86e4159660 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8003b50 con 0x7f86e4159660 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e9c11640 1 -- 172.21.15.73:0/2341775353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e40c98f0 con 0x7f86e4159660 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0001680 con 0x7f5ebc15cff0 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb40a5710 con 0x7f5ebc15cff0 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ebb7fe640 1 -- 172.21.15.73:0/13522158 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40a5aa0 con 0x7f5ebc15cff0 2023-12-19T16:15:46.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ec2b25640 1 -- 172.21.15.73:0/13522158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 msgr2=0x7f5ebc0b6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f86e9c11640 1 -- 172.21.15.73:0/2341775353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4157e40 con 0x7f86e4159660 2023-12-19T16:15:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/13522158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 0x7f5ebc0b6c50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009dc0 tx=0x7f5eb401c8b0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ec2b25640 1 -- 172.21.15.73:0/13522158 shutdown_connections 2023-12-19T16:15:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/13522158 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc15cff0 0x7f5ebc0b6c50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f5ec2b25640 1 -- 172.21.15.73:0/13522158 >> 172.21.15.73:0/13522158 conn(0x7f5ebc065ce0 msgr2=0x7f5ebc0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500cb860 0x7f8a50153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a50165800 0x7f8a50153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50162060 con 0x7f8a50165800 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50150530 con 0x7f8a500cb860 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a57a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a50161d80 con 0x7f8a500c1c10 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a55828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a55828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38050/0 (socket says 172.21.15.73:38050) 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f8a55828640 1 -- 172.21.15.73:0/2994181073 learned_addr learned my addr 172.21.15.73:0/2994181073 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a56029640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a50165800 0x7f8a50153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.757+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6d8c050100 con 0x7f6d940cc8c0 2023-12-19T16:15:46.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdf54003cf0 con 0x7fdf580b59b0 2023-12-19T16:15:46.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f5ec2b25640 1 -- 172.21.15.73:0/13522158 shutdown_connections 2023-12-19T16:15:46.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f5ec2b25640 1 -- 172.21.15.73:0/13522158 wait complete. 2023-12-19T16:15:46.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7fdf4e7fc640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 0x7fdf3c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf540825c0 con 0x7fdf580b59b0 2023-12-19T16:15:46.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86d8003cb0 con 0x7f86e4159660 2023-12-19T16:15:46.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f86cbfff640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 0x7f86d0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55027640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500cb860 0x7f8a50153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 -- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500cb860 msgr2=0x7f8a50153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500cb860 0x7f8a50153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 -- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a50165800 msgr2=0x7f8a50153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a50165800 0x7f8a50153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 -- 172.21.15.73:0/2994181073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48009b30 con 0x7f8a500c1c10 2023-12-19T16:15:46.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7fdf5d5ad640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 0x7fdf3c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f86e37fe640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 0x7f86d0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f5ec2b25640 1 Processor -- start 2023-12-19T16:15:46.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f8a55828640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a480af040 tx=0x7f8a48019770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7f5ec2b25640 1 -- start start 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.761+0000 7fdf5d5ad640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 0x7fdf3c067f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf580b73b0 tx=0x7fdf48009240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4163b20 con 0x7f86e4159660 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 0x7f5ebc14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 0x7f5ebc14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 0x7f5ebc0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b2b30 con 0x7f5ebc0d1cb0 2023-12-19T16:15:46.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b3500 con 0x7f5ebc15cff0 2023-12-19T16:15:46.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec2b25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b2290 con 0x7f5ebc0b47f0 2023-12-19T16:15:46.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdf58070e70 con 0x7fdf580b59b0 2023-12-19T16:15:46.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f86e37fe640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 0x7f86d0067f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0af000 tx=0x7f86dc0a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86d8053770 con 0x7f86e4159660 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b8670 con 0x7f8a500c1c10 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480b87d0 con 0x7f8a500c1c10 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b8b60 con 0x7f8a500c1c10 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a501641a0 con 0x7f8a500c1c10 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500c4480 con 0x7f8a500c1c10 2023-12-19T16:15:46.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 0x7f5ebc0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec08c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 0x7f5ebc14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec08c1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 0x7f5ebc14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38052/0 (socket says 172.21.15.73:38052) 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec08c1640 1 -- 172.21.15.73:0/2235855839 learned_addr learned my addr 172.21.15.73:0/2235855839 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 0x7f5ebc14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a50164000 con 0x7f8a500c1c10 2023-12-19T16:15:46.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 -- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 msgr2=0x7f5ebc14ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 0x7f5ebc14ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 -- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 msgr2=0x7f5ebc14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 0x7f5ebc14c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.765+0000 7f5ec10c2640 1 -- 172.21.15.73:0/2235855839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4009a70 con 0x7f5ebc15cff0 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5ebbfff640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 0x7f5ebc14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5ec10c2640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 0x7f5ebc0ca210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ac000 tx=0x7f5eb4019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a480b8cc0 con 0x7f8a500c1c10 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40adc00 con 0x7f5ebc15cff0 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb40add80 con 0x7f5ebc15cff0 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003be0 con 0x7f5ebc15cff0 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f8a427fc640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 0x7f8a34067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.769+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0b2570 con 0x7f5ebc15cff0 2023-12-19T16:15:46.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a4811e530 con 0x7f8a500c1c10 2023-12-19T16:15:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc14d640 con 0x7f5ebc15cff0 2023-12-19T16:15:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f8a55027640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 0x7f8a34067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86d8017080 con 0x7f86e4159660 2023-12-19T16:15:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f8a55027640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 0x7f8a34067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a501fd500 tx=0x7f8a4c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0b3670 con 0x7f5ebc15cff0 2023-12-19T16:15:46.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8a50164000 con 0x7f8a500c1c10 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.773+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5eb40b4050 con 0x7f5ebc15cff0 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.777+0000 7f5eb97fa640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 0x7f5ea0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.777+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb40a5e30 con 0x7f5ebc15cff0 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.777+0000 7f5ec08c1640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 0x7f5ea0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.777+0000 7f5ec08c1640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 0x7f5ea0067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc1fd0e0 tx=0x7f5eb0001de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:46.781+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5eb40ec030 con 0x7f5ebc15cff0 2023-12-19T16:15:47.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.069+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec6c005510 con 0x7fec900c9790 2023-12-19T16:15:47.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb940057e0 con 0x7fbbac0aff90 2023-12-19T16:15:47.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fec8cff9640 1 -- 172.21.15.73:0/3740794025 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec800edae0 con 0x7fec900c9790 2023-12-19T16:15:47.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbba2ffd640 1 -- 172.21.15.73:0/4070846808 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb9c0b9020 con 0x7fbbac0aff90 2023-12-19T16:15:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:68719476741 2023-12-19T16:15:47.075 INFO:teuthology.orchestra.run.smithi073.stdout:68719476742 2023-12-19T16:15:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 msgr2=0x7fbb90067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 0x7fbb90067fa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbba800b340 tx=0x7fbba800f040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 msgr2=0x7fbbac162a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.073+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c01cc20 tx=0x7fbb9c019120 comp rx=0 tx=0).stop 2023-12-19T16:15:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 msgr2=0x7fec70067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 0x7fec70067ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec88002240 tx=0x7fec88009040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 msgr2=0x7fec9015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec8001aa70 tx=0x7fec80019160 comp rx=0 tx=0).stop 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 shutdown_connections 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb90065ae0 0x7fbb90067fa0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbba800b340 tx=0x7fbba800f040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbac0cb4c0 0x7fbbac162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0aff90 0x7fbbac162a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 --2- 172.21.15.73:0/4070846808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac06a840 0x7fbbac1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 >> 172.21.15.73:0/4070846808 conn(0x7fbbac069d20 msgr2=0x7fbbac0aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 shutdown_connections 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fbbb428c640 1 -- 172.21.15.73:0/4070846808 wait complete. 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 shutdown_connections 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fec70065b30 0x7fec70067ff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec901650e0 0x7fec9015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec900c9790 0x7fec9015a520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 --2- 172.21.15.73:0/3740794025 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec900c93b0 0x7fec900afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 >> 172.21.15.73:0/3740794025 conn(0x7fec90069d20 msgr2=0x7fec900cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 shutdown_connections 2023-12-19T16:15:47.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.077+0000 7fec867fc640 1 -- 172.21.15.73:0/3740794025 wait complete. 2023-12-19T16:15:47.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.081+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9100ae870 con 0x7ff910153a70 2023-12-19T16:15:47.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.081+0000 7ff9067fc640 1 -- 172.21.15.73:0/3549980946 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9100ae870 con 0x7ff910153a70 2023-12-19T16:15:47.084 INFO:teuthology.orchestra.run.smithi073.stdout:68719476742 2023-12-19T16:15:47.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 msgr2=0x7ff8f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 0x7ff8f4067f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff90c000c10 tx=0x7ff90c008040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 msgr2=0x7ff9100b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdf58070e70 con 0x7fdf580b59b0 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 0x7ff9100b30c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff90800ebd0 tx=0x7ff90800c490 comp rx=0 tx=0).stop 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 shutdown_connections 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff910153a70 0x7ff9100b30c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91015cf50 0x7ff9100ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff8f4065a90 0x7ff8f4067f50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 --2- 172.21.15.73:0/3549980946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9100cae80 0x7ff9100b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 >> 172.21.15.73:0/3549980946 conn(0x7ff91006a320 msgr2=0x7ff9100cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.085+0000 7fdf4e7fc640 1 -- 172.21.15.73:0/840236609 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf58070e70 con 0x7fdf580b59b0 2023-12-19T16:15:47.090 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2023-12-19T16:15:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.089+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 shutdown_connections 2023-12-19T16:15:47.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.089+0000 7ff8f3fff640 1 -- 172.21.15.73:0/3549980946 wait complete. 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6d70005510 con 0x7f6d940cc8c0 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 msgr2=0x7fdf3c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 0x7fdf3c067f70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf580b73b0 tx=0x7fdf48009240 comp rx=0 tx=0).stop 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 msgr2=0x7fdf5815bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 0x7fdf5815bf40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c430 tx=0x7fdf5400c8f0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 shutdown_connections 2023-12-19T16:15:47.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdf3c065ab0 0x7fdf3c067f70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf5815cb20 0x7fdf580b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdf580cd180 0x7fdf580c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 --2- 172.21.15.73:0/840236609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf580b59b0 0x7fdf5815bf40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 >> 172.21.15.73:0/840236609 conn(0x7fdf58065ce0 msgr2=0x7fdf5815ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 shutdown_connections 2023-12-19T16:15:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.093+0000 7fdf60012640 1 -- 172.21.15.73:0/840236609 wait complete. 2023-12-19T16:15:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.097+0000 7f6d91ffb640 1 -- 172.21.15.73:0/1894830617 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d8c017020 con 0x7f6d940cc8c0 2023-12-19T16:15:47.099 INFO:teuthology.orchestra.run.smithi073.stdout:64424509445 2023-12-19T16:15:47.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.097+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f86e40c9ae0 con 0x7f86e4159660 2023-12-19T16:15:47.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.097+0000 7f86cbfff640 1 -- 172.21.15.73:0/2341775353 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86d8087060 con 0x7f86e4159660 2023-12-19T16:15:47.102 INFO:teuthology.orchestra.run.smithi073.stdout:60129542149 2023-12-19T16:15:47.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8a50164000 con 0x7f8a500c1c10 2023-12-19T16:15:47.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 msgr2=0x7f6d78067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 0x7f6d78067f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009870 tx=0x7f6d80009040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 msgr2=0x7f6d940c5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 0x7f6d940c5560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00c3e0 tx=0x7f6d8c00c8a0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f8a427fc640 1 -- 172.21.15.73:0/2994181073 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a50164000 con 0x7f8a500c1c10 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 shutdown_connections 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d940cc8c0 0x7f6d940c5560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d78065a60 0x7f6d78067f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d940cae60 0x7f6d940ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 --2- 172.21.15.73:0/1894830617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d940c9510 0x7f6d940ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 >> 172.21.15.73:0/1894830617 conn(0x7f6d94069ef0 msgr2=0x7f6d94158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 shutdown_connections 2023-12-19T16:15:47.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f6d777fe640 1 -- 172.21.15.73:0/1894830617 wait complete. 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 msgr2=0x7f86d0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 0x7f86d0067f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0af000 tx=0x7f86dc0a7070 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 msgr2=0x7f86e40caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f86d800c410 tx=0x7f86d800c8d0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 shutdown_connections 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86e4159660 0x7f86e40caa40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86e40cbf40 0x7f86e4157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86d0065a90 0x7f86d0067f50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 --2- 172.21.15.73:0/2341775353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86e40aead0 0x7f86e40b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.101+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 >> 172.21.15.73:0/2341775353 conn(0x7f86e4071780 msgr2=0x7f86e40b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.108 INFO:teuthology.orchestra.run.smithi073.stdout:64424509446 2023-12-19T16:15:47.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 shutdown_connections 2023-12-19T16:15:47.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f86c9ffb640 1 -- 172.21.15.73:0/2341775353 wait complete. 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 msgr2=0x7f8a34067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 0x7f8a34067ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a501fd500 tx=0x7f8a4c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 msgr2=0x7f8a500c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a480af040 tx=0x7f8a48019770 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 shutdown_connections 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8a34065b30 0x7f8a34067ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a50165800 0x7f8a50153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a500cb860 0x7f8a50153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 --2- 172.21.15.73:0/2994181073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a500c1c10 0x7f8a500c3f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 >> 172.21.15.73:0/2994181073 conn(0x7f8a500b0270 msgr2=0x7f8a500af4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 shutdown_connections 2023-12-19T16:15:47.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.105+0000 7f8a57a8c640 1 -- 172.21.15.73:0/2994181073 wait complete. 2023-12-19T16:15:47.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.113+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ebc074050 con 0x7f5ebc15cff0 2023-12-19T16:15:47.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.117+0000 7f5eb97fa640 1 -- 172.21.15.73:0/2235855839 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5eb40ec1d0 con 0x7f5ebc15cff0 2023-12-19T16:15:47.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.1 2023-12-19T16:15:47.123 INFO:teuthology.orchestra.run.smithi073.stdout:68719476742 2023-12-19T16:15:47.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.0 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 msgr2=0x7f5ea0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 0x7f5ea0067f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc1fd0e0 tx=0x7f5eb0001de0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 msgr2=0x7f5ebc0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 0x7f5ebc0ca210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40ac000 tx=0x7f5eb4019650 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 shutdown_connections 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ebc15cff0 0x7f5ebc0ca210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a60 0x7f5ea0067f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ebc0d1cb0 0x7f5ebc14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 --2- 172.21.15.73:0/2235855839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ebc0b47f0 0x7f5ebc14ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:47.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 >> 172.21.15.73:0/2235855839 conn(0x7f5ebc065ce0 msgr2=0x7f5ebc14fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:47.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 shutdown_connections 2023-12-19T16:15:47.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:47.121+0000 7f5ec2b25640 1 -- 172.21.15.73:0/2235855839 wait complete. 2023-12-19T16:15:47.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.3 2023-12-19T16:15:47.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.7 2023-12-19T16:15:47.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.5 2023-12-19T16:15:47.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2023-12-19T16:15:47.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.6 2023-12-19T16:15:47.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476742 for osd.2 2023-12-19T16:15:48.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T16:15:48.127 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T16:15:48.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T16:15:48.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T16:15:48.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T16:15:48.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T16:15:48.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T16:15:48.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T16:15:48.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.329+0000 7fe5631df640 1 Processor -- start 2023-12-19T16:15:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.329+0000 7fe5631df640 1 -- start start 2023-12-19T16:15:48.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.329+0000 7fe5631df640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe55c158bc0 0x7fe55c0cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5631df640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0c8ae0 con 0x7fe55c06c340 2023-12-19T16:15:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5619dc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe55c0cce00 0x7fe55c0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42444/0 (socket says 172.21.15.73:42444) 2023-12-19T16:15:48.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5619dc640 1 -- 172.21.15.73:0/3368364575 learned_addr learned my addr 172.21.15.73:0/3368364575 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3368364575 >> v2:172.21.15.162:3300/0 conn(0x7fe55c158bc0 0x7fe55c0cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55c0cb8b0 con 0x7fe55c0cce00 2023-12-19T16:15:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55c0cbb90 con 0x7fe55c158bc0 2023-12-19T16:15:48.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337323062 0 0) 0x7fe55c0cb8b0 con 0x7fe55c0cce00 2023-12-19T16:15:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe548003530 con 0x7fe55c0cce00 2023-12-19T16:15:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 120877401 0 0) 0x7fe548003530 con 0x7fe55c0cce00 2023-12-19T16:15:48.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 >> v2:172.21.15.162:3300/0 conn(0x7fe55c158bc0 msgr2=0x7fe55c0cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 --2- 172.21.15.73:0/3368364575 >> v2:172.21.15.162:3300/0 conn(0x7fe55c158bc0 0x7fe55c0cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 >> v1:172.21.15.73:6789/0 conn(0x7fe55c06c340 legacy=0x7fe55c0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0c8d10 con 0x7fe55c0cce00 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fe554001260 con 0x7fe55c0cce00 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 >> v1:172.21.15.162:6789/0 conn(0x7fe55c0cce00 legacy=0x7fe55c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548007aa0 0x7fe5480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 0x7fe5480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c0cbb90 con 0x7fe548007aa0 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe548014840 con 0x7fe548003980 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe548014a00 con 0x7fe548004d10 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3368364575 >> v2:172.21.15.162:3300/0 conn(0x7fe55c158bc0 0x7fe55c0cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5629de640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 0x7fe5480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5619dc640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548007aa0 0x7fe5480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5629de640 1 -- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548003980 msgr2=0x7fe548003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5629de640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548003980 0x7fe548003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5629de640 1 -- 172.21.15.73:0/3368364575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548007aa0 msgr2=0x7fe5480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.333+0000 7fe5629de640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe548007aa0 0x7fe5480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.337+0000 7fe5629de640 1 -- 172.21.15.73:0/3368364575 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548003530 con 0x7fe548004d10 2023-12-19T16:15:48.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.341+0000 7fe5629de640 1 -- 172.21.15.73:0/3368364575 reap_dead start 2023-12-19T16:15:48.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 Processor -- start 2023-12-19T16:15:48.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5629de640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 0x7fe5480051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0013e0 tx=0x7fe54c0173b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4c48b06142b798 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 -- start start 2023-12-19T16:15:48.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c005280 con 0x7fe548004d10 2023-12-19T16:15:48.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c0053e0 con 0x7fe548004d10 2023-12-19T16:15:48.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5611db640 1 -- 172.21.15.73:0/3368364575 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c003840 con 0x7fe548004d10 2023-12-19T16:15:48.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 msgr2=0x7fe5480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 0x7fe5480051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0013e0 tx=0x7fe54c0173b0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 shutdown_connections 2023-12-19T16:15:48.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 --2- 172.21.15.73:0/3368364575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe548004d10 0x7fe5480051c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 >> 172.21.15.73:0/3368364575 conn(0x7fe55c069ef0 msgr2=0x7fe55c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 shutdown_connections 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fe5631df640 1 -- 172.21.15.73:0/3368364575 wait complete. 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 0x7fad5c0eb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 0x7fad5c0eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0ec160 con 0x7fad5c047d10 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c054030 con 0x7fad5c033e50 2023-12-19T16:15:48.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad6b16d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c04f340 con 0x7fad5c048340 2023-12-19T16:15:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad68f09640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 0x7fad5c0eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad68f09640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 0x7fad5c0eb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42430/0 (socket says 172.21.15.73:42430) 2023-12-19T16:15:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.345+0000 7fad68f09640 1 -- 172.21.15.73:0/597547605 learned_addr learned my addr 172.21.15.73:0/597547605 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fad63fff640 1 --2- 172.21.15.73:0/597547605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 0x7fad5c0eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fad63fff640 1 -- 172.21.15.73:0/597547605 >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 msgr2=0x7fad5c0eb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fad63fff640 1 --2- 172.21.15.73:0/597547605 >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 0x7fad5c0eb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fad63fff640 1 -- 172.21.15.73:0/597547605 >> v1:172.21.15.162:6789/0 conn(0x7fad5c047d10 legacy=0x7fad5c006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fad63fff640 1 -- 172.21.15.73:0/597547605 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c04f620 con 0x7fad5c048340 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fe5631df640 1 Processor -- start 2023-12-19T16:15:48.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fe5631df640 1 -- start start 2023-12-19T16:15:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.349+0000 7fe5631df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 0x7fe55c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5631df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5631df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 0x7fe55c070550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5631df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c14bf70 con 0x7fe55c0cd1e0 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5619dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5619dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39092/0 (socket says 172.21.15.73:39092) 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5619dc640 1 -- 172.21.15.73:0/3546682250 learned_addr learned my addr 172.21.15.73:0/3546682250 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 0x7fe55c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5629de640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 0x7fe55c070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1eeab0 con 0x7fe548004d10 2023-12-19T16:15:48.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c1edf30 con 0x7fe55c14b780 2023-12-19T16:15:48.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad63fff640 1 --2- 172.21.15.73:0/597547605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 0x7fad5c0eb7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad500097f0 tx=0x7fad5001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6197b68e58471b65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 -- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 msgr2=0x7fe55c070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 0x7fe55c070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 -- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 msgr2=0x7fe55c14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c0cc6c0 con 0x7fe548004d10 2023-12-19T16:15:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5629de640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 0x7fe55c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5619dc640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fe5621dd640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 0x7fe55c0ceba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe558012880 tx=0x7fe558012d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad637fe640 1 -- 172.21.15.73:0/597547605 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500ac440 con 0x7fad5c048340 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad637fe640 1 -- 172.21.15.73:0/597547605 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad500ac5a0 con 0x7fad5c048340 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad637fe640 1 -- 172.21.15.73:0/597547605 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500ac930 con 0x7fad5c048340 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad6b16d640 1 -- 172.21.15.73:0/597547605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 msgr2=0x7fad5c0eb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.353+0000 7fad6b16d640 1 --2- 172.21.15.73:0/597547605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 0x7fad5c0eb7d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fad500097f0 tx=0x7fad5001c470 comp rx=0 tx=0).stop 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 -- 172.21.15.73:0/597547605 shutdown_connections 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 --2- 172.21.15.73:0/597547605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c048340 0x7fad5c0eb7d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 --2- 172.21.15.73:0/597547605 >> v2:172.21.15.162:3300/0 conn(0x7fad5c033e50 0x7fad5c0eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558005c70 con 0x7fe548004d10 2023-12-19T16:15:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558005dd0 con 0x7fe548004d10 2023-12-19T16:15:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558010a40 con 0x7fe548004d10 2023-12-19T16:15:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 -- 172.21.15.73:0/597547605 >> 172.21.15.73:0/597547605 conn(0x7fad5c054c50 msgr2=0x7fad5c055060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c1ee210 con 0x7fe548004d10 2023-12-19T16:15:48.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1ee7d0 con 0x7fe548004d10 2023-12-19T16:15:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 -- 172.21.15.73:0/597547605 shutdown_connections 2023-12-19T16:15:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 -- 172.21.15.73:0/597547605 wait complete. 2023-12-19T16:15:48.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fad6b16d640 1 Processor -- start 2023-12-19T16:15:48.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.357+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c04e000 con 0x7fe548004d10 2023-12-19T16:15:48.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 -- start start 2023-12-19T16:15:48.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe558010ba0 con 0x7fe548004d10 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c047d10 0x7fad5c04bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad68f09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad68f09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38114/0 (socket says 172.21.15.73:38114) 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad68f09640 1 -- 172.21.15.73:0/159497762 learned_addr learned my addr 172.21.15.73:0/159497762 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fe552ffd640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 0x7fe540068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad5c048340 0x7fad5c0e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c04ce80 con 0x7fad5c047d10 2023-12-19T16:15:48.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c180110 con 0x7fad5c048340 2023-12-19T16:15:48.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1803f0 con 0x7fad5c033e50 2023-12-19T16:15:48.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.361+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe558083750 con 0x7fe548004d10 2023-12-19T16:15:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad6970a640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad5c048340 0x7fad5c0e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 -- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad5c048340 msgr2=0x7fad5c0e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad5c048340 0x7fad5c0e5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 -- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c047d10 msgr2=0x7fad5c04bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c047d10 0x7fad5c04bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009420 con 0x7fad5c033e50 2023-12-19T16:15:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad68f09640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad5800d7d0 tx=0x7fad5800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580096a0 con 0x7fad5c033e50 2023-12-19T16:15:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fe5619dc640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 0x7fe540068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c1806d0 con 0x7fad5c033e50 2023-12-19T16:15:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c17fe20 con 0x7fad5c033e50 2023-12-19T16:15:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58009800 con 0x7fad5c033e50 2023-12-19T16:15:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580096a0 con 0x7fad5c033e50 2023-12-19T16:15:48.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.365+0000 7fe5619dc640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 0x7fe540068020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe55c154260 tx=0x7fe55400a040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe558051230 con 0x7fe548004d10 2023-12-19T16:15:48.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44005260 con 0x7fad5c033e50 2023-12-19T16:15:48.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad58009970 con 0x7fad5c033e50 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fad617fa640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 0x7fad48067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad58055320 con 0x7fad5c033e50 2023-12-19T16:15:48.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.369+0000 7fad63fff640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 0x7fad48067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.377+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fad580516f0 con 0x7fad5c033e50 2023-12-19T16:15:48.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.377+0000 7fad63fff640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 0x7fad48067f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad500ae000 tx=0x7fad50004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.417+0000 7f543cac4640 1 Processor -- start 2023-12-19T16:15:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.417+0000 7f543cac4640 1 -- start start 2023-12-19T16:15:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f0b00833640 1 Processor -- start 2023-12-19T16:15:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543cac4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54380cbbd0 0x7f54380c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543cac4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5438070510 con 0x7f543806a840 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543cac4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5438071fc0 con 0x7f54380c90a0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543cac4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543815fb40 con 0x7f54380cbbd0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f5435d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f54380c90a0 0x7f54380cb4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42462/0 (socket says 172.21.15.73:42462) 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f5435d9b640 1 -- 172.21.15.73:0/2725909282 learned_addr learned my addr 172.21.15.73:0/2725909282 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f5436d9d640 1 --2- 172.21.15.73:0/2725909282 >> v2:172.21.15.73:3300/0 conn(0x7f54380cbbd0 0x7f54380c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313144990 0 0) 0x7f5438071fc0 con 0x7f54380c90a0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5420003530 con 0x7f54380c90a0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202112617 0 0) 0x7f5438070510 con 0x7f543806a840 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5438071fc0 con 0x7f543806a840 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018051310 0 0) 0x7f5420003530 con 0x7f54380c90a0 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 >> v2:172.21.15.73:3300/0 conn(0x7f54380cbbd0 msgr2=0x7f54380c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.421+0000 7f543559a640 1 --2- 172.21.15.73:0/2725909282 >> v2:172.21.15.73:3300/0 conn(0x7f54380cbbd0 0x7f54380c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 >> v1:172.21.15.73:6789/0 conn(0x7f543806a840 legacy=0x7f5438158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380cc410 con 0x7f54380c90a0 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f5428001680 con 0x7f54380c90a0 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 >> v1:172.21.15.162:6789/0 conn(0x7f54380c90a0 legacy=0x7f54380cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420003b10 0x7f5420003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 0x7f5420004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5420005190 0x7f542001c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543815fb40 con 0x7f5420003b10 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542001d0d0 con 0x7f5420005190 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542001d290 con 0x7f54200047d0 2023-12-19T16:15:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0b00833640 1 -- start start 2023-12-19T16:15:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 0x7f5420004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f543659c640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420003b10 0x7f5420003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5436d9d640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5420005190 0x7f542001c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0b00833640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0afc0b0b10 0x7f0afc158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afbfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0afc0b1380 0x7f0afc071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42466/0 (socket says 172.21.15.73:42466) 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afbfff640 1 -- 172.21.15.73:0/4017380794 learned_addr learned my addr 172.21.15.73:0/4017380794 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0b00833640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0c8bf0 con 0x7f0afc15c8d0 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0c8ed0 con 0x7f0afc0b1380 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afb7fe640 1 --2- 172.21.15.73:0/4017380794 >> v2:172.21.15.73:3300/0 conn(0x7f0afc0b0b10 0x7f0afc158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0afea0 con 0x7f0afc0b0b10 2023-12-19T16:15:48.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160495514 0 0) 0x7f0afc0c8ed0 con 0x7f0afc0b1380 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae4005740 con 0x7f0afc0b1380 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 -- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5420005190 msgr2=0x7f542001c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5420005190 0x7f542001c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 -- 172.21.15.73:0/2725909282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420003b10 msgr2=0x7f5420003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5420003b10 0x7f5420003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f5435d9b640 1 -- 172.21.15.73:0/2725909282 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54380cc410 con 0x7f54200047d0 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171559078 0 0) 0x7f0afc0c8bf0 con 0x7f0afc15c8d0 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.425+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc0c8ed0 con 0x7f0afc15c8d0 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4100629464 0 0) 0x7f0ae4005740 con 0x7f0afc0b1380 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 >> v2:172.21.15.73:3300/0 conn(0x7f0afc0b0b10 msgr2=0x7f0afc158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 --2- 172.21.15.73:0/4017380794 >> v2:172.21.15.73:3300/0 conn(0x7f0afc0b0b10 0x7f0afc158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 >> v1:172.21.15.73:6789/0 conn(0x7f0afc15c8d0 legacy=0x7f0afc0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0c91b0 con 0x7f0afc0b1380 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f0af4001a00 con 0x7f0afc0b1380 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 >> v1:172.21.15.162:6789/0 conn(0x7f0afc0b1380 legacy=0x7f0afc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae4005dc0 0x7f0ae40061c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0ae4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ae40073a0 0x7f0ae400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0afea0 con 0x7f0ae40073a0 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4007b70 con 0x7f0ae4005dc0 2023-12-19T16:15:48.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4007d30 con 0x7f0ae40069e0 2023-12-19T16:15:48.435 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f5436d9d640 1 -- 172.21.15.73:0/2725909282 reap_dead start 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0ae4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afbfff640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ae40073a0 0x7f0ae400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afb7fe640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae4005dc0 0x7f0ae40061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 -- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae4005dc0 msgr2=0x7f0ae40061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ae4005dc0 0x7f0ae40061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 -- 172.21.15.73:0/4017380794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ae40073a0 msgr2=0x7f0ae400ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ae40073a0 0x7f0ae400ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afaffd640 1 -- 172.21.15.73:0/4017380794 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae4005740 con 0x7f0ae40069e0 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.429+0000 7f0afbfff640 1 -- 172.21.15.73:0/4017380794 reap_dead start 2023-12-19T16:15:48.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 Processor -- start 2023-12-19T16:15:48.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f5435d9b640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 0x7f5420004c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f542800b210 tx=0x7f542801cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2afd7eb6255552d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 -- start start 2023-12-19T16:15:48.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428004a80 con 0x7f54200047d0 2023-12-19T16:15:48.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428004be0 con 0x7f54200047d0 2023-12-19T16:15:48.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f543559a640 1 -- 172.21.15.73:0/2725909282 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54280a5850 con 0x7f54200047d0 2023-12-19T16:15:48.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f0afaffd640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0ae4006e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001800 tx=0x7f0af001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130759ba430ab495 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f543cac4640 1 -- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 msgr2=0x7f5420004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00052d0 con 0x7f0ae40069e0 2023-12-19T16:15:48.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f543cac4640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 0x7f5420004c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f542800b210 tx=0x7f542801cbd0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0afa7fc640 1 -- 172.21.15.73:0/4017380794 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00a7050 con 0x7f0ae40069e0 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f941c0c1c10 0x7f941c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 0x7f941c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0cc4b0 con 0x7f941c0cb690 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c165d70 con 0x7f941c0c1c10 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.433+0000 7f9424525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0cbb20 con 0x7f941c165800 2023-12-19T16:15:48.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f543cac4640 1 -- 172.21.15.73:0/2725909282 shutdown_connections 2023-12-19T16:15:48.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f543cac4640 1 --2- 172.21.15.73:0/2725909282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54200047d0 0x7f5420004c50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 msgr2=0x7f0ae4006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0ae4006e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0af0001800 tx=0x7f0af001c400 comp rx=0 tx=0).stop 2023-12-19T16:15:48.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7fb19641f640 1 Processor -- start 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f543cac4640 1 -- 172.21.15.73:0/2725909282 >> 172.21.15.73:0/2725909282 conn(0x7f5438069d20 msgr2=0x7f543806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f94222c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f941c0c1c10 0x7f941c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9421ac0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 0x7f941c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9422ac2640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f941c0cb690 0x7f941c070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56624/0 (socket says 172.21.15.73:56624) 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9422ac2640 1 -- 172.21.15.73:0/3195706204 learned_addr learned my addr 172.21.15.73:0/3195706204 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9421ac0640 1 -- 172.21.15.73:0/3195706204 >> v2:172.21.15.162:3300/0 conn(0x7f941c0c1c10 msgr2=0x7f941c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9421ac0640 1 --2- 172.21.15.73:0/3195706204 >> v2:172.21.15.162:3300/0 conn(0x7f941c0c1c10 0x7f941c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9421ac0640 1 -- 172.21.15.73:0/3195706204 >> v1:172.21.15.73:6789/0 conn(0x7f941c0cb690 legacy=0x7f941c070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f9421ac0640 1 -- 172.21.15.73:0/3195706204 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0cc790 con 0x7f941c165800 2023-12-19T16:15:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f543cac4640 1 -- 172.21.15.73:0/2725909282 shutdown_connections 2023-12-19T16:15:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 shutdown_connections 2023-12-19T16:15:48.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f543cac4640 1 -- 172.21.15.73:0/2725909282 wait complete. 2023-12-19T16:15:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7fb8abe04640 1 Processor -- start 2023-12-19T16:15:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 --2- 172.21.15.73:0/4017380794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0ae4006e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 >> 172.21.15.73:0/4017380794 conn(0x7f0afc0b0020 msgr2=0x7f0afc0b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 shutdown_connections 2023-12-19T16:15:48.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7fb19641f640 1 -- start start 2023-12-19T16:15:48.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7fb8abe04640 1 -- start start 2023-12-19T16:15:48.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb19641f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb19006a840 0x7fb190158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb19641f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb19641f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb190070510 con 0x7fb1900c90a0 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb19641f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb190071fc0 con 0x7fb19006a840 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb19641f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900cc410 con 0x7fb1900cbbd0 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8abe04640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8a40cba40 0x7fb8a40cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f543cac4640 1 Processor -- start 2023-12-19T16:15:48.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.437+0000 7f0b00833640 1 -- 172.21.15.73:0/4017380794 wait complete. 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f0b00833640 1 Processor -- start 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8abe04640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb8a406cdb0 0x7fb8a40abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8abe04640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40cc8f0 con 0x7fb8a41612e0 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8abe04640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40ccbd0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8abe04640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40cceb0 con 0x7fb8a40cba40 2023-12-19T16:15:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38138/0 (socket says 172.21.15.73:38138) 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 -- 172.21.15.73:0/1355699677 learned_addr learned my addr 172.21.15.73:0/1355699677 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a939f640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb8a41612e0 0x7fb8a406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42472/0 (socket says 172.21.15.73:42472) 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a939f640 1 -- 172.21.15.73:0/3209553126 learned_addr learned my addr 172.21.15.73:0/3209553126 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3209553126 >> v2:172.21.15.162:3300/0 conn(0x7fb8a40cba40 0x7fb8a40cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f543cac4640 1 -- start start 2023-12-19T16:15:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f0b00833640 1 -- start start 2023-12-19T16:15:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8aa3a1640 1 --2- 172.21.15.73:0/3209553126 >> v2:172.21.15.73:3300/0 conn(0x7fb8a406cdb0 0x7fb8a40abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb18ffff640 1 --2- 172.21.15.73:0/1355699677 >> v2:172.21.15.73:3300/0 conn(0x7fb19006a840 0x7fb190158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f9421ac0640 1 --2- 172.21.15.73:0/3195706204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 0x7f941c0cb150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94180097c0 tx=0x7f941801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d9732afece1dd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 Processor -- start 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 -- start start 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6080c5dd0 0x7fd6080c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ce520 con 0x7fd6080cfa10 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ce9b0 con 0x7fd6080b1ce0 2023-12-19T16:15:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60e3a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080cdef0 con 0x7fd6080c5dd0 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54200047d0 0x7f54380c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 0x7f543814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 0x7f54380af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5438159990 con 0x7f54200047d0 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5435d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 0x7f543814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5435d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 0x7f543814b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38168/0 (socket says 172.21.15.73:38168) 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5435d9b640 1 -- 172.21.15.73:0/596185279 learned_addr learned my addr 172.21.15.73:0/596185279 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 0x7f54380af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54380b1b60 con 0x7f54380af270 2023-12-19T16:15:48.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54380afc30 con 0x7f5438159240 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0afc0b2330 0x7f0afc0b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 0x7f0afc144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc158f30 con 0x7f0afc0b2330 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3170 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:38154/0 (socket says 172.21.15.73:38154) 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afb7fe640 1 -- 172.21.15.73:0/446863689 learned_addr learned my addr 172.21.15.73:0/446863689 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 0x7f0afc144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0b00833640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc15bff0 con 0x7f0ae40069e0 2023-12-19T16:15:48.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f94212bf640 1 -- 172.21.15.73:0/3195706204 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180ab600 con 0x7f941c165800 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f94212bf640 1 -- 172.21.15.73:0/3195706204 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94180a7050 con 0x7f941c165800 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7f94212bf640 1 -- 172.21.15.73:0/3195706204 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180ab980 con 0x7f941c165800 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 -- 172.21.15.73:0/3195706204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 msgr2=0x7f941c0cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 --2- 172.21.15.73:0/3195706204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 0x7f941c0cb150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94180097c0 tx=0x7f941801c480 comp rx=0 tx=0).stop 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60dba1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6080c5dd0 0x7fd6080c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60d3a0640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd6080b1ce0 0x7fd6080cf300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42478/0 (socket says 172.21.15.73:42478) 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fd60d3a0640 1 -- 172.21.15.73:0/837705655 learned_addr learned my addr 172.21.15.73:0/837705655 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261627263 0 0) 0x7fd6080ce9b0 con 0x7fd6080b1ce0 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f4003530 con 0x7fd6080b1ce0 2023-12-19T16:15:48.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4017466433 0 0) 0x7fd5f4003530 con 0x7fd6080b1ce0 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 >> v2:172.21.15.162:3300/0 conn(0x7fd6080c5dd0 msgr2=0x7fd6080c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 --2- 172.21.15.73:0/837705655 >> v2:172.21.15.162:3300/0 conn(0x7fd6080c5dd0 0x7fd6080c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 >> v1:172.21.15.73:6789/0 conn(0x7fd6080cfa10 legacy=0x7fd60806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080d33c0 con 0x7fd6080b1ce0 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fd604001680 con 0x7fd6080b1ce0 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 >> v1:172.21.15.162:6789/0 conn(0x7fd6080b1ce0 legacy=0x7fd6080cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 0x7fd5f4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5f40047d0 0x7fd5f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4005190 0x7fd5f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080cdef0 con 0x7fd5f4005190 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f400c0c0 con 0x7fd5f4003980 2023-12-19T16:15:48.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f400c280 con 0x7fd5f40047d0 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3209553126 >> v2:172.21.15.73:3300/0 conn(0x7fb8a406cdb0 msgr2=0x7fb8a40abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3209553126 >> v2:172.21.15.73:3300/0 conn(0x7fb8a406cdb0 0x7fb8a40abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3209553126 >> v1:172.21.15.162:6789/0 conn(0x7fb8a41612e0 legacy=0x7fb8a406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a8b9e640 1 -- 172.21.15.73:0/3209553126 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569916529 0 0) 0x7fb8a40cc8f0 con 0x7fb8a41612e0 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3209553126 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40cd190 con 0x7fb8a40cba40 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 -- 172.21.15.73:0/1355699677 >> v2:172.21.15.73:3300/0 conn(0x7fb19006a840 msgr2=0x7fb190158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 --2- 172.21.15.73:0/1355699677 >> v2:172.21.15.73:3300/0 conn(0x7fb19006a840 0x7fb190158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 -- 172.21.15.73:0/1355699677 >> v1:172.21.15.73:6789/0 conn(0x7fb1900c90a0 legacy=0x7fb1900cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.441+0000 7fb1949bc640 1 -- 172.21.15.73:0/1355699677 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900c9af0 con 0x7fb1900cbbd0 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543659c640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54200047d0 0x7f54380c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 0x7fd5f4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60cb9f640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5f40047d0 0x7fd5f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 -- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 msgr2=0x7f543814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 0x7f543814b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 -- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54200047d0 msgr2=0x7f54380c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54200047d0 0x7f54380c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54381596c0 con 0x7f54380af270 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 -- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 msgr2=0x7f0afc1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 -- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0afc0b2330 msgr2=0x7f0afc0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0afc0b2330 0x7f0afc0b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc15b230 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afb7fe640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 -- 172.21.15.73:0/3195706204 shutdown_connections 2023-12-19T16:15:48.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 --2- 172.21.15.73:0/3195706204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c165800 0x7f941c0cb150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 --2- 172.21.15.73:0/3195706204 >> v2:172.21.15.162:3300/0 conn(0x7f941c0c1c10 0x7f941c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 -- 172.21.15.73:0/3195706204 >> 172.21.15.73:0/3195706204 conn(0x7f941c0b0270 msgr2=0x7f941c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5436d9d640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 0x7f54380af6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f543806ac40 tx=0x7f54300115a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f0afbfff640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 0x7f0afc144d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0ce220 tx=0x7f0af4005aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543000e070 con 0x7f54380af270 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430011e10 con 0x7f54380af270 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300039a0 con 0x7f54380af270 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54380b1d70 con 0x7f54380af270 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54380b2330 con 0x7f54380af270 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 -- 172.21.15.73:0/3195706204 shutdown_connections 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7f9424525640 1 -- 172.21.15.73:0/3195706204 wait complete. 2023-12-19T16:15:48.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 -- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5f40047d0 msgr2=0x7fd5f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5f40047d0 0x7fd5f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 -- 172.21.15.73:0/837705655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4005190 msgr2=0x7fd5f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4005190 0x7fd5f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.445+0000 7fd60d3a0640 1 -- 172.21.15.73:0/837705655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080d33c0 con 0x7fd5f4003980 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fd60dba1640 1 -- 172.21.15.73:0/837705655 reap_dead start 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3209553126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a40cba40 0x7fb8a40cc310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8a406bf40 tx=0x7fb89401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a65c7f996c0c6f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8a8b9e640 1 -- 172.21.15.73:0/3209553126 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a8950 con 0x7fb8a40cba40 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8a8b9e640 1 -- 172.21.15.73:0/3209553126 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940a8ab0 con 0x7fb8a40cba40 2023-12-19T16:15:48.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8a8b9e640 1 -- 172.21.15.73:0/3209553126 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a8e40 con 0x7fb8a40cba40 2023-12-19T16:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400eb20 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400ec80 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4015400 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 -- 172.21.15.73:0/3209553126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a40cba40 msgr2=0x7fb8a40cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3209553126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a40cba40 0x7fb8a40cc310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb8a406bf40 tx=0x7fb89401ec50 comp rx=0 tx=0).stop 2023-12-19T16:15:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0b00833640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc15b510 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0b00833640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc15bad0 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f9424525640 1 Processor -- start 2023-12-19T16:15:48.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543804e000 con 0x7f54380af270 2023-12-19T16:15:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb1949bc640 1 --2- 172.21.15.73:0/1355699677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb188009870 tx=0x7fb18801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c4a30098441856 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 -- 172.21.15.73:0/3209553126 shutdown_connections 2023-12-19T16:15:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3209553126 >> v2:172.21.15.73:3300/0 conn(0x7fb8a406cdb0 0x7fb8a40abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3209553126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a40cba40 0x7fb8a40cc310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f9424525640 1 -- start start 2023-12-19T16:15:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 -- 172.21.15.73:0/3209553126 >> 172.21.15.73:0/3209553126 conn(0x7fb8a40b0270 msgr2=0x7fb8a40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc147cf0 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb18effd640 1 -- 172.21.15.73:0/1355699677 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880ac640 con 0x7fb1900cbbd0 2023-12-19T16:15:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb18effd640 1 -- 172.21.15.73:0/1355699677 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880ac7a0 con 0x7fb1900cbbd0 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 -- 172.21.15.73:0/3209553126 shutdown_connections 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb18effd640 1 -- 172.21.15.73:0/1355699677 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880acb30 con 0x7fb1900cbbd0 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fb8abe04640 1 -- 172.21.15.73:0/3209553126 wait complete. 2023-12-19T16:15:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.449+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 0x7fd5f4003d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c260 tx=0x7fd60401cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9c5cede6c16b58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0c1c10 0x7f941c201b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c165800 0x7f941c160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c06d0b0 con 0x7f941c165800 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c2170 con 0x7f941c0cb690 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9424525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7a60 con 0x7f941c0c1c10 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- 172.21.15.73:0/1355699677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 msgr2=0x7fb1900c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 --2- 172.21.15.73:0/1355699677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb188009870 tx=0x7fb18801c440 comp rx=0 tx=0).stop 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5430003b00 con 0x7f54380af270 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42538/0 (socket says 172.21.15.73:42538) 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 -- 172.21.15.73:0/2483864257 learned_addr learned my addr 172.21.15.73:0/2483864257 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9422ac2640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c165800 0x7f941c160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- 172.21.15.73:0/1355699677 shutdown_connections 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 --2- 172.21.15.73:0/1355699677 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1900cbbd0 0x7fb1900c9500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 --2- 172.21.15.73:0/1355699677 >> v2:172.21.15.73:3300/0 conn(0x7fb19006a840 0x7fb190158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- 172.21.15.73:0/1355699677 >> 172.21.15.73:0/1355699677 conn(0x7fb190069d20 msgr2=0x7fb19006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- 172.21.15.73:0/1355699677 shutdown_connections 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 -- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0c1c10 msgr2=0x7f941c201b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0c1c10 0x7f941c201b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 -- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c165800 msgr2=0x7f941c160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c165800 0x7f941c160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 -- 172.21.15.73:0/2483864257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418009420 con 0x7f941c0cb690 2023-12-19T16:15:48.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- 172.21.15.73:0/1355699677 wait complete. 2023-12-19T16:15:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0af401e3b0 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f5426ffd640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 0x7f5418067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f9421ac0640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9418019090 tx=0x7f9418019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54300836f0 con 0x7f54380af270 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f543659c640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 0x7f5418067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f543659c640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 0x7f5418067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f542c007fd0 tx=0x7f542c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 Processor -- start 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f0ae3fff640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 0x7f0ae8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af4086260 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7f0afb7fe640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 0x7f0ae8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.453+0000 7fb19641f640 1 -- start start 2023-12-19T16:15:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040a5b80 con 0x7fd5f4003980 2023-12-19T16:15:48.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180b4600 con 0x7f941c0cb690 2023-12-19T16:15:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 Processor -- start 2023-12-19T16:15:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0c23c0 con 0x7f941c0cb690 2023-12-19T16:15:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c202060 con 0x7f941c0cb690 2023-12-19T16:15:48.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0af4057740 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 -- start start 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb19006a840 0x7fb1900c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 0x7fb190146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900c6fb0 con 0x7fb1900cbbd0 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1901591c0 con 0x7fb1900c90a0 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb19641f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb190159480 con 0x7fb19006a840 2023-12-19T16:15:48.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f0afb7fe640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 0x7f0ae8067ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00bdb0 tx=0x7f0aec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42542/0 (socket says 172.21.15.73:42542) 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 -- 172.21.15.73:0/4139551627 learned_addr learned my addr 172.21.15.73:0/4139551627 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb1949bc640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 0x7fb190146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 -- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb19006a840 msgr2=0x7fb1900c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb19006a840 0x7fb1900c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 -- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 msgr2=0x7fb190146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 0x7fb190146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 -- 172.21.15.73:0/4139551627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880094d0 con 0x7fb1900c90a0 2023-12-19T16:15:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb1949bc640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 0x7fb190146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c074050 con 0x7f941c0cb690 2023-12-19T16:15:48.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb18f7fe640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c550 tx=0x7fb18000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8a40cba40 0x7fb8a414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 0x7fb8a414e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b5ad0 con 0x7fb8a40cba40 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b4e50 con 0x7fb8a406cdb0 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8abe04640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40b5130 con 0x7fb8a41612e0 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42552/0 (socket says 172.21.15.73:42552) 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3830296763 learned_addr learned my addr 172.21.15.73:0/3830296763 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a939f640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8a40cba40 0x7fb8a414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8aa3a1640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 0x7fb8a414e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 msgr2=0x7fb8a414e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 0x7fb8a414e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8a40cba40 msgr2=0x7fb8a414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8a40cba40 0x7fb8a414dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8a9ba0640 1 -- 172.21.15.73:0/3830296763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894009420 con 0x7fb8a406cdb0 2023-12-19T16:15:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.457+0000 7fb8aa3a1640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 0x7fb8a414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb8a9ba0640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb8940b3040 tx=0x7fb89401b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94180abe40 con 0x7f941c0cb690 2023-12-19T16:15:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180012830 con 0x7fb1900c90a0 2023-12-19T16:15:48.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940b0ea0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1800129b0 con 0x7fb1900c90a0 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180012d60 con 0x7fb1900c90a0 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb190159760 con 0x7fb1900c90a0 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb190159d20 con 0x7fb1900c90a0 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040a5ce0 con 0x7fd5f4003980 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fd5fffff640 1 -- 172.21.15.73:0/837705655 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd604005b20 con 0x7fd5f4003980 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fd60e3a2640 1 -- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 msgr2=0x7fd5f4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 0x7fd5f4003d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd60400c260 tx=0x7fd60401cca0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40b5410 con 0x7fb8a406cdb0 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c8ae0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940b9410 con 0x7fb8a406cdb0 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940b97c0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180b4960 con 0x7f941c0cb690 2023-12-19T16:15:48.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.461+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174005260 con 0x7fb1900c90a0 2023-12-19T16:15:48.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fd60e3a2640 1 -- 172.21.15.73:0/837705655 shutdown_connections 2023-12-19T16:15:48.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/837705655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5f4003980 0x7fd5f4003d80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fd60e3a2640 1 -- 172.21.15.73:0/837705655 >> 172.21.15.73:0/837705655 conn(0x7fd60809bc10 msgr2=0x7fd6080d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54300510a0 con 0x7f54380af270 2023-12-19T16:15:48.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94180b2040 con 0x7f941c0cb690 2023-12-19T16:15:48.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fd60e3a2640 1 -- 172.21.15.73:0/837705655 shutdown_connections 2023-12-19T16:15:48.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fd60e3a2640 1 -- 172.21.15.73:0/837705655 wait complete. 2023-12-19T16:15:48.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c005260 con 0x7fb8a406cdb0 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f940effd640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 0x7f9400067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f941811d780 con 0x7f941c0cb690 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f94222c1640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 0x7f9400067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f94180eb110 con 0x7f941c0cb690 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.465+0000 7f94222c1640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 0x7f9400067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94100099f0 tx=0x7f9410009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 Processor -- start 2023-12-19T16:15:48.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb1800050d0 con 0x7fb1900c90a0 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 -- start start 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4003980 0x7fd60815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6080b38c0 0x7fd6080b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081644e0 con 0x7fd5f4003980 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b4280 con 0x7fd6080ca330 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fd60e3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60814d890 con 0x7fd6080b38c0 2023-12-19T16:15:48.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8940b7040 con 0x7fb8a406cdb0 2023-12-19T16:15:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb89a7fc640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb894121950 con 0x7fb8a406cdb0 2023-12-19T16:15:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb18cff9640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 0x7fb170067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.469+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb180083880 con 0x7fb1900c90a0 2023-12-19T16:15:48.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fb18ffff640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 0x7fb170067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60dba1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6080b38c0 0x7fd6080b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42564/0 (socket says 172.21.15.73:42564) 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 -- 172.21.15.73:0/1706869678 learned_addr learned my addr 172.21.15.73:0/1706869678 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fb8a939f640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 -- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6080b38c0 msgr2=0x7fd6080b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6080b38c0 0x7fd6080b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 -- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4003980 msgr2=0x7fd60815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4003980 0x7fd60815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 -- 172.21.15.73:0/1706869678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60815ea90 con 0x7fd6080ca330 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60cb9f640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e510 tx=0x7fd5f800e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fb8a939f640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 0x7fb888067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8a41f5ec0 tx=0x7fb89c005b80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb180051220 con 0x7fb1900c90a0 2023-12-19T16:15:48.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fb18ffff640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 0x7fb170067f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb1780070b0 tx=0x7fb178007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80052e0 con 0x7fd6080ca330 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8005460 con 0x7fd6080ca330 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8003840 con 0x7fd6080ca330 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080c9d80 con 0x7fd6080ca330 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.473+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60815e440 con 0x7fd6080ca330 2023-12-19T16:15:48.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.477+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60804e000 con 0x7fd6080ca330 2023-12-19T16:15:48.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.477+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb8940ef2f0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.477+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5f80039a0 con 0x7fd6080ca330 2023-12-19T16:15:48.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.481+0000 7fd5fdffb640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 0x7fd5ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:48.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.481+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5f8082fb0 con 0x7fd6080ca330 2023-12-19T16:15:48.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.481+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 0x7fd5ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:48.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.481+0000 7fd60d3a0640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 0x7fd5ec067f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6040ab000 tx=0x7fd604001940 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:48.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.481+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd5f80508d0 con 0x7fd6080ca330 2023-12-19T16:15:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.705+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe55c0c55f0 con 0x7fe548004d10 2023-12-19T16:15:48.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.705+0000 7fe552ffd640 1 -- 172.21.15.73:0/3546682250 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe558051230 con 0x7fe548004d10 2023-12-19T16:15:48.707 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:48.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fad6b16d640 1 -- 172.21.15.73:0/159497762 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad440057e0 con 0x7fad5c033e50 2023-12-19T16:15:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 msgr2=0x7fe540068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 0x7fe540068020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe55c154260 tx=0x7fe55400a040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 msgr2=0x7fe55c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 0x7fe55c0ceba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe558012880 tx=0x7fe558012d40 comp rx=0 tx=0).stop 2023-12-19T16:15:48.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 shutdown_connections 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe55c14b780 0x7fe55c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe540065b60 0x7fe540068020 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe55c0cd1e0 0x7fe55c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 --2- 172.21.15.73:0/3546682250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe548004d10 0x7fe55c0ceba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 >> 172.21.15.73:0/3546682250 conn(0x7fe55c069ef0 msgr2=0x7fe55c0cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 shutdown_connections 2023-12-19T16:15:48.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.709+0000 7fe5631df640 1 -- 172.21.15.73:0/3546682250 wait complete. 2023-12-19T16:15:48.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.713+0000 7fad617fa640 1 -- 172.21.15.73:0/159497762 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad58051890 con 0x7fad5c033e50 2023-12-19T16:15:48.718 INFO:teuthology.orchestra.run.smithi073.stdout:68719476742 2023-12-19T16:15:48.721 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.717+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 msgr2=0x7fad48067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.717+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 0x7fad48067f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fad500ae000 tx=0x7fad50004740 comp rx=0 tx=0).stop 2023-12-19T16:15:48.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.717+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 msgr2=0x7fad5c17f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.717+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad5800d7d0 tx=0x7fad5800dc90 comp rx=0 tx=0).stop 2023-12-19T16:15:48.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 shutdown_connections 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad5c048340 0x7fad5c0e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad48065ac0 0x7fad48067f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c047d10 0x7fad5c04bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 --2- 172.21.15.73:0/159497762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5c033e50 0x7fad5c17f8e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 >> 172.21.15.73:0/159497762 conn(0x7fad5c054c50 msgr2=0x7fad5c0eafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 shutdown_connections 2023-12-19T16:15:48.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.721+0000 7fad4effd640 1 -- 172.21.15.73:0/159497762 wait complete. 2023-12-19T16:15:48.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.1 2023-12-19T16:15:48.751 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2023-12-19T16:15:48.757 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0afc04e000 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae3fff640 1 -- 172.21.15.73:0/446863689 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0af401a020 con 0x7f0afc0b2cf0 2023-12-19T16:15:48.771 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2023-12-19T16:15:48.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 msgr2=0x7f0ae8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 0x7f0ae8067ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00bdb0 tx=0x7f0aec008040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 msgr2=0x7f0afc144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 0x7f0afc144d00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0afc0ce220 tx=0x7f0af4005aa0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 shutdown_connections 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0afc0b2cf0 0x7f0afc144d00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0ae8065b30 0x7f0ae8067ff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0afc0b2330 0x7f0afc0b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 --2- 172.21.15.73:0/446863689 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ae40069e0 0x7f0afc1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 >> 172.21.15.73:0/446863689 conn(0x7f0afc0b0020 msgr2=0x7f0afc156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 shutdown_connections 2023-12-19T16:15:48.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.769+0000 7f0ae1ffb640 1 -- 172.21.15.73:0/446863689 wait complete. 2023-12-19T16:15:48.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.777+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd60815ec20 con 0x7fd6080ca330 2023-12-19T16:15:48.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd5fdffb640 1 -- 172.21.15.73:0/1706869678 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5f8053ef0 con 0x7fd6080ca330 2023-12-19T16:15:48.783 INFO:teuthology.orchestra.run.smithi073.stdout:60129542151 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 msgr2=0x7fd5ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 0x7fd5ec067f50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd6040ab000 tx=0x7fd604001940 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 msgr2=0x7fd6080ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800e510 tx=0x7fd5f800e9d0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 shutdown_connections 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6080b38c0 0x7fd6080b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6080ca330 0x7fd6080ca7b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5ec065a90 0x7fd5ec067f50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 --2- 172.21.15.73:0/1706869678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5f4003980 0x7fd60815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 >> 172.21.15.73:0/1706869678 conn(0x7fd60809bc10 msgr2=0x7fd6080b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 shutdown_connections 2023-12-19T16:15:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.781+0000 7fd60e3a2640 1 -- 172.21.15.73:0/1706869678 wait complete. 2023-12-19T16:15:48.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2023-12-19T16:15:48.797 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.793+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54380b4490 con 0x7f54380af270 2023-12-19T16:15:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f5426ffd640 1 -- 172.21.15.73:0/596185279 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54300546c0 con 0x7f54380af270 2023-12-19T16:15:48.799 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 msgr2=0x7f5418067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 0x7f5418067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f542c007fd0 tx=0x7f542c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 msgr2=0x7f54380af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 0x7f54380af6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f543806ac40 tx=0x7f54300115a0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 shutdown_connections 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54380af270 0x7f54380af6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5438159240 0x7f543814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5418065a60 0x7f5418067f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 --2- 172.21.15.73:0/596185279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54200047d0 0x7f54380c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 >> 172.21.15.73:0/596185279 conn(0x7f5438069d20 msgr2=0x7f54380adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 shutdown_connections 2023-12-19T16:15:48.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.797+0000 7f543cac4640 1 -- 172.21.15.73:0/596185279 wait complete. 2023-12-19T16:15:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1740057e0 con 0x7fb1900c90a0 2023-12-19T16:15:48.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2023-12-19T16:15:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb88c0057e0 con 0x7fb8a406cdb0 2023-12-19T16:15:48.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7fb18cff9640 1 -- 172.21.15.73:0/4139551627 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb180016090 con 0x7fb1900c90a0 2023-12-19T16:15:48.809 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.809 INFO:teuthology.orchestra.run.smithi073.stdout:64424509448 2023-12-19T16:15:48.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7fb89a7fc640 1 -- 172.21.15.73:0/3830296763 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8940b5090 con 0x7fb8a406cdb0 2023-12-19T16:15:48.810 INFO:teuthology.orchestra.run.smithi073.stdout:68719476743 2023-12-19T16:15:48.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f941c0c2870 con 0x7f941c0cb690 2023-12-19T16:15:48.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.805+0000 7f940effd640 1 -- 172.21.15.73:0/2483864257 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94180b0090 con 0x7f941c0cb690 2023-12-19T16:15:48.811 INFO:teuthology.orchestra.run.smithi073.stdout:64424509447 2023-12-19T16:15:48.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 msgr2=0x7fb888067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 0x7fb888067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8a41f5ec0 tx=0x7fb89c005b80 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 msgr2=0x7fb8a40c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb8940b3040 tx=0x7fb89401b9f0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 shutdown_connections 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8a41612e0 0x7fb8a414e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb888065a60 0x7fb888067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8a40cba40 0x7fb8a414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 --2- 172.21.15.73:0/3830296763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8a406cdb0 0x7fb8a40c85a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 >> 172.21.15.73:0/3830296763 conn(0x7fb8a40b0270 msgr2=0x7fb8a41605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 shutdown_connections 2023-12-19T16:15:48.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb8abe04640 1 -- 172.21.15.73:0/3830296763 wait complete. 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 msgr2=0x7fb170067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 0x7fb170067f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb1780070b0 tx=0x7fb178007040 comp rx=0 tx=0).stop 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 msgr2=0x7fb1900c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c550 tx=0x7fb18000ca10 comp rx=0 tx=0).stop 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 shutdown_connections 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb170065a60 0x7fb170067f20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1900cbbd0 0x7fb190146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1900c90a0 0x7fb1900c6a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 --2- 172.21.15.73:0/4139551627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb19006a840 0x7fb1900c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 >> 172.21.15.73:0/4139551627 conn(0x7fb190069d20 msgr2=0x7fb1901563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 msgr2=0x7f9400067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 0x7f9400067f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94100099f0 tx=0x7f9410009190 comp rx=0 tx=0).stop 2023-12-19T16:15:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 shutdown_connections 2023-12-19T16:15:48.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 msgr2=0x7f941c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9418019090 tx=0x7f9418019220 comp rx=0 tx=0).stop 2023-12-19T16:15:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7fb19641f640 1 -- 172.21.15.73:0/4139551627 wait complete. 2023-12-19T16:15:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 shutdown_connections 2023-12-19T16:15:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9400065a60 0x7f9400067f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c165800 0x7f941c160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0cb690 0x7f941c160030 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 --2- 172.21.15.73:0/2483864257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0c1c10 0x7f941c201b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 >> 172.21.15.73:0/2483864257 conn(0x7f941c0b0270 msgr2=0x7f941c15d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 shutdown_connections 2023-12-19T16:15:48.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:48.809+0000 7f9424525640 1 -- 172.21.15.73:0/2483864257 wait complete. 2023-12-19T16:15:48.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.3 2023-12-19T16:15:48.835 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2023-12-19T16:15:48.837 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.5 2023-12-19T16:15:48.840 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476743 got 68719476743 for osd.2 2023-12-19T16:15:48.843 DEBUG:teuthology.parallel:result is None 2023-12-19T16:15:48.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T16:15:48.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:49.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.017+0000 7fa251725640 1 Processor -- start 2023-12-19T16:15:49.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.017+0000 7fa251725640 1 -- start start 2023-12-19T16:15:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa251725640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa24c0cb860 0x7fa24c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa251725640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c165800 0x7fa24c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa251725640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c0cc4b0 con 0x7fa24c0c1c10 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa251725640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c165d70 con 0x7fa24c0cb860 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa251725640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0cc790 con 0x7fa24c165800 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa24affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa24c0c1c10 0x7fa24c0cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56654/0 (socket says 172.21.15.73:56654) 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa24affd640 1 -- 172.21.15.73:0/1977691678 learned_addr learned my addr 172.21.15.73:0/1977691678 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa2427fc640 1 --2- 172.21.15.73:0/1977691678 >> v2:172.21.15.162:3300/0 conn(0x7fa24c0cb860 0x7fa24c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa24b7fe640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c165800 0x7fa24c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa24a7fc640 1 -- 172.21.15.73:0/1977691678 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438485914 0 0) 0x7fa24c0cc4b0 con 0x7fa24c0c1c10 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa24a7fc640 1 -- 172.21.15.73:0/1977691678 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa238003530 con 0x7fa24c0c1c10 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa2427fc640 1 -- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c165800 msgr2=0x7fa24c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa2427fc640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c165800 0x7fa24c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa2427fc640 1 -- 172.21.15.73:0/1977691678 >> v1:172.21.15.73:6789/0 conn(0x7fa24c0c1c10 legacy=0x7fa24c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.021+0000 7fa2427fc640 1 -- 172.21.15.73:0/1977691678 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0cca70 con 0x7fa24c0cb860 2023-12-19T16:15:49.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa2427fc640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c0adc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa234009d90 tx=0x7fa23401d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2879cb51063fe53b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa24a7fc640 1 -- 172.21.15.73:0/1977691678 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340a5920 con 0x7fa24c0cb860 2023-12-19T16:15:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa24a7fc640 1 -- 172.21.15.73:0/1977691678 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340a5a80 con 0x7fa24c0cb860 2023-12-19T16:15:49.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa24a7fc640 1 -- 172.21.15.73:0/1977691678 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340a5e10 con 0x7fa24c0cb860 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 -- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 msgr2=0x7fa24c0adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c0adc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa234009d90 tx=0x7fa23401d3b0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 -- 172.21.15.73:0/1977691678 shutdown_connections 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c165800 0x7fa24c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 --2- 172.21.15.73:0/1977691678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c0adc90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 -- 172.21.15.73:0/1977691678 >> 172.21.15.73:0/1977691678 conn(0x7fa24c0b0270 msgr2=0x7fa24c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 -- 172.21.15.73:0/1977691678 shutdown_connections 2023-12-19T16:15:49.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 -- 172.21.15.73:0/1977691678 wait complete. 2023-12-19T16:15:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.025+0000 7fa251725640 1 Processor -- start 2023-12-19T16:15:49.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- start start 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c0c1c10 0x7fa24c15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c15c260 con 0x7fa24c165800 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c15c540 con 0x7fa24c0cb860 2023-12-19T16:15:49.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c15c820 con 0x7fa24c0c1c10 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39224/0 (socket says 172.21.15.73:39224) 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 -- 172.21.15.73:0/528210903 learned_addr learned my addr 172.21.15.73:0/528210903 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa2427fc640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24affd640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c0c1c10 0x7fa24c15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 -- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c0c1c10 msgr2=0x7fa24c15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c0c1c10 0x7fa24c15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 -- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 msgr2=0x7fa24c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 -- 172.21.15.73:0/528210903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009a70 con 0x7fa24c165800 2023-12-19T16:15:49.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa2427fc640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa24b7fe640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e7f0 tx=0x7fa24400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244009530 con 0x7fa24c165800 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400eea0 con 0x7fa24c165800 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c15cb00 con 0x7fa24c165800 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400cb60 con 0x7fa24c165800 2023-12-19T16:15:49.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c0b1b00 con 0x7fa24c165800 2023-12-19T16:15:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.029+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c074050 con 0x7fa24c165800 2023-12-19T16:15:49.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.033+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa24400ccc0 con 0x7fa24c165800 2023-12-19T16:15:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.033+0000 7fa243fff640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 0x7fa22c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.033+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa244083220 con 0x7fa24c165800 2023-12-19T16:15:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.033+0000 7fa24affd640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 0x7fa22c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.033+0000 7fa24affd640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 0x7fa22c067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005890 tx=0x7fa23c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.037+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa244050bd0 con 0x7fa24c165800 2023-12-19T16:15:49.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.181+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa24c0ca900 con 0x7fa22c065a60 2023-12-19T16:15:49.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.189+0000 7fa243fff640 1 -- 172.21.15.73:0/528210903 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264500 (secure 0 0 0) 0x7fa23c001400 con 0x7fa22c065a60 2023-12-19T16:15:49.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:49.198 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 msgr2=0x7fa22c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 0x7fa22c067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005890 tx=0x7fa23c009040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 msgr2=0x7fa24c161f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24400e7f0 tx=0x7fa24400ecb0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 shutdown_connections 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa22c065a60 0x7fa22c067f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa24c165800 0x7fa24c161f50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa24c0cb860 0x7fa24c161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 --2- 172.21.15.73:0/528210903 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa24c0c1c10 0x7fa24c15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 >> 172.21.15.73:0/528210903 conn(0x7fa24c0b0270 msgr2=0x7fa24c0cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 shutdown_connections 2023-12-19T16:15:49.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.193+0000 7fa251725640 1 -- 172.21.15.73:0/528210903 wait complete. 2023-12-19T16:15:49.216 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-12-19T16:15:48.448820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":3088384,"data_stored":1823788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005381"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196525+0000","last_change":"2023-12-19T16:15:40.564959+0000","last_active":"2023-12-19T16:15:42.196525+0000","last_peered":"2023-12-19T16:15:42.196525+0000","last_clean":"2023-12-19T16:15:42.196525+0000","last_became_active":"2023-12-19T16:15:40.564702+0000","last_became_peered":"2023-12-19T16:15:40.564702+0000","last_unstale":"2023-12-19T16:15:42.196525+0000","last_undegraded":"2023-12-19T16:15:42.196525+0000","last_fullsized":"2023-12-19T16:15:42.196525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195250+0000","last_change":"2023-12-19T16:15:40.576480+0000","last_active":"2023-12-19T16:15:42.195250+0000","last_peered":"2023-12-19T16:15:42.195250+0000","last_clean":"2023-12-19T16:15:42.195250+0000","last_became_active":"2023-12-19T16:15:40.574311+0000","last_became_peered":"2023-12-19T16:15:40.574311+0000","last_unstale":"2023-12-19T16:15:42.195250+0000","last_undegraded":"2023-12-19T16:15:42.195250+0000","last_fullsized":"2023-12-19T16:15:42.195250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195258+0000","last_change":"2023-12-19T16:15:40.573376+0000","last_active":"2023-12-19T16:15:42.195258+0000","last_peered":"2023-12-19T16:15:42.195258+0000","last_clean":"2023-12-19T16:15:42.195258+0000","last_became_active":"2023-12-19T16:15:40.573039+0000","last_became_peered":"2023-12-19T16:15:40.573039+0000","last_unstale":"2023-12-19T16:15:42.195258+0000","last_undegraded":"2023-12-19T16:15:42.195258+0000","last_fullsized":"2023-12-19T16:15:42.195258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541887+0000","last_change":"2023-12-19T16:15:40.564321+0000","last_active":"2023-12-19T16:15:41.541887+0000","last_peered":"2023-12-19T16:15:41.541887+0000","last_clean":"2023-12-19T16:15:41.541887+0000","last_became_active":"2023-12-19T16:15:40.564109+0000","last_became_peered":"2023-12-19T16:15:40.564109+0000","last_unstale":"2023-12-19T16:15:41.541887+0000","last_undegraded":"2023-12-19T16:15:41.541887+0000","last_fullsized":"2023-12-19T16:15:41.541887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:43.388901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196365+0000","last_change":"2023-12-19T16:15:40.573886+0000","last_active":"2023-12-19T16:15:42.196365+0000","last_peered":"2023-12-19T16:15:42.196365+0000","last_clean":"2023-12-19T16:15:42.196365+0000","last_became_active":"2023-12-19T16:15:40.573554+0000","last_became_peered":"2023-12-19T16:15:40.573554+0000","last_unstale":"2023-12-19T16:15:42.196365+0000","last_undegraded":"2023-12-19T16:15:42.196365+0000","last_fullsized":"2023-12-19T16:15:42.196365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541688+0000","last_change":"2023-12-19T16:15:40.565954+0000","last_active":"2023-12-19T16:15:41.541688+0000","last_peered":"2023-12-19T16:15:41.541688+0000","last_clean":"2023-12-19T16:15:41.541688+0000","last_became_active":"2023-12-19T16:15:40.563221+0000","last_became_peered":"2023-12-19T16:15:40.563221+0000","last_unstale":"2023-12-19T16:15:41.541688+0000","last_undegraded":"2023-12-19T16:15:41.541688+0000","last_fullsized":"2023-12-19T16:15:41.541688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196120+0000","last_change":"2023-12-19T16:15:40.551369+0000","last_active":"2023-12-19T16:15:42.196120+0000","last_peered":"2023-12-19T16:15:42.196120+0000","last_clean":"2023-12-19T16:15:42.196120+0000","last_became_active":"2023-12-19T16:15:40.551122+0000","last_became_peered":"2023-12-19T16:15:40.551122+0000","last_unstale":"2023-12-19T16:15:42.196120+0000","last_undegraded":"2023-12-19T16:15:42.196120+0000","last_fullsized":"2023-12-19T16:15:42.196120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195380+0000","last_change":"2023-12-19T16:15:40.568549+0000","last_active":"2023-12-19T16:15:42.195380+0000","last_peered":"2023-12-19T16:15:42.195380+0000","last_clean":"2023-12-19T16:15:42.195380+0000","last_became_active":"2023-12-19T16:15:40.567804+0000","last_became_peered":"2023-12-19T16:15:40.567804+0000","last_unstale":"2023-12-19T16:15:42.195380+0000","last_undegraded":"2023-12-19T16:15:42.195380+0000","last_fullsized":"2023-12-19T16:15:42.195380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196432+0000","last_change":"2023-12-19T16:15:40.542905+0000","last_active":"2023-12-19T16:15:42.196432+0000","last_peered":"2023-12-19T16:15:42.196432+0000","last_clean":"2023-12-19T16:15:42.196432+0000","last_became_active":"2023-12-19T16:15:40.542177+0000","last_became_peered":"2023-12-19T16:15:40.542177+0000","last_unstale":"2023-12-19T16:15:42.196432+0000","last_undegraded":"2023-12-19T16:15:42.196432+0000","last_fullsized":"2023-12-19T16:15:42.196432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196704+0000","last_change":"2023-12-19T16:15:40.554175+0000","last_active":"2023-12-19T16:15:42.196704+0000","last_peered":"2023-12-19T16:15:42.196704+0000","last_clean":"2023-12-19T16:15:42.196704+0000","last_became_active":"2023-12-19T16:15:40.553928+0000","last_became_peered":"2023-12-19T16:15:40.553928+0000","last_unstale":"2023-12-19T16:15:42.196704+0000","last_undegraded":"2023-12-19T16:15:42.196704+0000","last_fullsized":"2023-12-19T16:15:42.196704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196135+0000","last_change":"2023-12-19T16:15:40.566546+0000","last_active":"2023-12-19T16:15:42.196135+0000","last_peered":"2023-12-19T16:15:42.196135+0000","last_clean":"2023-12-19T16:15:42.196135+0000","last_became_active":"2023-12-19T16:15:40.566340+0000","last_became_peered":"2023-12-19T16:15:40.566340+0000","last_unstale":"2023-12-19T16:15:42.196135+0000","last_undegraded":"2023-12-19T16:15:42.196135+0000","last_fullsized":"2023-12-19T16:15:42.196135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196623+0000","last_change":"2023-12-19T16:15:40.556322+0000","last_active":"2023-12-19T16:15:42.196623+0000","last_peered":"2023-12-19T16:15:42.196623+0000","last_clean":"2023-12-19T16:15:42.196623+0000","last_became_active":"2023-12-19T16:15:40.555847+0000","last_became_peered":"2023-12-19T16:15:40.555847+0000","last_unstale":"2023-12-19T16:15:42.196623+0000","last_undegraded":"2023-12-19T16:15:42.196623+0000","last_fullsized":"2023-12-19T16:15:42.196623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195837+0000","last_change":"2023-12-19T16:15:40.554846+0000","last_active":"2023-12-19T16:15:42.195837+0000","last_peered":"2023-12-19T16:15:42.195837+0000","last_clean":"2023-12-19T16:15:42.195837+0000","last_became_active":"2023-12-19T16:15:40.554558+0000","last_became_peered":"2023-12-19T16:15:40.554558+0000","last_unstale":"2023-12-19T16:15:42.195837+0000","last_undegraded":"2023-12-19T16:15:42.195837+0000","last_fullsized":"2023-12-19T16:15:42.195837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195005+0000","last_change":"2023-12-19T16:15:40.556072+0000","last_active":"2023-12-19T16:15:42.195005+0000","last_peered":"2023-12-19T16:15:42.195005+0000","last_clean":"2023-12-19T16:15:42.195005+0000","last_became_active":"2023-12-19T16:15:40.555805+0000","last_became_peered":"2023-12-19T16:15:40.555805+0000","last_unstale":"2023-12-19T16:15:42.195005+0000","last_undegraded":"2023-12-19T16:15:42.195005+0000","last_fullsized":"2023-12-19T16:15:42.195005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195192+0000","last_change":"2023-12-19T16:15:40.572960+0000","last_active":"2023-12-19T16:15:42.195192+0000","last_peered":"2023-12-19T16:15:42.195192+0000","last_clean":"2023-12-19T16:15:42.195192+0000","last_became_active":"2023-12-19T16:15:40.572640+0000","last_became_peered":"2023-12-19T16:15:40.572640+0000","last_unstale":"2023-12-19T16:15:42.195192+0000","last_undegraded":"2023-12-19T16:15:42.195192+0000","last_fullsized":"2023-12-19T16:15:42.195192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774645+0000","last_change":"2023-12-19T16:15:40.554309+0000","last_active":"2023-12-19T16:15:41.774645+0000","last_peered":"2023-12-19T16:15:41.774645+0000","last_clean":"2023-12-19T16:15:41.774645+0000","last_became_active":"2023-12-19T16:15:40.552766+0000","last_became_peered":"2023-12-19T16:15:40.552766+0000","last_unstale":"2023-12-19T16:15:41.774645+0000","last_undegraded":"2023-12-19T16:15:41.774645+0000","last_fullsized":"2023-12-19T16:15:41.774645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775218+0000","last_change":"2023-12-19T16:15:40.553698+0000","last_active":"2023-12-19T16:15:41.775218+0000","last_peered":"2023-12-19T16:15:41.775218+0000","last_clean":"2023-12-19T16:15:41.775218+0000","last_became_active":"2023-12-19T16:15:40.553379+0000","last_became_peered":"2023-12-19T16:15:40.553379+0000","last_unstale":"2023-12-19T16:15:41.775218+0000","last_undegraded":"2023-12-19T16:15:41.775218+0000","last_fullsized":"2023-12-19T16:15:41.775218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:16.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544284+0000","last_change":"2023-12-19T16:15:40.556547+0000","last_active":"2023-12-19T16:15:41.544284+0000","last_peered":"2023-12-19T16:15:41.544284+0000","last_clean":"2023-12-19T16:15:41.544284+0000","last_became_active":"2023-12-19T16:15:40.555905+0000","last_became_peered":"2023-12-19T16:15:40.555905+0000","last_unstale":"2023-12-19T16:15:41.544284+0000","last_undegraded":"2023-12-19T16:15:41.544284+0000","last_fullsized":"2023-12-19T16:15:41.544284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775141+0000","last_change":"2023-12-19T16:15:40.560248+0000","last_active":"2023-12-19T16:15:41.775141+0000","last_peered":"2023-12-19T16:15:41.775141+0000","last_clean":"2023-12-19T16:15:41.775141+0000","last_became_active":"2023-12-19T16:15:40.548053+0000","last_became_peered":"2023-12-19T16:15:40.548053+0000","last_unstale":"2023-12-19T16:15:41.775141+0000","last_undegraded":"2023-12-19T16:15:41.775141+0000","last_fullsized":"2023-12-19T16:15:41.775141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:42.987632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196292+0000","last_change":"2023-12-19T16:15:40.556318+0000","last_active":"2023-12-19T16:15:42.196292+0000","last_peered":"2023-12-19T16:15:42.196292+0000","last_clean":"2023-12-19T16:15:42.196292+0000","last_became_active":"2023-12-19T16:15:40.555536+0000","last_became_peered":"2023-12-19T16:15:40.555536+0000","last_unstale":"2023-12-19T16:15:42.196292+0000","last_undegraded":"2023-12-19T16:15:42.196292+0000","last_fullsized":"2023-12-19T16:15:42.196292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461722+0000","last_change":"2023-12-19T16:15:40.552448+0000","last_active":"2023-12-19T16:15:41.461722+0000","last_peered":"2023-12-19T16:15:41.461722+0000","last_clean":"2023-12-19T16:15:41.461722+0000","last_became_active":"2023-12-19T16:15:40.552127+0000","last_became_peered":"2023-12-19T16:15:40.552127+0000","last_unstale":"2023-12-19T16:15:41.461722+0000","last_undegraded":"2023-12-19T16:15:41.461722+0000","last_fullsized":"2023-12-19T16:15:41.461722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:33.400230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195779+0000","last_change":"2023-12-19T16:15:40.549822+0000","last_active":"2023-12-19T16:15:42.195779+0000","last_peered":"2023-12-19T16:15:42.195779+0000","last_clean":"2023-12-19T16:15:42.195779+0000","last_became_active":"2023-12-19T16:15:40.548780+0000","last_became_peered":"2023-12-19T16:15:40.548780+0000","last_unstale":"2023-12-19T16:15:42.195779+0000","last_undegraded":"2023-12-19T16:15:42.195779+0000","last_fullsized":"2023-12-19T16:15:42.195779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:41.432356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195237+0000","last_change":"2023-12-19T16:15:40.569571+0000","last_active":"2023-12-19T16:15:42.195237+0000","last_peered":"2023-12-19T16:15:42.195237+0000","last_clean":"2023-12-19T16:15:42.195237+0000","last_became_active":"2023-12-19T16:15:40.566982+0000","last_became_peered":"2023-12-19T16:15:40.566982+0000","last_unstale":"2023-12-19T16:15:42.195237+0000","last_undegraded":"2023-12-19T16:15:42.195237+0000","last_fullsized":"2023-12-19T16:15:42.195237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.569324+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.568945+0000","last_became_peered":"2023-12-19T16:15:40.568945+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:04.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195417+0000","last_change":"2023-12-19T16:15:40.573746+0000","last_active":"2023-12-19T16:15:42.195417+0000","last_peered":"2023-12-19T16:15:42.195417+0000","last_clean":"2023-12-19T16:15:42.195417+0000","last_became_active":"2023-12-19T16:15:40.573442+0000","last_became_peered":"2023-12-19T16:15:40.573442+0000","last_unstale":"2023-12-19T16:15:42.195417+0000","last_undegraded":"2023-12-19T16:15:42.195417+0000","last_fullsized":"2023-12-19T16:15:42.195417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542041+0000","last_change":"2023-12-19T16:15:40.566429+0000","last_active":"2023-12-19T16:15:41.542041+0000","last_peered":"2023-12-19T16:15:41.542041+0000","last_clean":"2023-12-19T16:15:41.542041+0000","last_became_active":"2023-12-19T16:15:40.565983+0000","last_became_peered":"2023-12-19T16:15:40.565983+0000","last_unstale":"2023-12-19T16:15:41.542041+0000","last_undegraded":"2023-12-19T16:15:41.542041+0000","last_fullsized":"2023-12-19T16:15:41.542041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195908+0000","last_change":"2023-12-19T16:15:40.565357+0000","last_active":"2023-12-19T16:15:42.195908+0000","last_peered":"2023-12-19T16:15:42.195908+0000","last_clean":"2023-12-19T16:15:42.195908+0000","last_became_active":"2023-12-19T16:15:40.565074+0000","last_became_peered":"2023-12-19T16:15:40.565074+0000","last_unstale":"2023-12-19T16:15:42.195908+0000","last_undegraded":"2023-12-19T16:15:42.195908+0000","last_fullsized":"2023-12-19T16:15:42.195908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195836+0000","last_change":"2023-12-19T16:15:40.555405+0000","last_active":"2023-12-19T16:15:42.195836+0000","last_peered":"2023-12-19T16:15:42.195836+0000","last_clean":"2023-12-19T16:15:42.195836+0000","last_became_active":"2023-12-19T16:15:40.555000+0000","last_became_peered":"2023-12-19T16:15:40.555000+0000","last_unstale":"2023-12-19T16:15:42.195836+0000","last_undegraded":"2023-12-19T16:15:42.195836+0000","last_fullsized":"2023-12-19T16:15:42.195836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:06.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195687+0000","last_change":"2023-12-19T16:15:40.573526+0000","last_active":"2023-12-19T16:15:42.195687+0000","last_peered":"2023-12-19T16:15:42.195687+0000","last_clean":"2023-12-19T16:15:42.195687+0000","last_became_active":"2023-12-19T16:15:40.572779+0000","last_became_peered":"2023-12-19T16:15:40.572779+0000","last_unstale":"2023-12-19T16:15:42.195687+0000","last_undegraded":"2023-12-19T16:15:42.195687+0000","last_fullsized":"2023-12-19T16:15:42.195687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:37.149682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774761+0000","last_change":"2023-12-19T16:15:40.574985+0000","last_active":"2023-12-19T16:15:41.774761+0000","last_peered":"2023-12-19T16:15:41.774761+0000","last_clean":"2023-12-19T16:15:41.774761+0000","last_became_active":"2023-12-19T16:15:40.574724+0000","last_became_peered":"2023-12-19T16:15:40.574724+0000","last_unstale":"2023-12-19T16:15:41.774761+0000","last_undegraded":"2023-12-19T16:15:41.774761+0000","last_fullsized":"2023-12-19T16:15:41.774761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:41.216724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543806+0000","last_change":"2023-12-19T16:15:40.550561+0000","last_active":"2023-12-19T16:15:41.543806+0000","last_peered":"2023-12-19T16:15:41.543806+0000","last_clean":"2023-12-19T16:15:41.543806+0000","last_became_active":"2023-12-19T16:15:40.549817+0000","last_became_peered":"2023-12-19T16:15:40.549817+0000","last_unstale":"2023-12-19T16:15:41.543806+0000","last_undegraded":"2023-12-19T16:15:41.543806+0000","last_fullsized":"2023-12-19T16:15:41.543806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541700+0000","last_change":"2023-12-19T16:15:40.559294+0000","last_active":"2023-12-19T16:15:41.541700+0000","last_peered":"2023-12-19T16:15:41.541700+0000","last_clean":"2023-12-19T16:15:41.541700+0000","last_became_active":"2023-12-19T16:15:40.559007+0000","last_became_peered":"2023-12-19T16:15:40.559007+0000","last_unstale":"2023-12-19T16:15:41.541700+0000","last_undegraded":"2023-12-19T16:15:41.541700+0000","last_fullsized":"2023-12-19T16:15:41.541700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195827+0000","last_change":"2023-12-19T16:15:40.574997+0000","last_active":"2023-12-19T16:15:42.195827+0000","last_peered":"2023-12-19T16:15:42.195827+0000","last_clean":"2023-12-19T16:15:42.195827+0000","last_became_active":"2023-12-19T16:15:40.574713+0000","last_became_peered":"2023-12-19T16:15:40.574713+0000","last_unstale":"2023-12-19T16:15:42.195827+0000","last_undegraded":"2023-12-19T16:15:42.195827+0000","last_fullsized":"2023-12-19T16:15:42.195827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195918+0000","last_change":"2023-12-19T16:15:40.161104+0000","last_active":"2023-12-19T16:15:42.195918+0000","last_peered":"2023-12-19T16:15:42.195918+0000","last_clean":"2023-12-19T16:15:42.195918+0000","last_became_active":"2023-12-19T16:15:40.160769+0000","last_became_peered":"2023-12-19T16:15:40.160769+0000","last_unstale":"2023-12-19T16:15:42.195918+0000","last_undegraded":"2023-12-19T16:15:42.195918+0000","last_fullsized":"2023-12-19T16:15:42.195918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461732+0000","last_change":"2023-12-19T16:15:40.549947+0000","last_active":"2023-12-19T16:15:41.461732+0000","last_peered":"2023-12-19T16:15:41.461732+0000","last_clean":"2023-12-19T16:15:41.461732+0000","last_became_active":"2023-12-19T16:15:40.548174+0000","last_became_peered":"2023-12-19T16:15:40.548174+0000","last_unstale":"2023-12-19T16:15:41.461732+0000","last_undegraded":"2023-12-19T16:15:41.461732+0000","last_fullsized":"2023-12-19T16:15:41.461732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:13.136180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774874+0000","last_change":"2023-12-19T16:15:40.171997+0000","last_active":"2023-12-19T16:15:41.774874+0000","last_peered":"2023-12-19T16:15:41.774874+0000","last_clean":"2023-12-19T16:15:41.774874+0000","last_became_active":"2023-12-19T16:15:40.171706+0000","last_became_peered":"2023-12-19T16:15:40.171706+0000","last_unstale":"2023-12-19T16:15:41.774874+0000","last_undegraded":"2023-12-19T16:15:41.774874+0000","last_fullsized":"2023-12-19T16:15:41.774874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:04.965195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194944+0000","last_change":"2023-12-19T16:15:40.153875+0000","last_active":"2023-12-19T16:15:42.194944+0000","last_peered":"2023-12-19T16:15:42.194944+0000","last_clean":"2023-12-19T16:15:42.194944+0000","last_became_active":"2023-12-19T16:15:40.153373+0000","last_became_peered":"2023-12-19T16:15:40.153373+0000","last_unstale":"2023-12-19T16:15:42.194944+0000","last_undegraded":"2023-12-19T16:15:42.194944+0000","last_fullsized":"2023-12-19T16:15:42.194944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.568164+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.567046+0000","last_became_peered":"2023-12-19T16:15:40.567046+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774782+0000","last_change":"2023-12-19T16:15:40.167038+0000","last_active":"2023-12-19T16:15:41.774782+0000","last_peered":"2023-12-19T16:15:41.774782+0000","last_clean":"2023-12-19T16:15:41.774782+0000","last_became_active":"2023-12-19T16:15:40.166736+0000","last_became_peered":"2023-12-19T16:15:40.166736+0000","last_unstale":"2023-12-19T16:15:41.774782+0000","last_undegraded":"2023-12-19T16:15:41.774782+0000","last_fullsized":"2023-12-19T16:15:41.774782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:33.645727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461671+0000","last_change":"2023-12-19T16:15:40.544723+0000","last_active":"2023-12-19T16:15:41.461671+0000","last_peered":"2023-12-19T16:15:41.461671+0000","last_clean":"2023-12-19T16:15:41.461671+0000","last_became_active":"2023-12-19T16:15:40.543779+0000","last_became_peered":"2023-12-19T16:15:40.543779+0000","last_unstale":"2023-12-19T16:15:41.461671+0000","last_undegraded":"2023-12-19T16:15:41.461671+0000","last_fullsized":"2023-12-19T16:15:41.461671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:36:03.153648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.151962+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.151615+0000","last_became_peered":"2023-12-19T16:15:40.151615+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542009+0000","last_change":"2023-12-19T16:15:40.565718+0000","last_active":"2023-12-19T16:15:41.542009+0000","last_peered":"2023-12-19T16:15:41.542009+0000","last_clean":"2023-12-19T16:15:41.542009+0000","last_became_active":"2023-12-19T16:15:40.565454+0000","last_became_peered":"2023-12-19T16:15:40.565454+0000","last_unstale":"2023-12-19T16:15:41.542009+0000","last_undegraded":"2023-12-19T16:15:41.542009+0000","last_fullsized":"2023-12-19T16:15:41.542009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.166745+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.166441+0000","last_became_peered":"2023-12-19T16:15:40.166441+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:18.251526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195536+0000","last_change":"2023-12-19T16:15:40.572844+0000","last_active":"2023-12-19T16:15:42.195536+0000","last_peered":"2023-12-19T16:15:42.195536+0000","last_clean":"2023-12-19T16:15:42.195536+0000","last_became_active":"2023-12-19T16:15:40.572602+0000","last_became_peered":"2023-12-19T16:15:40.572602+0000","last_unstale":"2023-12-19T16:15:42.195536+0000","last_undegraded":"2023-12-19T16:15:42.195536+0000","last_fullsized":"2023-12-19T16:15:42.195536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544172+0000","last_change":"2023-12-19T16:15:40.154528+0000","last_active":"2023-12-19T16:15:41.544172+0000","last_peered":"2023-12-19T16:15:41.544172+0000","last_clean":"2023-12-19T16:15:41.544172+0000","last_became_active":"2023-12-19T16:15:40.154244+0000","last_became_peered":"2023-12-19T16:15:40.154244+0000","last_unstale":"2023-12-19T16:15:41.544172+0000","last_undegraded":"2023-12-19T16:15:41.544172+0000","last_fullsized":"2023-12-19T16:15:41.544172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774964+0000","last_change":"2023-12-19T16:15:40.553550+0000","last_active":"2023-12-19T16:15:41.774964+0000","last_peered":"2023-12-19T16:15:41.774964+0000","last_clean":"2023-12-19T16:15:41.774964+0000","last_became_active":"2023-12-19T16:15:40.553276+0000","last_became_peered":"2023-12-19T16:15:40.553276+0000","last_unstale":"2023-12-19T16:15:41.774964+0000","last_undegraded":"2023-12-19T16:15:41.774964+0000","last_fullsized":"2023-12-19T16:15:41.774964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541934+0000","last_change":"2023-12-19T16:15:40.156756+0000","last_active":"2023-12-19T16:15:41.541934+0000","last_peered":"2023-12-19T16:15:41.541934+0000","last_clean":"2023-12-19T16:15:41.541934+0000","last_became_active":"2023-12-19T16:15:40.155859+0000","last_became_peered":"2023-12-19T16:15:40.155859+0000","last_unstale":"2023-12-19T16:15:41.541934+0000","last_undegraded":"2023-12-19T16:15:41.541934+0000","last_fullsized":"2023-12-19T16:15:41.541934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:32.050629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196089+0000","last_change":"2023-12-19T16:15:40.561493+0000","last_active":"2023-12-19T16:15:42.196089+0000","last_peered":"2023-12-19T16:15:42.196089+0000","last_clean":"2023-12-19T16:15:42.196089+0000","last_became_active":"2023-12-19T16:15:40.561194+0000","last_became_peered":"2023-12-19T16:15:40.561194+0000","last_unstale":"2023-12-19T16:15:42.196089+0000","last_undegraded":"2023-12-19T16:15:42.196089+0000","last_fullsized":"2023-12-19T16:15:42.196089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544306+0000","last_change":"2023-12-19T16:15:40.166564+0000","last_active":"2023-12-19T16:15:41.544306+0000","last_peered":"2023-12-19T16:15:41.544306+0000","last_clean":"2023-12-19T16:15:41.544306+0000","last_became_active":"2023-12-19T16:15:40.166232+0000","last_became_peered":"2023-12-19T16:15:40.166232+0000","last_unstale":"2023-12-19T16:15:41.544306+0000","last_undegraded":"2023-12-19T16:15:41.544306+0000","last_fullsized":"2023-12-19T16:15:41.544306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195585+0000","last_change":"2023-12-19T16:15:40.558430+0000","last_active":"2023-12-19T16:15:42.195585+0000","last_peered":"2023-12-19T16:15:42.195585+0000","last_clean":"2023-12-19T16:15:42.195585+0000","last_became_active":"2023-12-19T16:15:40.558153+0000","last_became_peered":"2023-12-19T16:15:40.558153+0000","last_unstale":"2023-12-19T16:15:42.195585+0000","last_undegraded":"2023-12-19T16:15:42.195585+0000","last_fullsized":"2023-12-19T16:15:42.195585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:14:36.494631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774898+0000","last_change":"2023-12-19T16:15:40.163849+0000","last_active":"2023-12-19T16:15:41.774898+0000","last_peered":"2023-12-19T16:15:41.774898+0000","last_clean":"2023-12-19T16:15:41.774898+0000","last_became_active":"2023-12-19T16:15:40.163576+0000","last_became_peered":"2023-12-19T16:15:40.163576+0000","last_unstale":"2023-12-19T16:15:41.774898+0000","last_undegraded":"2023-12-19T16:15:41.774898+0000","last_fullsized":"2023-12-19T16:15:41.774898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774801+0000","last_change":"2023-12-19T16:15:40.559502+0000","last_active":"2023-12-19T16:15:41.774801+0000","last_peered":"2023-12-19T16:15:41.774801+0000","last_clean":"2023-12-19T16:15:41.774801+0000","last_became_active":"2023-12-19T16:15:40.559273+0000","last_became_peered":"2023-12-19T16:15:40.559273+0000","last_unstale":"2023-12-19T16:15:41.774801+0000","last_undegraded":"2023-12-19T16:15:41.774801+0000","last_fullsized":"2023-12-19T16:15:41.774801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:53.305645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196023+0000","last_change":"2023-12-19T16:15:40.166877+0000","last_active":"2023-12-19T16:15:42.196023+0000","last_peered":"2023-12-19T16:15:42.196023+0000","last_clean":"2023-12-19T16:15:42.196023+0000","last_became_active":"2023-12-19T16:15:40.166506+0000","last_became_peered":"2023-12-19T16:15:40.166506+0000","last_unstale":"2023-12-19T16:15:42.196023+0000","last_undegraded":"2023-12-19T16:15:42.196023+0000","last_fullsized":"2023-12-19T16:15:42.196023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195757+0000","last_change":"2023-12-19T16:15:40.569727+0000","last_active":"2023-12-19T16:15:42.195757+0000","last_peered":"2023-12-19T16:15:42.195757+0000","last_clean":"2023-12-19T16:15:42.195757+0000","last_became_active":"2023-12-19T16:15:40.569430+0000","last_became_peered":"2023-12-19T16:15:40.569430+0000","last_unstale":"2023-12-19T16:15:42.195757+0000","last_undegraded":"2023-12-19T16:15:42.195757+0000","last_fullsized":"2023-12-19T16:15:42.195757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461658+0000","last_change":"2023-12-19T16:15:40.150626+0000","last_active":"2023-12-19T16:15:41.461658+0000","last_peered":"2023-12-19T16:15:41.461658+0000","last_clean":"2023-12-19T16:15:41.461658+0000","last_became_active":"2023-12-19T16:15:40.150345+0000","last_became_peered":"2023-12-19T16:15:40.150345+0000","last_unstale":"2023-12-19T16:15:41.461658+0000","last_undegraded":"2023-12-19T16:15:41.461658+0000","last_fullsized":"2023-12-19T16:15:41.461658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:49.556556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.550692+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.550433+0000","last_became_peered":"2023-12-19T16:15:40.550433+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:45:06.826275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196683+0000","last_change":"2023-12-19T16:15:40.167815+0000","last_active":"2023-12-19T16:15:42.196683+0000","last_peered":"2023-12-19T16:15:42.196683+0000","last_clean":"2023-12-19T16:15:42.196683+0000","last_became_active":"2023-12-19T16:15:40.167149+0000","last_became_peered":"2023-12-19T16:15:40.167149+0000","last_unstale":"2023-12-19T16:15:42.196683+0000","last_undegraded":"2023-12-19T16:15:42.196683+0000","last_fullsized":"2023-12-19T16:15:42.196683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542057+0000","last_change":"2023-12-19T16:15:40.560268+0000","last_active":"2023-12-19T16:15:41.542057+0000","last_peered":"2023-12-19T16:15:41.542057+0000","last_clean":"2023-12-19T16:15:41.542057+0000","last_became_active":"2023-12-19T16:15:40.559853+0000","last_became_peered":"2023-12-19T16:15:40.559853+0000","last_unstale":"2023-12-19T16:15:41.542057+0000","last_undegraded":"2023-12-19T16:15:41.542057+0000","last_fullsized":"2023-12-19T16:15:41.542057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461751+0000","last_change":"2023-12-19T16:15:40.160008+0000","last_active":"2023-12-19T16:15:41.461751+0000","last_peered":"2023-12-19T16:15:41.461751+0000","last_clean":"2023-12-19T16:15:41.461751+0000","last_became_active":"2023-12-19T16:15:40.159521+0000","last_became_peered":"2023-12-19T16:15:40.159521+0000","last_unstale":"2023-12-19T16:15:41.461751+0000","last_undegraded":"2023-12-19T16:15:41.461751+0000","last_fullsized":"2023-12-19T16:15:41.461751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:50.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196655+0000","last_change":"2023-12-19T16:15:40.555956+0000","last_active":"2023-12-19T16:15:42.196655+0000","last_peered":"2023-12-19T16:15:42.196655+0000","last_clean":"2023-12-19T16:15:42.196655+0000","last_became_active":"2023-12-19T16:15:40.555515+0000","last_became_peered":"2023-12-19T16:15:40.555515+0000","last_unstale":"2023-12-19T16:15:42.196655+0000","last_undegraded":"2023-12-19T16:15:42.196655+0000","last_fullsized":"2023-12-19T16:15:42.196655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195286+0000","last_change":"2023-12-19T16:15:40.161341+0000","last_active":"2023-12-19T16:15:42.195286+0000","last_peered":"2023-12-19T16:15:42.195286+0000","last_clean":"2023-12-19T16:15:42.195286+0000","last_became_active":"2023-12-19T16:15:40.160718+0000","last_became_peered":"2023-12-19T16:15:40.160718+0000","last_unstale":"2023-12-19T16:15:42.195286+0000","last_undegraded":"2023-12-19T16:15:42.195286+0000","last_fullsized":"2023-12-19T16:15:42.195286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196516+0000","last_change":"2023-12-19T16:15:40.561843+0000","last_active":"2023-12-19T16:15:42.196516+0000","last_peered":"2023-12-19T16:15:42.196516+0000","last_clean":"2023-12-19T16:15:42.196516+0000","last_became_active":"2023-12-19T16:15:40.561455+0000","last_became_peered":"2023-12-19T16:15:40.561455+0000","last_unstale":"2023-12-19T16:15:42.196516+0000","last_undegraded":"2023-12-19T16:15:42.196516+0000","last_fullsized":"2023-12-19T16:15:42.196516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195860+0000","last_change":"2023-12-19T16:15:40.170958+0000","last_active":"2023-12-19T16:15:42.195860+0000","last_peered":"2023-12-19T16:15:42.195860+0000","last_clean":"2023-12-19T16:15:42.195860+0000","last_became_active":"2023-12-19T16:15:40.170735+0000","last_became_peered":"2023-12-19T16:15:40.170735+0000","last_unstale":"2023-12-19T16:15:42.195860+0000","last_undegraded":"2023-12-19T16:15:42.195860+0000","last_fullsized":"2023-12-19T16:15:42.195860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775038+0000","last_change":"2023-12-19T16:15:40.557532+0000","last_active":"2023-12-19T16:15:41.775038+0000","last_peered":"2023-12-19T16:15:41.775038+0000","last_clean":"2023-12-19T16:15:41.775038+0000","last_became_active":"2023-12-19T16:15:40.549277+0000","last_became_peered":"2023-12-19T16:15:40.549277+0000","last_unstale":"2023-12-19T16:15:41.775038+0000","last_undegraded":"2023-12-19T16:15:41.775038+0000","last_fullsized":"2023-12-19T16:15:41.775038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:42.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.533799+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:15:40.533799+0000","last_peered":"2023-12-19T16:15:40.533799+0000","last_clean":"2023-12-19T16:15:40.533799+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:15:40.533799+0000","last_undegraded":"2023-12-19T16:15:40.533799+0000","last_fullsized":"2023-12-19T16:15:40.533799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774904+0000","last_change":"2023-12-19T16:15:40.163049+0000","last_active":"2023-12-19T16:15:41.774904+0000","last_peered":"2023-12-19T16:15:41.774904+0000","last_clean":"2023-12-19T16:15:41.774904+0000","last_became_active":"2023-12-19T16:15:40.162399+0000","last_became_peered":"2023-12-19T16:15:40.162399+0000","last_unstale":"2023-12-19T16:15:41.774904+0000","last_undegraded":"2023-12-19T16:15:41.774904+0000","last_fullsized":"2023-12-19T16:15:41.774904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:42.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461711+0000","last_change":"2023-12-19T16:15:40.552618+0000","last_active":"2023-12-19T16:15:41.461711+0000","last_peered":"2023-12-19T16:15:41.461711+0000","last_clean":"2023-12-19T16:15:41.461711+0000","last_became_active":"2023-12-19T16:15:40.552192+0000","last_became_peered":"2023-12-19T16:15:40.552192+0000","last_unstale":"2023-12-19T16:15:41.461711+0000","last_undegraded":"2023-12-19T16:15:41.461711+0000","last_fullsized":"2023-12-19T16:15:41.461711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:28:34.037513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774770+0000","last_change":"2023-12-19T16:15:40.162386+0000","last_active":"2023-12-19T16:15:41.774770+0000","last_peered":"2023-12-19T16:15:41.774770+0000","last_clean":"2023-12-19T16:15:41.774770+0000","last_became_active":"2023-12-19T16:15:40.162130+0000","last_became_peered":"2023-12-19T16:15:40.162130+0000","last_unstale":"2023-12-19T16:15:41.774770+0000","last_undegraded":"2023-12-19T16:15:41.774770+0000","last_fullsized":"2023-12-19T16:15:41.774770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:39.071401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194943+0000","last_change":"2023-12-19T16:15:40.554293+0000","last_active":"2023-12-19T16:15:42.194943+0000","last_peered":"2023-12-19T16:15:42.194943+0000","last_clean":"2023-12-19T16:15:42.194943+0000","last_became_active":"2023-12-19T16:15:40.551755+0000","last_became_peered":"2023-12-19T16:15:40.551755+0000","last_unstale":"2023-12-19T16:15:42.194943+0000","last_undegraded":"2023-12-19T16:15:42.194943+0000","last_fullsized":"2023-12-19T16:15:42.194943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543821+0000","last_change":"2023-12-19T16:15:40.158318+0000","last_active":"2023-12-19T16:15:41.543821+0000","last_peered":"2023-12-19T16:15:41.543821+0000","last_clean":"2023-12-19T16:15:41.543821+0000","last_became_active":"2023-12-19T16:15:40.157613+0000","last_became_peered":"2023-12-19T16:15:40.157613+0000","last_unstale":"2023-12-19T16:15:41.543821+0000","last_undegraded":"2023-12-19T16:15:41.543821+0000","last_fullsized":"2023-12-19T16:15:41.543821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195229+0000","last_change":"2023-12-19T16:15:40.568353+0000","last_active":"2023-12-19T16:15:42.195229+0000","last_peered":"2023-12-19T16:15:42.195229+0000","last_clean":"2023-12-19T16:15:42.195229+0000","last_became_active":"2023-12-19T16:15:40.567479+0000","last_became_peered":"2023-12-19T16:15:40.567479+0000","last_unstale":"2023-12-19T16:15:42.195229+0000","last_undegraded":"2023-12-19T16:15:42.195229+0000","last_fullsized":"2023-12-19T16:15:42.195229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:33.311177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774968+0000","last_change":"2023-12-19T16:15:40.164928+0000","last_active":"2023-12-19T16:15:41.774968+0000","last_peered":"2023-12-19T16:15:41.774968+0000","last_clean":"2023-12-19T16:15:41.774968+0000","last_became_active":"2023-12-19T16:15:40.164705+0000","last_became_peered":"2023-12-19T16:15:40.164705+0000","last_unstale":"2023-12-19T16:15:41.774968+0000","last_undegraded":"2023-12-19T16:15:41.774968+0000","last_fullsized":"2023-12-19T16:15:41.774968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:39.741388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196456+0000","last_change":"2023-12-19T16:15:40.553255+0000","last_active":"2023-12-19T16:15:42.196456+0000","last_peered":"2023-12-19T16:15:42.196456+0000","last_clean":"2023-12-19T16:15:42.196456+0000","last_became_active":"2023-12-19T16:15:40.553001+0000","last_became_peered":"2023-12-19T16:15:40.553001+0000","last_unstale":"2023-12-19T16:15:42.196456+0000","last_undegraded":"2023-12-19T16:15:42.196456+0000","last_fullsized":"2023-12-19T16:15:42.196456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195083+0000","last_change":"2023-12-19T16:15:40.162669+0000","last_active":"2023-12-19T16:15:42.195083+0000","last_peered":"2023-12-19T16:15:42.195083+0000","last_clean":"2023-12-19T16:15:42.195083+0000","last_became_active":"2023-12-19T16:15:40.162323+0000","last_became_peered":"2023-12-19T16:15:40.162323+0000","last_unstale":"2023-12-19T16:15:42.195083+0000","last_undegraded":"2023-12-19T16:15:42.195083+0000","last_fullsized":"2023-12-19T16:15:42.195083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541911+0000","last_change":"2023-12-19T16:15:40.560616+0000","last_active":"2023-12-19T16:15:41.541911+0000","last_peered":"2023-12-19T16:15:41.541911+0000","last_clean":"2023-12-19T16:15:41.541911+0000","last_became_active":"2023-12-19T16:15:40.560305+0000","last_became_peered":"2023-12-19T16:15:40.560305+0000","last_unstale":"2023-12-19T16:15:41.541911+0000","last_undegraded":"2023-12-19T16:15:41.541911+0000","last_fullsized":"2023-12-19T16:15:41.541911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775144+0000","last_change":"2023-12-19T16:15:40.159112+0000","last_active":"2023-12-19T16:15:41.775144+0000","last_peered":"2023-12-19T16:15:41.775144+0000","last_clean":"2023-12-19T16:15:41.775144+0000","last_became_active":"2023-12-19T16:15:40.158745+0000","last_became_peered":"2023-12-19T16:15:40.158745+0000","last_unstale":"2023-12-19T16:15:41.775144+0000","last_undegraded":"2023-12-19T16:15:41.775144+0000","last_fullsized":"2023-12-19T16:15:41.775144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195766+0000","last_change":"2023-12-19T16:15:40.574613+0000","last_active":"2023-12-19T16:15:42.195766+0000","last_peered":"2023-12-19T16:15:42.195766+0000","last_clean":"2023-12-19T16:15:42.195766+0000","last_became_active":"2023-12-19T16:15:40.574349+0000","last_became_peered":"2023-12-19T16:15:40.574349+0000","last_unstale":"2023-12-19T16:15:42.195766+0000","last_undegraded":"2023-12-19T16:15:42.195766+0000","last_fullsized":"2023-12-19T16:15:42.195766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:48:11.094121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544054+0000","last_change":"2023-12-19T16:15:40.170093+0000","last_active":"2023-12-19T16:15:41.544054+0000","last_peered":"2023-12-19T16:15:41.544054+0000","last_clean":"2023-12-19T16:15:41.544054+0000","last_became_active":"2023-12-19T16:15:40.169869+0000","last_became_peered":"2023-12-19T16:15:40.169869+0000","last_unstale":"2023-12-19T16:15:41.544054+0000","last_undegraded":"2023-12-19T16:15:41.544054+0000","last_fullsized":"2023-12-19T16:15:41.544054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:27.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461772+0000","last_change":"2023-12-19T16:15:40.555076+0000","last_active":"2023-12-19T16:15:41.461772+0000","last_peered":"2023-12-19T16:15:41.461772+0000","last_clean":"2023-12-19T16:15:41.461772+0000","last_became_active":"2023-12-19T16:15:40.553947+0000","last_became_peered":"2023-12-19T16:15:40.553947+0000","last_unstale":"2023-12-19T16:15:41.461772+0000","last_undegraded":"2023-12-19T16:15:41.461772+0000","last_fullsized":"2023-12-19T16:15:41.461772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:57.529437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775238+0000","last_change":"2023-12-19T16:15:40.169787+0000","last_active":"2023-12-19T16:15:41.775238+0000","last_peered":"2023-12-19T16:15:41.775238+0000","last_clean":"2023-12-19T16:15:41.775238+0000","last_became_active":"2023-12-19T16:15:40.169383+0000","last_became_peered":"2023-12-19T16:15:40.169383+0000","last_unstale":"2023-12-19T16:15:41.775238+0000","last_undegraded":"2023-12-19T16:15:41.775238+0000","last_fullsized":"2023-12-19T16:15:41.775238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:51.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461741+0000","last_change":"2023-12-19T16:15:40.544924+0000","last_active":"2023-12-19T16:15:41.461741+0000","last_peered":"2023-12-19T16:15:41.461741+0000","last_clean":"2023-12-19T16:15:41.461741+0000","last_became_active":"2023-12-19T16:15:40.544590+0000","last_became_peered":"2023-12-19T16:15:40.544590+0000","last_unstale":"2023-12-19T16:15:41.461741+0000","last_undegraded":"2023-12-19T16:15:41.461741+0000","last_fullsized":"2023-12-19T16:15:41.461741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:10.724734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196014+0000","last_change":"2023-12-19T16:15:40.148785+0000","last_active":"2023-12-19T16:15:42.196014+0000","last_peered":"2023-12-19T16:15:42.196014+0000","last_clean":"2023-12-19T16:15:42.196014+0000","last_became_active":"2023-12-19T16:15:40.147904+0000","last_became_peered":"2023-12-19T16:15:40.147904+0000","last_unstale":"2023-12-19T16:15:42.196014+0000","last_undegraded":"2023-12-19T16:15:42.196014+0000","last_fullsized":"2023-12-19T16:15:42.196014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774747+0000","last_change":"2023-12-19T16:15:40.546029+0000","last_active":"2023-12-19T16:15:41.774747+0000","last_peered":"2023-12-19T16:15:41.774747+0000","last_clean":"2023-12-19T16:15:41.774747+0000","last_became_active":"2023-12-19T16:15:40.545475+0000","last_became_peered":"2023-12-19T16:15:40.545475+0000","last_unstale":"2023-12-19T16:15:41.774747+0000","last_undegraded":"2023-12-19T16:15:41.774747+0000","last_fullsized":"2023-12-19T16:15:41.774747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:39.910949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461697+0000","last_change":"2023-12-19T16:15:40.148744+0000","last_active":"2023-12-19T16:15:41.461697+0000","last_peered":"2023-12-19T16:15:41.461697+0000","last_clean":"2023-12-19T16:15:41.461697+0000","last_became_active":"2023-12-19T16:15:40.148279+0000","last_became_peered":"2023-12-19T16:15:40.148279+0000","last_unstale":"2023-12-19T16:15:41.461697+0000","last_undegraded":"2023-12-19T16:15:41.461697+0000","last_fullsized":"2023-12-19T16:15:41.461697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:56:19.336029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461630+0000","last_change":"2023-12-19T16:15:40.548298+0000","last_active":"2023-12-19T16:15:41.461630+0000","last_peered":"2023-12-19T16:15:41.461630+0000","last_clean":"2023-12-19T16:15:41.461630+0000","last_became_active":"2023-12-19T16:15:40.545774+0000","last_became_peered":"2023-12-19T16:15:40.545774+0000","last_unstale":"2023-12-19T16:15:41.461630+0000","last_undegraded":"2023-12-19T16:15:41.461630+0000","last_fullsized":"2023-12-19T16:15:41.461630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:45.938202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195660+0000","last_change":"2023-12-19T16:15:40.158974+0000","last_active":"2023-12-19T16:15:42.195660+0000","last_peered":"2023-12-19T16:15:42.195660+0000","last_clean":"2023-12-19T16:15:42.195660+0000","last_became_active":"2023-12-19T16:15:40.158129+0000","last_became_peered":"2023-12-19T16:15:40.158129+0000","last_unstale":"2023-12-19T16:15:42.195660+0000","last_undegraded":"2023-12-19T16:15:42.195660+0000","last_fullsized":"2023-12-19T16:15:42.195660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544242+0000","last_change":"2023-12-19T16:15:40.554888+0000","last_active":"2023-12-19T16:15:41.544242+0000","last_peered":"2023-12-19T16:15:41.544242+0000","last_clean":"2023-12-19T16:15:41.544242+0000","last_became_active":"2023-12-19T16:15:40.554560+0000","last_became_peered":"2023-12-19T16:15:40.554560+0000","last_unstale":"2023-12-19T16:15:41.544242+0000","last_undegraded":"2023-12-19T16:15:41.544242+0000","last_fullsized":"2023-12-19T16:15:41.544242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774905+0000","last_change":"2023-12-19T16:15:40.163081+0000","last_active":"2023-12-19T16:15:41.774905+0000","last_peered":"2023-12-19T16:15:41.774905+0000","last_clean":"2023-12-19T16:15:41.774905+0000","last_became_active":"2023-12-19T16:15:40.162817+0000","last_became_peered":"2023-12-19T16:15:40.162817+0000","last_unstale":"2023-12-19T16:15:41.774905+0000","last_undegraded":"2023-12-19T16:15:41.774905+0000","last_fullsized":"2023-12-19T16:15:41.774905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:46.268839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774815+0000","last_change":"2023-12-19T16:15:40.542899+0000","last_active":"2023-12-19T16:15:41.774815+0000","last_peered":"2023-12-19T16:15:41.774815+0000","last_clean":"2023-12-19T16:15:41.774815+0000","last_became_active":"2023-12-19T16:15:40.542005+0000","last_became_peered":"2023-12-19T16:15:40.542005+0000","last_unstale":"2023-12-19T16:15:41.774815+0000","last_undegraded":"2023-12-19T16:15:41.774815+0000","last_fullsized":"2023-12-19T16:15:41.774815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:22.119577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775029+0000","last_change":"2023-12-19T16:15:40.560771+0000","last_active":"2023-12-19T16:15:41.775029+0000","last_peered":"2023-12-19T16:15:41.775029+0000","last_clean":"2023-12-19T16:15:41.775029+0000","last_became_active":"2023-12-19T16:15:40.560543+0000","last_became_peered":"2023-12-19T16:15:40.560543+0000","last_unstale":"2023-12-19T16:15:41.775029+0000","last_undegraded":"2023-12-19T16:15:41.775029+0000","last_fullsized":"2023-12-19T16:15:41.775029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:39.453323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196607+0000","last_change":"2023-12-19T16:15:40.169041+0000","last_active":"2023-12-19T16:15:42.196607+0000","last_peered":"2023-12-19T16:15:42.196607+0000","last_clean":"2023-12-19T16:15:42.196607+0000","last_became_active":"2023-12-19T16:15:40.168466+0000","last_became_peered":"2023-12-19T16:15:40.168466+0000","last_unstale":"2023-12-19T16:15:42.196607+0000","last_undegraded":"2023-12-19T16:15:42.196607+0000","last_fullsized":"2023-12-19T16:15:42.196607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196263+0000","last_change":"2023-12-19T16:15:40.554186+0000","last_active":"2023-12-19T16:15:42.196263+0000","last_peered":"2023-12-19T16:15:42.196263+0000","last_clean":"2023-12-19T16:15:42.196263+0000","last_became_active":"2023-12-19T16:15:40.553941+0000","last_became_peered":"2023-12-19T16:15:40.553941+0000","last_unstale":"2023-12-19T16:15:42.196263+0000","last_undegraded":"2023-12-19T16:15:42.196263+0000","last_fullsized":"2023-12-19T16:15:42.196263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196177+0000","last_change":"2023-12-19T16:15:40.169576+0000","last_active":"2023-12-19T16:15:42.196177+0000","last_peered":"2023-12-19T16:15:42.196177+0000","last_clean":"2023-12-19T16:15:42.196177+0000","last_became_active":"2023-12-19T16:15:40.169336+0000","last_became_peered":"2023-12-19T16:15:40.169336+0000","last_unstale":"2023-12-19T16:15:42.196177+0000","last_undegraded":"2023-12-19T16:15:42.196177+0000","last_fullsized":"2023-12-19T16:15:42.196177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.576580+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.576231+0000","last_became_peered":"2023-12-19T16:15:40.576231+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195533+0000","last_change":"2023-12-19T16:15:40.162671+0000","last_active":"2023-12-19T16:15:42.195533+0000","last_peered":"2023-12-19T16:15:42.195533+0000","last_clean":"2023-12-19T16:15:42.195533+0000","last_became_active":"2023-12-19T16:15:40.162239+0000","last_became_peered":"2023-12-19T16:15:40.162239+0000","last_unstale":"2023-12-19T16:15:42.195533+0000","last_undegraded":"2023-12-19T16:15:42.195533+0000","last_fullsized":"2023-12-19T16:15:42.195533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195348+0000","last_change":"2023-12-19T16:15:40.573940+0000","last_active":"2023-12-19T16:15:42.195348+0000","last_peered":"2023-12-19T16:15:42.195348+0000","last_clean":"2023-12-19T16:15:42.195348+0000","last_became_active":"2023-12-19T16:15:40.573117+0000","last_became_peered":"2023-12-19T16:15:40.573117+0000","last_unstale":"2023-12-19T16:15:42.195348+0000","last_undegraded":"2023-12-19T16:15:42.195348+0000","last_fullsized":"2023-12-19T16:15:42.195348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461795+0000","last_change":"2023-12-19T16:15:40.164711+0000","last_active":"2023-12-19T16:15:41.461795+0000","last_peered":"2023-12-19T16:15:41.461795+0000","last_clean":"2023-12-19T16:15:41.461795+0000","last_became_active":"2023-12-19T16:15:40.164283+0000","last_became_peered":"2023-12-19T16:15:40.164283+0000","last_unstale":"2023-12-19T16:15:41.461795+0000","last_undegraded":"2023-12-19T16:15:41.461795+0000","last_fullsized":"2023-12-19T16:15:41.461795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:49.298209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":81355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":82027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:49.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:15:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 Processor -- start 2023-12-19T16:15:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 -- start start 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 0x7fcbcc0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0cb720 con 0x7fcbcc06d630 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc159380 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd32ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc06dde0 con 0x7fcbcc158fa0 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39228/0 (socket says 172.21.15.73:39228) 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 -- 172.21.15.73:0/914300260 learned_addr learned my addr 172.21.15.73:0/914300260 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd22c8640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 0x7fcbcc0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 -- 172.21.15.73:0/914300260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 msgr2=0x7fcbcc0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 0x7fcbcc0cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 -- 172.21.15.73:0/914300260 >> v1:172.21.15.162:6789/0 conn(0x7fcbcc06d630 legacy=0x7fcbcc0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd1ac7640 1 -- 172.21.15.73:0/914300260 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc06bff0 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.393+0000 7fcbd22c8640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 0x7fcbcc0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:49.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd1ac7640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc006fd0 tx=0x7fcbbc01e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe8ecc982825caf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd12c6640 1 -- 172.21.15.73:0/914300260 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc004230 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd12c6640 1 -- 172.21.15.73:0/914300260 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc0ab070 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd12c6640 1 -- 172.21.15.73:0/914300260 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc0a7770 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- 172.21.15.73:0/914300260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc0cb2c0 msgr2=0x7fcbcc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc006fd0 tx=0x7fcbbc01e960 comp rx=0 tx=0).stop 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- 172.21.15.73:0/914300260 shutdown_connections 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc06d0f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/914300260 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc158fa0 0x7fcbcc0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- 172.21.15.73:0/914300260 >> 172.21.15.73:0/914300260 conn(0x7fcbcc06a120 msgr2=0x7fcbcc06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- 172.21.15.73:0/914300260 shutdown_connections 2023-12-19T16:15:49.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- 172.21.15.73:0/914300260 wait complete. 2023-12-19T16:15:49.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 Processor -- start 2023-12-19T16:15:49.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.397+0000 7fcbd32ca640 1 -- start start 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc06d630 0x7fcbcc159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc159a60 con 0x7fcbcc158fa0 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc1633b0 con 0x7fcbcc0cb2c0 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc15bac0 con 0x7fcbcc06d630 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39242/0 (socket says 172.21.15.73:39242) 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 -- 172.21.15.73:0/786105113 learned_addr learned my addr 172.21.15.73:0/786105113 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:49.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd1ac7640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd22c8640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc06d630 0x7fcbcc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 -- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc06d630 msgr2=0x7fcbcc159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc06d630 0x7fcbcc159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 -- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbcc0cb2c0 msgr2=0x7fcbcc149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 -- 172.21.15.73:0/786105113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc00b780 con 0x7fcbcc158fa0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd2ac9640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c780 tx=0x7fcbc400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4004b20 con 0x7fcbcc158fa0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4004c80 con 0x7fcbcc158fa0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400aa90 con 0x7fcbcc158fa0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc1630d0 con 0x7fcbcc158fa0 2023-12-19T16:15:49.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc149670 con 0x7fcbcc158fa0 2023-12-19T16:15:49.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.401+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc15c280 con 0x7fcbcc158fa0 2023-12-19T16:15:49.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.405+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcbc400abf0 con 0x7fcbcc158fa0 2023-12-19T16:15:49.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.405+0000 7fcbc2ffd640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 0x7fcbb0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.405+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbc4083050 con 0x7fcbcc158fa0 2023-12-19T16:15:49.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.405+0000 7fcbd22c8640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 0x7fcbb0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.405+0000 7fcbd22c8640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 0x7fcbb0067f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006fd0 tx=0x7fcbc8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.409+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcbcc15c280 con 0x7fcbcc158fa0 2023-12-19T16:15:49.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.557+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbcc06cdb0 con 0x7fcbb0065a90 2023-12-19T16:15:49.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.565+0000 7fcbc2ffd640 1 -- 172.21.15.73:0/786105113 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264500 (secure 0 0 0) 0x7fcbc800c040 con 0x7fcbb0065a90 2023-12-19T16:15:49.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:49.573 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:15:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 msgr2=0x7fcbb0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 0x7fcbb0067f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8006fd0 tx=0x7fcbc8008040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 msgr2=0x7fcbcc157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c780 tx=0x7fcbc400cc40 comp rx=0 tx=0).stop 2023-12-19T16:15:49.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 shutdown_connections 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcbb0065a90 0x7fcbb0067f50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbcc158fa0 0x7fcbcc157fc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbcc0cb2c0 0x7fcbcc149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 --2- 172.21.15.73:0/786105113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcbcc06d630 0x7fcbcc159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 >> 172.21.15.73:0/786105113 conn(0x7fcbcc06a120 msgr2=0x7fcbcc0ac440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 shutdown_connections 2023-12-19T16:15:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.569+0000 7fcbd32ca640 1 -- 172.21.15.73:0/786105113 wait complete. 2023-12-19T16:15:49.591 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-12-19T16:15:48.448820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218632,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756088,"statfs":{"total":773094113280,"available":772870234112,"internally_reserved":0,"allocated":3088384,"data_stored":1823788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.005381"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196525+0000","last_change":"2023-12-19T16:15:40.564959+0000","last_active":"2023-12-19T16:15:42.196525+0000","last_peered":"2023-12-19T16:15:42.196525+0000","last_clean":"2023-12-19T16:15:42.196525+0000","last_became_active":"2023-12-19T16:15:40.564702+0000","last_became_peered":"2023-12-19T16:15:40.564702+0000","last_unstale":"2023-12-19T16:15:42.196525+0000","last_undegraded":"2023-12-19T16:15:42.196525+0000","last_fullsized":"2023-12-19T16:15:42.196525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195250+0000","last_change":"2023-12-19T16:15:40.576480+0000","last_active":"2023-12-19T16:15:42.195250+0000","last_peered":"2023-12-19T16:15:42.195250+0000","last_clean":"2023-12-19T16:15:42.195250+0000","last_became_active":"2023-12-19T16:15:40.574311+0000","last_became_peered":"2023-12-19T16:15:40.574311+0000","last_unstale":"2023-12-19T16:15:42.195250+0000","last_undegraded":"2023-12-19T16:15:42.195250+0000","last_fullsized":"2023-12-19T16:15:42.195250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195258+0000","last_change":"2023-12-19T16:15:40.573376+0000","last_active":"2023-12-19T16:15:42.195258+0000","last_peered":"2023-12-19T16:15:42.195258+0000","last_clean":"2023-12-19T16:15:42.195258+0000","last_became_active":"2023-12-19T16:15:40.573039+0000","last_became_peered":"2023-12-19T16:15:40.573039+0000","last_unstale":"2023-12-19T16:15:42.195258+0000","last_undegraded":"2023-12-19T16:15:42.195258+0000","last_fullsized":"2023-12-19T16:15:42.195258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541887+0000","last_change":"2023-12-19T16:15:40.564321+0000","last_active":"2023-12-19T16:15:41.541887+0000","last_peered":"2023-12-19T16:15:41.541887+0000","last_clean":"2023-12-19T16:15:41.541887+0000","last_became_active":"2023-12-19T16:15:40.564109+0000","last_became_peered":"2023-12-19T16:15:40.564109+0000","last_unstale":"2023-12-19T16:15:41.541887+0000","last_undegraded":"2023-12-19T16:15:41.541887+0000","last_fullsized":"2023-12-19T16:15:41.541887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:43.388901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196365+0000","last_change":"2023-12-19T16:15:40.573886+0000","last_active":"2023-12-19T16:15:42.196365+0000","last_peered":"2023-12-19T16:15:42.196365+0000","last_clean":"2023-12-19T16:15:42.196365+0000","last_became_active":"2023-12-19T16:15:40.573554+0000","last_became_peered":"2023-12-19T16:15:40.573554+0000","last_unstale":"2023-12-19T16:15:42.196365+0000","last_undegraded":"2023-12-19T16:15:42.196365+0000","last_fullsized":"2023-12-19T16:15:42.196365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541688+0000","last_change":"2023-12-19T16:15:40.565954+0000","last_active":"2023-12-19T16:15:41.541688+0000","last_peered":"2023-12-19T16:15:41.541688+0000","last_clean":"2023-12-19T16:15:41.541688+0000","last_became_active":"2023-12-19T16:15:40.563221+0000","last_became_peered":"2023-12-19T16:15:40.563221+0000","last_unstale":"2023-12-19T16:15:41.541688+0000","last_undegraded":"2023-12-19T16:15:41.541688+0000","last_fullsized":"2023-12-19T16:15:41.541688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196120+0000","last_change":"2023-12-19T16:15:40.551369+0000","last_active":"2023-12-19T16:15:42.196120+0000","last_peered":"2023-12-19T16:15:42.196120+0000","last_clean":"2023-12-19T16:15:42.196120+0000","last_became_active":"2023-12-19T16:15:40.551122+0000","last_became_peered":"2023-12-19T16:15:40.551122+0000","last_unstale":"2023-12-19T16:15:42.196120+0000","last_undegraded":"2023-12-19T16:15:42.196120+0000","last_fullsized":"2023-12-19T16:15:42.196120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195380+0000","last_change":"2023-12-19T16:15:40.568549+0000","last_active":"2023-12-19T16:15:42.195380+0000","last_peered":"2023-12-19T16:15:42.195380+0000","last_clean":"2023-12-19T16:15:42.195380+0000","last_became_active":"2023-12-19T16:15:40.567804+0000","last_became_peered":"2023-12-19T16:15:40.567804+0000","last_unstale":"2023-12-19T16:15:42.195380+0000","last_undegraded":"2023-12-19T16:15:42.195380+0000","last_fullsized":"2023-12-19T16:15:42.195380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196432+0000","last_change":"2023-12-19T16:15:40.542905+0000","last_active":"2023-12-19T16:15:42.196432+0000","last_peered":"2023-12-19T16:15:42.196432+0000","last_clean":"2023-12-19T16:15:42.196432+0000","last_became_active":"2023-12-19T16:15:40.542177+0000","last_became_peered":"2023-12-19T16:15:40.542177+0000","last_unstale":"2023-12-19T16:15:42.196432+0000","last_undegraded":"2023-12-19T16:15:42.196432+0000","last_fullsized":"2023-12-19T16:15:42.196432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196704+0000","last_change":"2023-12-19T16:15:40.554175+0000","last_active":"2023-12-19T16:15:42.196704+0000","last_peered":"2023-12-19T16:15:42.196704+0000","last_clean":"2023-12-19T16:15:42.196704+0000","last_became_active":"2023-12-19T16:15:40.553928+0000","last_became_peered":"2023-12-19T16:15:40.553928+0000","last_unstale":"2023-12-19T16:15:42.196704+0000","last_undegraded":"2023-12-19T16:15:42.196704+0000","last_fullsized":"2023-12-19T16:15:42.196704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196135+0000","last_change":"2023-12-19T16:15:40.566546+0000","last_active":"2023-12-19T16:15:42.196135+0000","last_peered":"2023-12-19T16:15:42.196135+0000","last_clean":"2023-12-19T16:15:42.196135+0000","last_became_active":"2023-12-19T16:15:40.566340+0000","last_became_peered":"2023-12-19T16:15:40.566340+0000","last_unstale":"2023-12-19T16:15:42.196135+0000","last_undegraded":"2023-12-19T16:15:42.196135+0000","last_fullsized":"2023-12-19T16:15:42.196135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:58.986713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196623+0000","last_change":"2023-12-19T16:15:40.556322+0000","last_active":"2023-12-19T16:15:42.196623+0000","last_peered":"2023-12-19T16:15:42.196623+0000","last_clean":"2023-12-19T16:15:42.196623+0000","last_became_active":"2023-12-19T16:15:40.555847+0000","last_became_peered":"2023-12-19T16:15:40.555847+0000","last_unstale":"2023-12-19T16:15:42.196623+0000","last_undegraded":"2023-12-19T16:15:42.196623+0000","last_fullsized":"2023-12-19T16:15:42.196623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195837+0000","last_change":"2023-12-19T16:15:40.554846+0000","last_active":"2023-12-19T16:15:42.195837+0000","last_peered":"2023-12-19T16:15:42.195837+0000","last_clean":"2023-12-19T16:15:42.195837+0000","last_became_active":"2023-12-19T16:15:40.554558+0000","last_became_peered":"2023-12-19T16:15:40.554558+0000","last_unstale":"2023-12-19T16:15:42.195837+0000","last_undegraded":"2023-12-19T16:15:42.195837+0000","last_fullsized":"2023-12-19T16:15:42.195837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:47.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195005+0000","last_change":"2023-12-19T16:15:40.556072+0000","last_active":"2023-12-19T16:15:42.195005+0000","last_peered":"2023-12-19T16:15:42.195005+0000","last_clean":"2023-12-19T16:15:42.195005+0000","last_became_active":"2023-12-19T16:15:40.555805+0000","last_became_peered":"2023-12-19T16:15:40.555805+0000","last_unstale":"2023-12-19T16:15:42.195005+0000","last_undegraded":"2023-12-19T16:15:42.195005+0000","last_fullsized":"2023-12-19T16:15:42.195005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195192+0000","last_change":"2023-12-19T16:15:40.572960+0000","last_active":"2023-12-19T16:15:42.195192+0000","last_peered":"2023-12-19T16:15:42.195192+0000","last_clean":"2023-12-19T16:15:42.195192+0000","last_became_active":"2023-12-19T16:15:40.572640+0000","last_became_peered":"2023-12-19T16:15:40.572640+0000","last_unstale":"2023-12-19T16:15:42.195192+0000","last_undegraded":"2023-12-19T16:15:42.195192+0000","last_fullsized":"2023-12-19T16:15:42.195192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774645+0000","last_change":"2023-12-19T16:15:40.554309+0000","last_active":"2023-12-19T16:15:41.774645+0000","last_peered":"2023-12-19T16:15:41.774645+0000","last_clean":"2023-12-19T16:15:41.774645+0000","last_became_active":"2023-12-19T16:15:40.552766+0000","last_became_peered":"2023-12-19T16:15:40.552766+0000","last_unstale":"2023-12-19T16:15:41.774645+0000","last_undegraded":"2023-12-19T16:15:41.774645+0000","last_fullsized":"2023-12-19T16:15:41.774645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775218+0000","last_change":"2023-12-19T16:15:40.553698+0000","last_active":"2023-12-19T16:15:41.775218+0000","last_peered":"2023-12-19T16:15:41.775218+0000","last_clean":"2023-12-19T16:15:41.775218+0000","last_became_active":"2023-12-19T16:15:40.553379+0000","last_became_peered":"2023-12-19T16:15:40.553379+0000","last_unstale":"2023-12-19T16:15:41.775218+0000","last_undegraded":"2023-12-19T16:15:41.775218+0000","last_fullsized":"2023-12-19T16:15:41.775218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:16.645742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544284+0000","last_change":"2023-12-19T16:15:40.556547+0000","last_active":"2023-12-19T16:15:41.544284+0000","last_peered":"2023-12-19T16:15:41.544284+0000","last_clean":"2023-12-19T16:15:41.544284+0000","last_became_active":"2023-12-19T16:15:40.555905+0000","last_became_peered":"2023-12-19T16:15:40.555905+0000","last_unstale":"2023-12-19T16:15:41.544284+0000","last_undegraded":"2023-12-19T16:15:41.544284+0000","last_fullsized":"2023-12-19T16:15:41.544284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775141+0000","last_change":"2023-12-19T16:15:40.560248+0000","last_active":"2023-12-19T16:15:41.775141+0000","last_peered":"2023-12-19T16:15:41.775141+0000","last_clean":"2023-12-19T16:15:41.775141+0000","last_became_active":"2023-12-19T16:15:40.548053+0000","last_became_peered":"2023-12-19T16:15:40.548053+0000","last_unstale":"2023-12-19T16:15:41.775141+0000","last_undegraded":"2023-12-19T16:15:41.775141+0000","last_fullsized":"2023-12-19T16:15:41.775141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:42.987632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196292+0000","last_change":"2023-12-19T16:15:40.556318+0000","last_active":"2023-12-19T16:15:42.196292+0000","last_peered":"2023-12-19T16:15:42.196292+0000","last_clean":"2023-12-19T16:15:42.196292+0000","last_became_active":"2023-12-19T16:15:40.555536+0000","last_became_peered":"2023-12-19T16:15:40.555536+0000","last_unstale":"2023-12-19T16:15:42.196292+0000","last_undegraded":"2023-12-19T16:15:42.196292+0000","last_fullsized":"2023-12-19T16:15:42.196292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:33:51.917759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461722+0000","last_change":"2023-12-19T16:15:40.552448+0000","last_active":"2023-12-19T16:15:41.461722+0000","last_peered":"2023-12-19T16:15:41.461722+0000","last_clean":"2023-12-19T16:15:41.461722+0000","last_became_active":"2023-12-19T16:15:40.552127+0000","last_became_peered":"2023-12-19T16:15:40.552127+0000","last_unstale":"2023-12-19T16:15:41.461722+0000","last_undegraded":"2023-12-19T16:15:41.461722+0000","last_fullsized":"2023-12-19T16:15:41.461722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:33.400230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195779+0000","last_change":"2023-12-19T16:15:40.549822+0000","last_active":"2023-12-19T16:15:42.195779+0000","last_peered":"2023-12-19T16:15:42.195779+0000","last_clean":"2023-12-19T16:15:42.195779+0000","last_became_active":"2023-12-19T16:15:40.548780+0000","last_became_peered":"2023-12-19T16:15:40.548780+0000","last_unstale":"2023-12-19T16:15:42.195779+0000","last_undegraded":"2023-12-19T16:15:42.195779+0000","last_fullsized":"2023-12-19T16:15:42.195779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:41.432356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195237+0000","last_change":"2023-12-19T16:15:40.569571+0000","last_active":"2023-12-19T16:15:42.195237+0000","last_peered":"2023-12-19T16:15:42.195237+0000","last_clean":"2023-12-19T16:15:42.195237+0000","last_became_active":"2023-12-19T16:15:40.566982+0000","last_became_peered":"2023-12-19T16:15:40.566982+0000","last_unstale":"2023-12-19T16:15:42.195237+0000","last_undegraded":"2023-12-19T16:15:42.195237+0000","last_fullsized":"2023-12-19T16:15:42.195237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:49:13.770139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.569324+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.568945+0000","last_became_peered":"2023-12-19T16:15:40.568945+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:04.988648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195417+0000","last_change":"2023-12-19T16:15:40.573746+0000","last_active":"2023-12-19T16:15:42.195417+0000","last_peered":"2023-12-19T16:15:42.195417+0000","last_clean":"2023-12-19T16:15:42.195417+0000","last_became_active":"2023-12-19T16:15:40.573442+0000","last_became_peered":"2023-12-19T16:15:40.573442+0000","last_unstale":"2023-12-19T16:15:42.195417+0000","last_undegraded":"2023-12-19T16:15:42.195417+0000","last_fullsized":"2023-12-19T16:15:42.195417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:22.210353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542041+0000","last_change":"2023-12-19T16:15:40.566429+0000","last_active":"2023-12-19T16:15:41.542041+0000","last_peered":"2023-12-19T16:15:41.542041+0000","last_clean":"2023-12-19T16:15:41.542041+0000","last_became_active":"2023-12-19T16:15:40.565983+0000","last_became_peered":"2023-12-19T16:15:40.565983+0000","last_unstale":"2023-12-19T16:15:41.542041+0000","last_undegraded":"2023-12-19T16:15:41.542041+0000","last_fullsized":"2023-12-19T16:15:41.542041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195908+0000","last_change":"2023-12-19T16:15:40.565357+0000","last_active":"2023-12-19T16:15:42.195908+0000","last_peered":"2023-12-19T16:15:42.195908+0000","last_clean":"2023-12-19T16:15:42.195908+0000","last_became_active":"2023-12-19T16:15:40.565074+0000","last_became_peered":"2023-12-19T16:15:40.565074+0000","last_unstale":"2023-12-19T16:15:42.195908+0000","last_undegraded":"2023-12-19T16:15:42.195908+0000","last_fullsized":"2023-12-19T16:15:42.195908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:05.972215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195836+0000","last_change":"2023-12-19T16:15:40.555405+0000","last_active":"2023-12-19T16:15:42.195836+0000","last_peered":"2023-12-19T16:15:42.195836+0000","last_clean":"2023-12-19T16:15:42.195836+0000","last_became_active":"2023-12-19T16:15:40.555000+0000","last_became_peered":"2023-12-19T16:15:40.555000+0000","last_unstale":"2023-12-19T16:15:42.195836+0000","last_undegraded":"2023-12-19T16:15:42.195836+0000","last_fullsized":"2023-12-19T16:15:42.195836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:51:06.077461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195687+0000","last_change":"2023-12-19T16:15:40.573526+0000","last_active":"2023-12-19T16:15:42.195687+0000","last_peered":"2023-12-19T16:15:42.195687+0000","last_clean":"2023-12-19T16:15:42.195687+0000","last_became_active":"2023-12-19T16:15:40.572779+0000","last_became_peered":"2023-12-19T16:15:40.572779+0000","last_unstale":"2023-12-19T16:15:42.195687+0000","last_undegraded":"2023-12-19T16:15:42.195687+0000","last_fullsized":"2023-12-19T16:15:42.195687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:37.149682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774761+0000","last_change":"2023-12-19T16:15:40.574985+0000","last_active":"2023-12-19T16:15:41.774761+0000","last_peered":"2023-12-19T16:15:41.774761+0000","last_clean":"2023-12-19T16:15:41.774761+0000","last_became_active":"2023-12-19T16:15:40.574724+0000","last_became_peered":"2023-12-19T16:15:40.574724+0000","last_unstale":"2023-12-19T16:15:41.774761+0000","last_undegraded":"2023-12-19T16:15:41.774761+0000","last_fullsized":"2023-12-19T16:15:41.774761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:41.216724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543806+0000","last_change":"2023-12-19T16:15:40.550561+0000","last_active":"2023-12-19T16:15:41.543806+0000","last_peered":"2023-12-19T16:15:41.543806+0000","last_clean":"2023-12-19T16:15:41.543806+0000","last_became_active":"2023-12-19T16:15:40.549817+0000","last_became_peered":"2023-12-19T16:15:40.549817+0000","last_unstale":"2023-12-19T16:15:41.543806+0000","last_undegraded":"2023-12-19T16:15:41.543806+0000","last_fullsized":"2023-12-19T16:15:41.543806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541700+0000","last_change":"2023-12-19T16:15:40.559294+0000","last_active":"2023-12-19T16:15:41.541700+0000","last_peered":"2023-12-19T16:15:41.541700+0000","last_clean":"2023-12-19T16:15:41.541700+0000","last_became_active":"2023-12-19T16:15:40.559007+0000","last_became_peered":"2023-12-19T16:15:40.559007+0000","last_unstale":"2023-12-19T16:15:41.541700+0000","last_undegraded":"2023-12-19T16:15:41.541700+0000","last_fullsized":"2023-12-19T16:15:41.541700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195827+0000","last_change":"2023-12-19T16:15:40.574997+0000","last_active":"2023-12-19T16:15:42.195827+0000","last_peered":"2023-12-19T16:15:42.195827+0000","last_clean":"2023-12-19T16:15:42.195827+0000","last_became_active":"2023-12-19T16:15:40.574713+0000","last_became_peered":"2023-12-19T16:15:40.574713+0000","last_unstale":"2023-12-19T16:15:42.195827+0000","last_undegraded":"2023-12-19T16:15:42.195827+0000","last_fullsized":"2023-12-19T16:15:42.195827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195918+0000","last_change":"2023-12-19T16:15:40.161104+0000","last_active":"2023-12-19T16:15:42.195918+0000","last_peered":"2023-12-19T16:15:42.195918+0000","last_clean":"2023-12-19T16:15:42.195918+0000","last_became_active":"2023-12-19T16:15:40.160769+0000","last_became_peered":"2023-12-19T16:15:40.160769+0000","last_unstale":"2023-12-19T16:15:42.195918+0000","last_undegraded":"2023-12-19T16:15:42.195918+0000","last_fullsized":"2023-12-19T16:15:42.195918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461732+0000","last_change":"2023-12-19T16:15:40.549947+0000","last_active":"2023-12-19T16:15:41.461732+0000","last_peered":"2023-12-19T16:15:41.461732+0000","last_clean":"2023-12-19T16:15:41.461732+0000","last_became_active":"2023-12-19T16:15:40.548174+0000","last_became_peered":"2023-12-19T16:15:40.548174+0000","last_unstale":"2023-12-19T16:15:41.461732+0000","last_undegraded":"2023-12-19T16:15:41.461732+0000","last_fullsized":"2023-12-19T16:15:41.461732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:52:13.136180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774874+0000","last_change":"2023-12-19T16:15:40.171997+0000","last_active":"2023-12-19T16:15:41.774874+0000","last_peered":"2023-12-19T16:15:41.774874+0000","last_clean":"2023-12-19T16:15:41.774874+0000","last_became_active":"2023-12-19T16:15:40.171706+0000","last_became_peered":"2023-12-19T16:15:40.171706+0000","last_unstale":"2023-12-19T16:15:41.774874+0000","last_undegraded":"2023-12-19T16:15:41.774874+0000","last_fullsized":"2023-12-19T16:15:41.774874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:04.965195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194944+0000","last_change":"2023-12-19T16:15:40.153875+0000","last_active":"2023-12-19T16:15:42.194944+0000","last_peered":"2023-12-19T16:15:42.194944+0000","last_clean":"2023-12-19T16:15:42.194944+0000","last_became_active":"2023-12-19T16:15:40.153373+0000","last_became_peered":"2023-12-19T16:15:40.153373+0000","last_unstale":"2023-12-19T16:15:42.194944+0000","last_undegraded":"2023-12-19T16:15:42.194944+0000","last_fullsized":"2023-12-19T16:15:42.194944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.568164+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.567046+0000","last_became_peered":"2023-12-19T16:15:40.567046+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774782+0000","last_change":"2023-12-19T16:15:40.167038+0000","last_active":"2023-12-19T16:15:41.774782+0000","last_peered":"2023-12-19T16:15:41.774782+0000","last_clean":"2023-12-19T16:15:41.774782+0000","last_became_active":"2023-12-19T16:15:40.166736+0000","last_became_peered":"2023-12-19T16:15:40.166736+0000","last_unstale":"2023-12-19T16:15:41.774782+0000","last_undegraded":"2023-12-19T16:15:41.774782+0000","last_fullsized":"2023-12-19T16:15:41.774782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:33.645727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461671+0000","last_change":"2023-12-19T16:15:40.544723+0000","last_active":"2023-12-19T16:15:41.461671+0000","last_peered":"2023-12-19T16:15:41.461671+0000","last_clean":"2023-12-19T16:15:41.461671+0000","last_became_active":"2023-12-19T16:15:40.543779+0000","last_became_peered":"2023-12-19T16:15:40.543779+0000","last_unstale":"2023-12-19T16:15:41.461671+0000","last_undegraded":"2023-12-19T16:15:41.461671+0000","last_fullsized":"2023-12-19T16:15:41.461671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:36:03.153648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.151962+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.151615+0000","last_became_peered":"2023-12-19T16:15:40.151615+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542009+0000","last_change":"2023-12-19T16:15:40.565718+0000","last_active":"2023-12-19T16:15:41.542009+0000","last_peered":"2023-12-19T16:15:41.542009+0000","last_clean":"2023-12-19T16:15:41.542009+0000","last_became_active":"2023-12-19T16:15:40.565454+0000","last_became_peered":"2023-12-19T16:15:40.565454+0000","last_unstale":"2023-12-19T16:15:41.542009+0000","last_undegraded":"2023-12-19T16:15:41.542009+0000","last_fullsized":"2023-12-19T16:15:41.542009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196444+0000","last_change":"2023-12-19T16:15:40.166745+0000","last_active":"2023-12-19T16:15:42.196444+0000","last_peered":"2023-12-19T16:15:42.196444+0000","last_clean":"2023-12-19T16:15:42.196444+0000","last_became_active":"2023-12-19T16:15:40.166441+0000","last_became_peered":"2023-12-19T16:15:40.166441+0000","last_unstale":"2023-12-19T16:15:42.196444+0000","last_undegraded":"2023-12-19T16:15:42.196444+0000","last_fullsized":"2023-12-19T16:15:42.196444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:18.251526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195536+0000","last_change":"2023-12-19T16:15:40.572844+0000","last_active":"2023-12-19T16:15:42.195536+0000","last_peered":"2023-12-19T16:15:42.195536+0000","last_clean":"2023-12-19T16:15:42.195536+0000","last_became_active":"2023-12-19T16:15:40.572602+0000","last_became_peered":"2023-12-19T16:15:40.572602+0000","last_unstale":"2023-12-19T16:15:42.195536+0000","last_undegraded":"2023-12-19T16:15:42.195536+0000","last_fullsized":"2023-12-19T16:15:42.195536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544172+0000","last_change":"2023-12-19T16:15:40.154528+0000","last_active":"2023-12-19T16:15:41.544172+0000","last_peered":"2023-12-19T16:15:41.544172+0000","last_clean":"2023-12-19T16:15:41.544172+0000","last_became_active":"2023-12-19T16:15:40.154244+0000","last_became_peered":"2023-12-19T16:15:40.154244+0000","last_unstale":"2023-12-19T16:15:41.544172+0000","last_undegraded":"2023-12-19T16:15:41.544172+0000","last_fullsized":"2023-12-19T16:15:41.544172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774964+0000","last_change":"2023-12-19T16:15:40.553550+0000","last_active":"2023-12-19T16:15:41.774964+0000","last_peered":"2023-12-19T16:15:41.774964+0000","last_clean":"2023-12-19T16:15:41.774964+0000","last_became_active":"2023-12-19T16:15:40.553276+0000","last_became_peered":"2023-12-19T16:15:40.553276+0000","last_unstale":"2023-12-19T16:15:41.774964+0000","last_undegraded":"2023-12-19T16:15:41.774964+0000","last_fullsized":"2023-12-19T16:15:41.774964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:38.637691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541934+0000","last_change":"2023-12-19T16:15:40.156756+0000","last_active":"2023-12-19T16:15:41.541934+0000","last_peered":"2023-12-19T16:15:41.541934+0000","last_clean":"2023-12-19T16:15:41.541934+0000","last_became_active":"2023-12-19T16:15:40.155859+0000","last_became_peered":"2023-12-19T16:15:40.155859+0000","last_unstale":"2023-12-19T16:15:41.541934+0000","last_undegraded":"2023-12-19T16:15:41.541934+0000","last_fullsized":"2023-12-19T16:15:41.541934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:32.050629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196089+0000","last_change":"2023-12-19T16:15:40.561493+0000","last_active":"2023-12-19T16:15:42.196089+0000","last_peered":"2023-12-19T16:15:42.196089+0000","last_clean":"2023-12-19T16:15:42.196089+0000","last_became_active":"2023-12-19T16:15:40.561194+0000","last_became_peered":"2023-12-19T16:15:40.561194+0000","last_unstale":"2023-12-19T16:15:42.196089+0000","last_undegraded":"2023-12-19T16:15:42.196089+0000","last_fullsized":"2023-12-19T16:15:42.196089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:09.785906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544306+0000","last_change":"2023-12-19T16:15:40.166564+0000","last_active":"2023-12-19T16:15:41.544306+0000","last_peered":"2023-12-19T16:15:41.544306+0000","last_clean":"2023-12-19T16:15:41.544306+0000","last_became_active":"2023-12-19T16:15:40.166232+0000","last_became_peered":"2023-12-19T16:15:40.166232+0000","last_unstale":"2023-12-19T16:15:41.544306+0000","last_undegraded":"2023-12-19T16:15:41.544306+0000","last_fullsized":"2023-12-19T16:15:41.544306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:17:06.620480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195585+0000","last_change":"2023-12-19T16:15:40.558430+0000","last_active":"2023-12-19T16:15:42.195585+0000","last_peered":"2023-12-19T16:15:42.195585+0000","last_clean":"2023-12-19T16:15:42.195585+0000","last_became_active":"2023-12-19T16:15:40.558153+0000","last_became_peered":"2023-12-19T16:15:40.558153+0000","last_unstale":"2023-12-19T16:15:42.195585+0000","last_undegraded":"2023-12-19T16:15:42.195585+0000","last_fullsized":"2023-12-19T16:15:42.195585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:14:36.494631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774898+0000","last_change":"2023-12-19T16:15:40.163849+0000","last_active":"2023-12-19T16:15:41.774898+0000","last_peered":"2023-12-19T16:15:41.774898+0000","last_clean":"2023-12-19T16:15:41.774898+0000","last_became_active":"2023-12-19T16:15:40.163576+0000","last_became_peered":"2023-12-19T16:15:40.163576+0000","last_unstale":"2023-12-19T16:15:41.774898+0000","last_undegraded":"2023-12-19T16:15:41.774898+0000","last_fullsized":"2023-12-19T16:15:41.774898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774801+0000","last_change":"2023-12-19T16:15:40.559502+0000","last_active":"2023-12-19T16:15:41.774801+0000","last_peered":"2023-12-19T16:15:41.774801+0000","last_clean":"2023-12-19T16:15:41.774801+0000","last_became_active":"2023-12-19T16:15:40.559273+0000","last_became_peered":"2023-12-19T16:15:40.559273+0000","last_unstale":"2023-12-19T16:15:41.774801+0000","last_undegraded":"2023-12-19T16:15:41.774801+0000","last_fullsized":"2023-12-19T16:15:41.774801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:53.305645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196023+0000","last_change":"2023-12-19T16:15:40.166877+0000","last_active":"2023-12-19T16:15:42.196023+0000","last_peered":"2023-12-19T16:15:42.196023+0000","last_clean":"2023-12-19T16:15:42.196023+0000","last_became_active":"2023-12-19T16:15:40.166506+0000","last_became_peered":"2023-12-19T16:15:40.166506+0000","last_unstale":"2023-12-19T16:15:42.196023+0000","last_undegraded":"2023-12-19T16:15:42.196023+0000","last_fullsized":"2023-12-19T16:15:42.196023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:19:03.218477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195757+0000","last_change":"2023-12-19T16:15:40.569727+0000","last_active":"2023-12-19T16:15:42.195757+0000","last_peered":"2023-12-19T16:15:42.195757+0000","last_clean":"2023-12-19T16:15:42.195757+0000","last_became_active":"2023-12-19T16:15:40.569430+0000","last_became_peered":"2023-12-19T16:15:40.569430+0000","last_unstale":"2023-12-19T16:15:42.195757+0000","last_undegraded":"2023-12-19T16:15:42.195757+0000","last_fullsized":"2023-12-19T16:15:42.195757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:34.652746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461658+0000","last_change":"2023-12-19T16:15:40.150626+0000","last_active":"2023-12-19T16:15:41.461658+0000","last_peered":"2023-12-19T16:15:41.461658+0000","last_clean":"2023-12-19T16:15:41.461658+0000","last_became_active":"2023-12-19T16:15:40.150345+0000","last_became_peered":"2023-12-19T16:15:40.150345+0000","last_unstale":"2023-12-19T16:15:41.461658+0000","last_undegraded":"2023-12-19T16:15:41.461658+0000","last_fullsized":"2023-12-19T16:15:41.461658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:49.556556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774652+0000","last_change":"2023-12-19T16:15:40.550692+0000","last_active":"2023-12-19T16:15:41.774652+0000","last_peered":"2023-12-19T16:15:41.774652+0000","last_clean":"2023-12-19T16:15:41.774652+0000","last_became_active":"2023-12-19T16:15:40.550433+0000","last_became_peered":"2023-12-19T16:15:40.550433+0000","last_unstale":"2023-12-19T16:15:41.774652+0000","last_undegraded":"2023-12-19T16:15:41.774652+0000","last_fullsized":"2023-12-19T16:15:41.774652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:45:06.826275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196683+0000","last_change":"2023-12-19T16:15:40.167815+0000","last_active":"2023-12-19T16:15:42.196683+0000","last_peered":"2023-12-19T16:15:42.196683+0000","last_clean":"2023-12-19T16:15:42.196683+0000","last_became_active":"2023-12-19T16:15:40.167149+0000","last_became_peered":"2023-12-19T16:15:40.167149+0000","last_unstale":"2023-12-19T16:15:42.196683+0000","last_undegraded":"2023-12-19T16:15:42.196683+0000","last_fullsized":"2023-12-19T16:15:42.196683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:22:40.425337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.542057+0000","last_change":"2023-12-19T16:15:40.560268+0000","last_active":"2023-12-19T16:15:41.542057+0000","last_peered":"2023-12-19T16:15:41.542057+0000","last_clean":"2023-12-19T16:15:41.542057+0000","last_became_active":"2023-12-19T16:15:40.559853+0000","last_became_peered":"2023-12-19T16:15:40.559853+0000","last_unstale":"2023-12-19T16:15:41.542057+0000","last_undegraded":"2023-12-19T16:15:41.542057+0000","last_fullsized":"2023-12-19T16:15:41.542057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:40.748408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461751+0000","last_change":"2023-12-19T16:15:40.160008+0000","last_active":"2023-12-19T16:15:41.461751+0000","last_peered":"2023-12-19T16:15:41.461751+0000","last_clean":"2023-12-19T16:15:41.461751+0000","last_became_active":"2023-12-19T16:15:40.159521+0000","last_became_peered":"2023-12-19T16:15:40.159521+0000","last_unstale":"2023-12-19T16:15:41.461751+0000","last_undegraded":"2023-12-19T16:15:41.461751+0000","last_fullsized":"2023-12-19T16:15:41.461751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:50.505789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196655+0000","last_change":"2023-12-19T16:15:40.555956+0000","last_active":"2023-12-19T16:15:42.196655+0000","last_peered":"2023-12-19T16:15:42.196655+0000","last_clean":"2023-12-19T16:15:42.196655+0000","last_became_active":"2023-12-19T16:15:40.555515+0000","last_became_peered":"2023-12-19T16:15:40.555515+0000","last_unstale":"2023-12-19T16:15:42.196655+0000","last_undegraded":"2023-12-19T16:15:42.196655+0000","last_fullsized":"2023-12-19T16:15:42.196655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195286+0000","last_change":"2023-12-19T16:15:40.161341+0000","last_active":"2023-12-19T16:15:42.195286+0000","last_peered":"2023-12-19T16:15:42.195286+0000","last_clean":"2023-12-19T16:15:42.195286+0000","last_became_active":"2023-12-19T16:15:40.160718+0000","last_became_peered":"2023-12-19T16:15:40.160718+0000","last_unstale":"2023-12-19T16:15:42.195286+0000","last_undegraded":"2023-12-19T16:15:42.195286+0000","last_fullsized":"2023-12-19T16:15:42.195286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196516+0000","last_change":"2023-12-19T16:15:40.561843+0000","last_active":"2023-12-19T16:15:42.196516+0000","last_peered":"2023-12-19T16:15:42.196516+0000","last_clean":"2023-12-19T16:15:42.196516+0000","last_became_active":"2023-12-19T16:15:40.561455+0000","last_became_peered":"2023-12-19T16:15:40.561455+0000","last_unstale":"2023-12-19T16:15:42.196516+0000","last_undegraded":"2023-12-19T16:15:42.196516+0000","last_fullsized":"2023-12-19T16:15:42.196516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:28.120557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195860+0000","last_change":"2023-12-19T16:15:40.170958+0000","last_active":"2023-12-19T16:15:42.195860+0000","last_peered":"2023-12-19T16:15:42.195860+0000","last_clean":"2023-12-19T16:15:42.195860+0000","last_became_active":"2023-12-19T16:15:40.170735+0000","last_became_peered":"2023-12-19T16:15:40.170735+0000","last_unstale":"2023-12-19T16:15:42.195860+0000","last_undegraded":"2023-12-19T16:15:42.195860+0000","last_fullsized":"2023-12-19T16:15:42.195860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:23:29.929182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775038+0000","last_change":"2023-12-19T16:15:40.557532+0000","last_active":"2023-12-19T16:15:41.775038+0000","last_peered":"2023-12-19T16:15:41.775038+0000","last_clean":"2023-12-19T16:15:41.775038+0000","last_became_active":"2023-12-19T16:15:40.549277+0000","last_became_peered":"2023-12-19T16:15:40.549277+0000","last_unstale":"2023-12-19T16:15:41.775038+0000","last_undegraded":"2023-12-19T16:15:41.775038+0000","last_fullsized":"2023-12-19T16:15:41.775038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:41:42.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:40.533799+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:15:40.533799+0000","last_peered":"2023-12-19T16:15:40.533799+0000","last_clean":"2023-12-19T16:15:40.533799+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:15:40.533799+0000","last_undegraded":"2023-12-19T16:15:40.533799+0000","last_fullsized":"2023-12-19T16:15:40.533799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774904+0000","last_change":"2023-12-19T16:15:40.163049+0000","last_active":"2023-12-19T16:15:41.774904+0000","last_peered":"2023-12-19T16:15:41.774904+0000","last_clean":"2023-12-19T16:15:41.774904+0000","last_became_active":"2023-12-19T16:15:40.162399+0000","last_became_peered":"2023-12-19T16:15:40.162399+0000","last_unstale":"2023-12-19T16:15:41.774904+0000","last_undegraded":"2023-12-19T16:15:41.774904+0000","last_fullsized":"2023-12-19T16:15:41.774904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:35:42.381882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461711+0000","last_change":"2023-12-19T16:15:40.552618+0000","last_active":"2023-12-19T16:15:41.461711+0000","last_peered":"2023-12-19T16:15:41.461711+0000","last_clean":"2023-12-19T16:15:41.461711+0000","last_became_active":"2023-12-19T16:15:40.552192+0000","last_became_peered":"2023-12-19T16:15:40.552192+0000","last_unstale":"2023-12-19T16:15:41.461711+0000","last_undegraded":"2023-12-19T16:15:41.461711+0000","last_fullsized":"2023-12-19T16:15:41.461711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:28:34.037513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774770+0000","last_change":"2023-12-19T16:15:40.162386+0000","last_active":"2023-12-19T16:15:41.774770+0000","last_peered":"2023-12-19T16:15:41.774770+0000","last_clean":"2023-12-19T16:15:41.774770+0000","last_became_active":"2023-12-19T16:15:40.162130+0000","last_became_peered":"2023-12-19T16:15:40.162130+0000","last_unstale":"2023-12-19T16:15:41.774770+0000","last_undegraded":"2023-12-19T16:15:41.774770+0000","last_fullsized":"2023-12-19T16:15:41.774770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:39.071401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.194943+0000","last_change":"2023-12-19T16:15:40.554293+0000","last_active":"2023-12-19T16:15:42.194943+0000","last_peered":"2023-12-19T16:15:42.194943+0000","last_clean":"2023-12-19T16:15:42.194943+0000","last_became_active":"2023-12-19T16:15:40.551755+0000","last_became_peered":"2023-12-19T16:15:40.551755+0000","last_unstale":"2023-12-19T16:15:42.194943+0000","last_undegraded":"2023-12-19T16:15:42.194943+0000","last_fullsized":"2023-12-19T16:15:42.194943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.543821+0000","last_change":"2023-12-19T16:15:40.158318+0000","last_active":"2023-12-19T16:15:41.543821+0000","last_peered":"2023-12-19T16:15:41.543821+0000","last_clean":"2023-12-19T16:15:41.543821+0000","last_became_active":"2023-12-19T16:15:40.157613+0000","last_became_peered":"2023-12-19T16:15:40.157613+0000","last_unstale":"2023-12-19T16:15:41.543821+0000","last_undegraded":"2023-12-19T16:15:41.543821+0000","last_fullsized":"2023-12-19T16:15:41.543821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:50:21.897877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195229+0000","last_change":"2023-12-19T16:15:40.568353+0000","last_active":"2023-12-19T16:15:42.195229+0000","last_peered":"2023-12-19T16:15:42.195229+0000","last_clean":"2023-12-19T16:15:42.195229+0000","last_became_active":"2023-12-19T16:15:40.567479+0000","last_became_peered":"2023-12-19T16:15:40.567479+0000","last_unstale":"2023-12-19T16:15:42.195229+0000","last_undegraded":"2023-12-19T16:15:42.195229+0000","last_fullsized":"2023-12-19T16:15:42.195229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:33.311177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774968+0000","last_change":"2023-12-19T16:15:40.164928+0000","last_active":"2023-12-19T16:15:41.774968+0000","last_peered":"2023-12-19T16:15:41.774968+0000","last_clean":"2023-12-19T16:15:41.774968+0000","last_became_active":"2023-12-19T16:15:40.164705+0000","last_became_peered":"2023-12-19T16:15:40.164705+0000","last_unstale":"2023-12-19T16:15:41.774968+0000","last_undegraded":"2023-12-19T16:15:41.774968+0000","last_fullsized":"2023-12-19T16:15:41.774968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:32:39.741388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196456+0000","last_change":"2023-12-19T16:15:40.553255+0000","last_active":"2023-12-19T16:15:42.196456+0000","last_peered":"2023-12-19T16:15:42.196456+0000","last_clean":"2023-12-19T16:15:42.196456+0000","last_became_active":"2023-12-19T16:15:40.553001+0000","last_became_peered":"2023-12-19T16:15:40.553001+0000","last_unstale":"2023-12-19T16:15:42.196456+0000","last_undegraded":"2023-12-19T16:15:42.196456+0000","last_fullsized":"2023-12-19T16:15:42.196456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:47.275858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195083+0000","last_change":"2023-12-19T16:15:40.162669+0000","last_active":"2023-12-19T16:15:42.195083+0000","last_peered":"2023-12-19T16:15:42.195083+0000","last_clean":"2023-12-19T16:15:42.195083+0000","last_became_active":"2023-12-19T16:15:40.162323+0000","last_became_peered":"2023-12-19T16:15:40.162323+0000","last_unstale":"2023-12-19T16:15:42.195083+0000","last_undegraded":"2023-12-19T16:15:42.195083+0000","last_fullsized":"2023-12-19T16:15:42.195083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.541911+0000","last_change":"2023-12-19T16:15:40.560616+0000","last_active":"2023-12-19T16:15:41.541911+0000","last_peered":"2023-12-19T16:15:41.541911+0000","last_clean":"2023-12-19T16:15:41.541911+0000","last_became_active":"2023-12-19T16:15:40.560305+0000","last_became_peered":"2023-12-19T16:15:40.560305+0000","last_unstale":"2023-12-19T16:15:41.541911+0000","last_undegraded":"2023-12-19T16:15:41.541911+0000","last_fullsized":"2023-12-19T16:15:41.541911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:40.078420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775144+0000","last_change":"2023-12-19T16:15:40.159112+0000","last_active":"2023-12-19T16:15:41.775144+0000","last_peered":"2023-12-19T16:15:41.775144+0000","last_clean":"2023-12-19T16:15:41.775144+0000","last_became_active":"2023-12-19T16:15:40.158745+0000","last_became_peered":"2023-12-19T16:15:40.158745+0000","last_unstale":"2023-12-19T16:15:41.775144+0000","last_undegraded":"2023-12-19T16:15:41.775144+0000","last_fullsized":"2023-12-19T16:15:41.775144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195766+0000","last_change":"2023-12-19T16:15:40.574613+0000","last_active":"2023-12-19T16:15:42.195766+0000","last_peered":"2023-12-19T16:15:42.195766+0000","last_clean":"2023-12-19T16:15:42.195766+0000","last_became_active":"2023-12-19T16:15:40.574349+0000","last_became_peered":"2023-12-19T16:15:40.574349+0000","last_unstale":"2023-12-19T16:15:42.195766+0000","last_undegraded":"2023-12-19T16:15:42.195766+0000","last_fullsized":"2023-12-19T16:15:42.195766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:48:11.094121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544054+0000","last_change":"2023-12-19T16:15:40.170093+0000","last_active":"2023-12-19T16:15:41.544054+0000","last_peered":"2023-12-19T16:15:41.544054+0000","last_clean":"2023-12-19T16:15:41.544054+0000","last_became_active":"2023-12-19T16:15:40.169869+0000","last_became_peered":"2023-12-19T16:15:40.169869+0000","last_unstale":"2023-12-19T16:15:41.544054+0000","last_undegraded":"2023-12-19T16:15:41.544054+0000","last_fullsized":"2023-12-19T16:15:41.544054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:58:27.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461772+0000","last_change":"2023-12-19T16:15:40.555076+0000","last_active":"2023-12-19T16:15:41.461772+0000","last_peered":"2023-12-19T16:15:41.461772+0000","last_clean":"2023-12-19T16:15:41.461772+0000","last_became_active":"2023-12-19T16:15:40.553947+0000","last_became_peered":"2023-12-19T16:15:40.553947+0000","last_unstale":"2023-12-19T16:15:41.461772+0000","last_undegraded":"2023-12-19T16:15:41.461772+0000","last_fullsized":"2023-12-19T16:15:41.461772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:48:57.529437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775238+0000","last_change":"2023-12-19T16:15:40.169787+0000","last_active":"2023-12-19T16:15:41.775238+0000","last_peered":"2023-12-19T16:15:41.775238+0000","last_clean":"2023-12-19T16:15:41.775238+0000","last_became_active":"2023-12-19T16:15:40.169383+0000","last_became_peered":"2023-12-19T16:15:40.169383+0000","last_unstale":"2023-12-19T16:15:41.775238+0000","last_undegraded":"2023-12-19T16:15:41.775238+0000","last_fullsized":"2023-12-19T16:15:41.775238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:51.208482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461741+0000","last_change":"2023-12-19T16:15:40.544924+0000","last_active":"2023-12-19T16:15:41.461741+0000","last_peered":"2023-12-19T16:15:41.461741+0000","last_clean":"2023-12-19T16:15:41.461741+0000","last_became_active":"2023-12-19T16:15:40.544590+0000","last_became_peered":"2023-12-19T16:15:40.544590+0000","last_unstale":"2023-12-19T16:15:41.461741+0000","last_undegraded":"2023-12-19T16:15:41.461741+0000","last_fullsized":"2023-12-19T16:15:41.461741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:10.724734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196014+0000","last_change":"2023-12-19T16:15:40.148785+0000","last_active":"2023-12-19T16:15:42.196014+0000","last_peered":"2023-12-19T16:15:42.196014+0000","last_clean":"2023-12-19T16:15:42.196014+0000","last_became_active":"2023-12-19T16:15:40.147904+0000","last_became_peered":"2023-12-19T16:15:40.147904+0000","last_unstale":"2023-12-19T16:15:42.196014+0000","last_undegraded":"2023-12-19T16:15:42.196014+0000","last_fullsized":"2023-12-19T16:15:42.196014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:11.746630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774747+0000","last_change":"2023-12-19T16:15:40.546029+0000","last_active":"2023-12-19T16:15:41.774747+0000","last_peered":"2023-12-19T16:15:41.774747+0000","last_clean":"2023-12-19T16:15:41.774747+0000","last_became_active":"2023-12-19T16:15:40.545475+0000","last_became_peered":"2023-12-19T16:15:40.545475+0000","last_unstale":"2023-12-19T16:15:41.774747+0000","last_undegraded":"2023-12-19T16:15:41.774747+0000","last_fullsized":"2023-12-19T16:15:41.774747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:09:39.910949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461697+0000","last_change":"2023-12-19T16:15:40.148744+0000","last_active":"2023-12-19T16:15:41.461697+0000","last_peered":"2023-12-19T16:15:41.461697+0000","last_clean":"2023-12-19T16:15:41.461697+0000","last_became_active":"2023-12-19T16:15:40.148279+0000","last_became_peered":"2023-12-19T16:15:40.148279+0000","last_unstale":"2023-12-19T16:15:41.461697+0000","last_undegraded":"2023-12-19T16:15:41.461697+0000","last_fullsized":"2023-12-19T16:15:41.461697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:56:19.336029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461630+0000","last_change":"2023-12-19T16:15:40.548298+0000","last_active":"2023-12-19T16:15:41.461630+0000","last_peered":"2023-12-19T16:15:41.461630+0000","last_clean":"2023-12-19T16:15:41.461630+0000","last_became_active":"2023-12-19T16:15:40.545774+0000","last_became_peered":"2023-12-19T16:15:40.545774+0000","last_unstale":"2023-12-19T16:15:41.461630+0000","last_undegraded":"2023-12-19T16:15:41.461630+0000","last_fullsized":"2023-12-19T16:15:41.461630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:14:45.938202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195660+0000","last_change":"2023-12-19T16:15:40.158974+0000","last_active":"2023-12-19T16:15:42.195660+0000","last_peered":"2023-12-19T16:15:42.195660+0000","last_clean":"2023-12-19T16:15:42.195660+0000","last_became_active":"2023-12-19T16:15:40.158129+0000","last_became_peered":"2023-12-19T16:15:40.158129+0000","last_unstale":"2023-12-19T16:15:42.195660+0000","last_undegraded":"2023-12-19T16:15:42.195660+0000","last_fullsized":"2023-12-19T16:15:42.195660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.544242+0000","last_change":"2023-12-19T16:15:40.554888+0000","last_active":"2023-12-19T16:15:41.544242+0000","last_peered":"2023-12-19T16:15:41.544242+0000","last_clean":"2023-12-19T16:15:41.544242+0000","last_became_active":"2023-12-19T16:15:40.554560+0000","last_became_peered":"2023-12-19T16:15:40.554560+0000","last_unstale":"2023-12-19T16:15:41.544242+0000","last_undegraded":"2023-12-19T16:15:41.544242+0000","last_fullsized":"2023-12-19T16:15:41.544242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:42:52.215501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774905+0000","last_change":"2023-12-19T16:15:40.163081+0000","last_active":"2023-12-19T16:15:41.774905+0000","last_peered":"2023-12-19T16:15:41.774905+0000","last_clean":"2023-12-19T16:15:41.774905+0000","last_became_active":"2023-12-19T16:15:40.162817+0000","last_became_peered":"2023-12-19T16:15:40.162817+0000","last_unstale":"2023-12-19T16:15:41.774905+0000","last_undegraded":"2023-12-19T16:15:41.774905+0000","last_fullsized":"2023-12-19T16:15:41.774905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:46.268839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.774815+0000","last_change":"2023-12-19T16:15:40.542899+0000","last_active":"2023-12-19T16:15:41.774815+0000","last_peered":"2023-12-19T16:15:41.774815+0000","last_clean":"2023-12-19T16:15:41.774815+0000","last_became_active":"2023-12-19T16:15:40.542005+0000","last_became_peered":"2023-12-19T16:15:40.542005+0000","last_unstale":"2023-12-19T16:15:41.774815+0000","last_undegraded":"2023-12-19T16:15:41.774815+0000","last_fullsized":"2023-12-19T16:15:41.774815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:22.119577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.775029+0000","last_change":"2023-12-19T16:15:40.560771+0000","last_active":"2023-12-19T16:15:41.775029+0000","last_peered":"2023-12-19T16:15:41.775029+0000","last_clean":"2023-12-19T16:15:41.775029+0000","last_became_active":"2023-12-19T16:15:40.560543+0000","last_became_peered":"2023-12-19T16:15:40.560543+0000","last_unstale":"2023-12-19T16:15:41.775029+0000","last_undegraded":"2023-12-19T16:15:41.775029+0000","last_fullsized":"2023-12-19T16:15:41.775029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:39.453323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196607+0000","last_change":"2023-12-19T16:15:40.169041+0000","last_active":"2023-12-19T16:15:42.196607+0000","last_peered":"2023-12-19T16:15:42.196607+0000","last_clean":"2023-12-19T16:15:42.196607+0000","last_became_active":"2023-12-19T16:15:40.168466+0000","last_became_peered":"2023-12-19T16:15:40.168466+0000","last_unstale":"2023-12-19T16:15:42.196607+0000","last_undegraded":"2023-12-19T16:15:42.196607+0000","last_fullsized":"2023-12-19T16:15:42.196607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:33:14.041843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196263+0000","last_change":"2023-12-19T16:15:40.554186+0000","last_active":"2023-12-19T16:15:42.196263+0000","last_peered":"2023-12-19T16:15:42.196263+0000","last_clean":"2023-12-19T16:15:42.196263+0000","last_became_active":"2023-12-19T16:15:40.553941+0000","last_became_peered":"2023-12-19T16:15:40.553941+0000","last_unstale":"2023-12-19T16:15:42.196263+0000","last_undegraded":"2023-12-19T16:15:42.196263+0000","last_fullsized":"2023-12-19T16:15:42.196263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:14:12.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.196177+0000","last_change":"2023-12-19T16:15:40.169576+0000","last_active":"2023-12-19T16:15:42.196177+0000","last_peered":"2023-12-19T16:15:42.196177+0000","last_clean":"2023-12-19T16:15:42.196177+0000","last_became_active":"2023-12-19T16:15:40.169336+0000","last_became_peered":"2023-12-19T16:15:40.169336+0000","last_unstale":"2023-12-19T16:15:42.196177+0000","last_undegraded":"2023-12-19T16:15:42.196177+0000","last_fullsized":"2023-12-19T16:15:42.196177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195450+0000","last_change":"2023-12-19T16:15:40.576580+0000","last_active":"2023-12-19T16:15:42.195450+0000","last_peered":"2023-12-19T16:15:42.195450+0000","last_clean":"2023-12-19T16:15:42.195450+0000","last_became_active":"2023-12-19T16:15:40.576231+0000","last_became_peered":"2023-12-19T16:15:40.576231+0000","last_unstale":"2023-12-19T16:15:42.195450+0000","last_undegraded":"2023-12-19T16:15:42.195450+0000","last_fullsized":"2023-12-19T16:15:42.195450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:11.136752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195533+0000","last_change":"2023-12-19T16:15:40.162671+0000","last_active":"2023-12-19T16:15:42.195533+0000","last_peered":"2023-12-19T16:15:42.195533+0000","last_clean":"2023-12-19T16:15:42.195533+0000","last_became_active":"2023-12-19T16:15:40.162239+0000","last_became_peered":"2023-12-19T16:15:40.162239+0000","last_unstale":"2023-12-19T16:15:42.195533+0000","last_undegraded":"2023-12-19T16:15:42.195533+0000","last_fullsized":"2023-12-19T16:15:42.195533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:57:43.469523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T16:15:42.195348+0000","last_change":"2023-12-19T16:15:40.573940+0000","last_active":"2023-12-19T16:15:42.195348+0000","last_peered":"2023-12-19T16:15:42.195348+0000","last_clean":"2023-12-19T16:15:42.195348+0000","last_became_active":"2023-12-19T16:15:40.573117+0000","last_became_peered":"2023-12-19T16:15:40.573117+0000","last_unstale":"2023-12-19T16:15:42.195348+0000","last_undegraded":"2023-12-19T16:15:42.195348+0000","last_fullsized":"2023-12-19T16:15:42.195348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:40.126581+0000","last_clean_scrub_stamp":"2023-12-19T16:15:40.126581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:27:17.799420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-12-19T16:15:41.461795+0000","last_change":"2023-12-19T16:15:40.164711+0000","last_active":"2023-12-19T16:15:41.461795+0000","last_peered":"2023-12-19T16:15:41.461795+0000","last_clean":"2023-12-19T16:15:41.461795+0000","last_became_active":"2023-12-19T16:15:40.164283+0000","last_became_peered":"2023-12-19T16:15:40.164283+0000","last_unstale":"2023-12-19T16:15:41.461795+0000","last_undegraded":"2023-12-19T16:15:41.461795+0000","last_fullsized":"2023-12-19T16:15:41.461795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:39.119562+0000","last_clean_scrub_stamp":"2023-12-19T16:15:39.119562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:18:49.298209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":80373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":81355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]}]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":827392,"data_stored":670229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":79915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":79791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":812,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":831488,"data_stored":670251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":82027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:15:49.596 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T16:15:49.596 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T16:15:49.596 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T16:15:49.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T16:15:49.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.765+0000 7f1e937f0640 1 Processor -- start 2023-12-19T16:15:49.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.765+0000 7f1e937f0640 1 -- start start 2023-12-19T16:15:49.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e937f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c15cd30 0x7f1e8c070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e937f0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e937f0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c15d110 con 0x7f1e8c070dc0 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e937f0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c069fe0 con 0x7f1e8c06d090 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e937f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0713f0 con 0x7f1e8c15cd30 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39254/0 (socket says 172.21.15.73:39254) 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 -- 172.21.15.73:0/4256624444 learned_addr learned my addr 172.21.15.73:0/4256624444 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e9158c640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c15cd30 0x7f1e8c070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 -- 172.21.15.73:0/4256624444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c15cd30 msgr2=0x7f1e8c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c15cd30 0x7f1e8c070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 -- 172.21.15.73:0/4256624444 >> v1:172.21.15.162:6789/0 conn(0x7f1e8c070dc0 legacy=0x7f1e8c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.769+0000 7f1e91d8d640 1 -- 172.21.15.73:0/4256624444 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0716d0 con 0x7f1e8c06d090 2023-12-19T16:15:49.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e91d8d640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009870 tx=0x7f1e8401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5413fc1707c8007d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e83fff640 1 -- 172.21.15.73:0/4256624444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840a8a30 con 0x7f1e8c06d090 2023-12-19T16:15:49.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e83fff640 1 -- 172.21.15.73:0/4256624444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840a8b90 con 0x7f1e8c06d090 2023-12-19T16:15:49.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e83fff640 1 -- 172.21.15.73:0/4256624444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840b0440 con 0x7f1e8c06d090 2023-12-19T16:15:49.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- 172.21.15.73:0/4256624444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c06d090 msgr2=0x7f1e8c0c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009870 tx=0x7f1e8401ed30 comp rx=0 tx=0).stop 2023-12-19T16:15:49.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- 172.21.15.73:0/4256624444 shutdown_connections 2023-12-19T16:15:49.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c06d090 0x7f1e8c0c9ef0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 --2- 172.21.15.73:0/4256624444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c15cd30 0x7f1e8c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- 172.21.15.73:0/4256624444 >> 172.21.15.73:0/4256624444 conn(0x7f1e8c0b0b10 msgr2=0x7f1e8c0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- 172.21.15.73:0/4256624444 shutdown_connections 2023-12-19T16:15:49.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- 172.21.15.73:0/4256624444 wait complete. 2023-12-19T16:15:49.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 Processor -- start 2023-12-19T16:15:49.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.773+0000 7f1e937f0640 1 -- start start 2023-12-19T16:15:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c06d090 0x7f1e8c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 0x7f1e8c0c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15e7b0 con 0x7f1e8c15cd30 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15dba0 con 0x7f1e8c070dc0 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c15de80 con 0x7f1e8c06d090 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39260/0 (socket says 172.21.15.73:39260) 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 -- 172.21.15.73:0/344060443 learned_addr learned my addr 172.21.15.73:0/344060443 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 -- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c06d090 msgr2=0x7f1e8c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c06d090 0x7f1e8c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 -- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 msgr2=0x7f1e8c0c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e90d8b640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 0x7f1e8c0c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 0x7f1e8c0c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 -- 172.21.15.73:0/344060443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840094d0 con 0x7f1e8c15cd30 2023-12-19T16:15:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e90d8b640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 0x7f1e8c0c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e91d8d640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b3040 tx=0x7f1e8401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840ba600 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840ba760 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840baaf0 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c15e160 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c15d7e0 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c074050 con 0x7f1e8c15cd30 2023-12-19T16:15:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.777+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e840bac50 con 0x7f1e8c15cd30 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.781+0000 7f1e81ffb640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 0x7f1e70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.781+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e84121820 con 0x7f1e8c15cd30 2023-12-19T16:15:49.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.781+0000 7f1e9158c640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 0x7f1e70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:49.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.781+0000 7f1e9158c640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 0x7f1e70067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e880070b0 tx=0x7f1e88007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.785+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1e840ef260 con 0x7f1e8c15cd30 2023-12-19T16:15:49.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.965+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e8c06b380 con 0x7f1e8c15cd30 2023-12-19T16:15:49.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.965+0000 7f1e81ffb640 1 -- 172.21.15.73:0/344060443 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1e840f2880 con 0x7f1e8c15cd30 2023-12-19T16:15:49.970 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:49.971 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T16:15:49.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 msgr2=0x7f1e70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 0x7f1e70067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1e880070b0 tx=0x7f1e88007040 comp rx=0 tx=0).stop 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 msgr2=0x7f1e8c0cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1e840b3040 tx=0x7f1e8401bad0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 shutdown_connections 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1e70065a60 0x7f1e70067f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e8c15cd30 0x7f1e8c0cd620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e8c070dc0 0x7f1e8c0c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 --2- 172.21.15.73:0/344060443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e8c06d090 0x7f1e8c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 >> 172.21.15.73:0/344060443 conn(0x7f1e8c0b0b10 msgr2=0x7f1e8c158780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 shutdown_connections 2023-12-19T16:15:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:49.969+0000 7f1e937f0640 1 -- 172.21.15.73:0/344060443 wait complete. 2023-12-19T16:15:49.992 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T16:15:49.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.125+0000 7f5e0d066640 1 Processor -- start 2023-12-19T16:15:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 -- start start 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e0815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5e080b40b0 0x7f5e080cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0815ad00 con 0x7f5e080cda70 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0815e110 con 0x7f5e080b40b0 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0d066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e080cdf00 con 0x7f5e08159830 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e0815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5dfffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5e080b40b0 0x7f5e080cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0759e640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5e080cda70 0x7f5e080cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42512/0 (socket says 172.21.15.73:42512) 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0759e640 1 -- 172.21.15.73:0/3281010570 learned_addr learned my addr 172.21.15.73:0/3281010570 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5dfffff640 1 -- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 msgr2=0x7f5e0815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5dfffff640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e0815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e0659c640 1 -- 172.21.15.73:0/3281010570 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167075654 0 0) 0x7f5e0815ad00 con 0x7f5e080cda70 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5dfffff640 1 -- 172.21.15.73:0/3281010570 >> v1:172.21.15.162:6789/0 conn(0x7f5e080cda70 legacy=0x7f5e080cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5dfffff640 1 -- 172.21.15.73:0/3281010570 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080ce2d0 con 0x7f5e080b40b0 2023-12-19T16:15:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.129+0000 7f5e06d9d640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e0815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:50.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5dfffff640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080b40b0 0x7f5e080cd530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5df000dbe0 tx=0x7f5df00206d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3d0c46f6ee0ee6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0659c640 1 -- 172.21.15.73:0/3281010570 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df000d2d0 con 0x7f5e080b40b0 2023-12-19T16:15:50.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0659c640 1 -- 172.21.15.73:0/3281010570 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00a95a0 con 0x7f5e080b40b0 2023-12-19T16:15:50.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0659c640 1 -- 172.21.15.73:0/3281010570 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00a9930 con 0x7f5e080b40b0 2023-12-19T16:15:50.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080b40b0 msgr2=0x7f5e080cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080b40b0 0x7f5e080cd530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5df000dbe0 tx=0x7f5df00206d0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- 172.21.15.73:0/3281010570 shutdown_connections 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080b40b0 0x7f5e080cd530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3281010570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e0815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- 172.21.15.73:0/3281010570 >> 172.21.15.73:0/3281010570 conn(0x7f5e080b0270 msgr2=0x7f5e080b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- 172.21.15.73:0/3281010570 shutdown_connections 2023-12-19T16:15:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- 172.21.15.73:0/3281010570 wait complete. 2023-12-19T16:15:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 Processor -- start 2023-12-19T16:15:50.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.133+0000 7f5e0d066640 1 -- start start 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080cda70 0x7f5e0814db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e08154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0814e0b0 con 0x7f5e080b40b0 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e08151940 con 0x7f5e080cda70 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e081550f0 con 0x7f5e08159830 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39262/0 (socket says 172.21.15.73:39262) 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 -- 172.21.15.73:0/3871689160 learned_addr learned my addr 172.21.15.73:0/3871689160 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0759e640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e08154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5dfffff640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080cda70 0x7f5e0814db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 -- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 msgr2=0x7f5e08154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e08154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 -- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080cda70 msgr2=0x7f5e0814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080cda70 0x7f5e0814db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 -- 172.21.15.73:0/3871689160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df800b4d0 con 0x7f5e080b40b0 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0759e640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e08154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e06d9d640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df800fde0 tx=0x7f5df800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8018640 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df80187a0 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df000d8c0 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8018b30 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e08151ea0 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e08074050 con 0x7f5e080b40b0 2023-12-19T16:15:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.137+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5df8018c90 con 0x7f5e080b40b0 2023-12-19T16:15:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.141+0000 7f5dff7fe640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 0x7f5de8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.141+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5df8083b20 con 0x7f5e080b40b0 2023-12-19T16:15:50.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.141+0000 7f5dfffff640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 0x7f5de8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.141+0000 7f5dfffff640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 0x7f5de8067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b2000 tx=0x7f5df00ab070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.145+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5df8051620 con 0x7f5e080b40b0 2023-12-19T16:15:50.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e0815dd00 con 0x7f5e080b40b0 2023-12-19T16:15:50.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5dff7fe640 1 -- 172.21.15.73:0/3871689160 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5df8054c40 con 0x7f5e080b40b0 2023-12-19T16:15:50.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:50.301 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 msgr2=0x7f5de8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 0x7f5de8067f20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5df00b2000 tx=0x7f5df00ab070 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 msgr2=0x7f5e0814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5df800fde0 tx=0x7f5df800d720 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 shutdown_connections 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e08159830 0x7f5e08154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e080cda70 0x7f5e0814db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5de8065a60 0x7f5de8067f20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 --2- 172.21.15.73:0/3871689160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e080b40b0 0x7f5e0814d630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.297+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 >> 172.21.15.73:0/3871689160 conn(0x7f5e080b0270 msgr2=0x7f5e0806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.301+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 shutdown_connections 2023-12-19T16:15:50.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.301+0000 7f5e0d066640 1 -- 172.21.15.73:0/3871689160 wait complete. 2023-12-19T16:15:50.322 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:50.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:50.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 Processor -- start 2023-12-19T16:15:50.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 -- start start 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 0x7f0e440cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4406a650 con 0x7f0e440cd110 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4406a930 con 0x7f0e44065a30 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e4a509640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4406b6f0 con 0x7f0e44161010 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e43fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0e440cd110 0x7f0e44069d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56670/0 (socket says 172.21.15.73:56670) 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e43fff640 1 -- 172.21.15.73:0/1915662381 learned_addr learned my addr 172.21.15.73:0/1915662381 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:50.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e48aa6640 1 --2- 172.21.15.73:0/1915662381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 0x7f0e440cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933011854 0 0) 0x7f0e4406a650 con 0x7f0e440cd110 2023-12-19T16:15:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c003530 con 0x7f0e440cd110 2023-12-19T16:15:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255752686 0 0) 0x7f0e4406a930 con 0x7f0e44065a30 2023-12-19T16:15:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4406a650 con 0x7f0e44065a30 2023-12-19T16:15:50.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e48aa6640 1 -- 172.21.15.73:0/1915662381 >> v1:172.21.15.162:6789/0 conn(0x7f0e44065a30 legacy=0x7f0e44160900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e48aa6640 1 -- 172.21.15.73:0/1915662381 >> v1:172.21.15.73:6789/0 conn(0x7f0e440cd110 legacy=0x7f0e44069d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.467 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.461+0000 7f0e48aa6640 1 -- 172.21.15.73:0/1915662381 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4406ac10 con 0x7f0e44161010 2023-12-19T16:15:50.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e48aa6640 1 --2- 172.21.15.73:0/1915662381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 0x7f0e440cd4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009dc0 tx=0x7f0e3c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f511e2c2fe3922e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a5890 con 0x7f0e44161010 2023-12-19T16:15:50.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0a59f0 con 0x7f0e44161010 2023-12-19T16:15:50.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e42ffd640 1 -- 172.21.15.73:0/1915662381 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a5d60 con 0x7f0e44161010 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 -- 172.21.15.73:0/1915662381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 msgr2=0x7f0e440cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 --2- 172.21.15.73:0/1915662381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 0x7f0e440cd4f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009dc0 tx=0x7f0e3c01c8e0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 -- 172.21.15.73:0/1915662381 shutdown_connections 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 --2- 172.21.15.73:0/1915662381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44161010 0x7f0e440cd4f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 -- 172.21.15.73:0/1915662381 >> 172.21.15.73:0/1915662381 conn(0x7f0e440b0ad0 msgr2=0x7f0e440b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 -- 172.21.15.73:0/1915662381 shutdown_connections 2023-12-19T16:15:50.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.465+0000 7f0e4a509640 1 -- 172.21.15.73:0/1915662381 wait complete. 2023-12-19T16:15:50.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 Processor -- start 2023-12-19T16:15:50.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- start start 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44065a30 0x7f0e44153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e44161010 0x7f0e440c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440c6b40 con 0x7f0e440cd110 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441515a0 con 0x7f0e44161010 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441534a0 con 0x7f0e44065a30 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39268/0 (socket says 172.21.15.73:39268) 2023-12-19T16:15:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 -- 172.21.15.73:0/2316657191 learned_addr learned my addr 172.21.15.73:0/2316657191 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e48aa6640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e44161010 0x7f0e440c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e43fff640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44065a30 0x7f0e44153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 -- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44065a30 msgr2=0x7f0e44153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44065a30 0x7f0e44153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 -- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e44161010 msgr2=0x7f0e440c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e44161010 0x7f0e440c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 -- 172.21.15.73:0/2316657191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009a70 con 0x7f0e440cd110 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e437fe640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c430 tx=0x7f0e3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e380052d0 con 0x7f0e440cd110 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38005450 con 0x7f0e440cd110 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e440c61e0 con 0x7f0e440cd110 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38003840 con 0x7f0e440cd110 2023-12-19T16:15:50.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.469+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440c6760 con 0x7f0e440cd110 2023-12-19T16:15:50.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e440c6c80 con 0x7f0e440cd110 2023-12-19T16:15:50.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e380039a0 con 0x7f0e440cd110 2023-12-19T16:15:50.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e40ff9640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 0x7f0e30067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e38082700 con 0x7f0e440cd110 2023-12-19T16:15:50.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e43fff640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 0x7f0e30067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.473+0000 7f0e43fff640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 0x7f0e30067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e340011f0 tx=0x7f0e34007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.477+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e440c6c80 con 0x7f0e440cd110 2023-12-19T16:15:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e440c6c80 con 0x7f0e440cd110 2023-12-19T16:15:50.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e40ff9640 1 -- 172.21.15.73:0/2316657191 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e440c6c80 con 0x7f0e440cd110 2023-12-19T16:15:50.632 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:15:50.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 msgr2=0x7f0e30067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 0x7f0e30067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e340011f0 tx=0x7f0e34007d40 comp rx=0 tx=0).stop 2023-12-19T16:15:50.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 msgr2=0x7f0e44152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800c430 tx=0x7f0e3800c8f0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 shutdown_connections 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e44161010 0x7f0e440c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e30065a60 0x7f0e30067f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e440cd110 0x7f0e44152e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 --2- 172.21.15.73:0/2316657191 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0e44065a30 0x7f0e44153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 >> 172.21.15.73:0/2316657191 conn(0x7f0e440b0ad0 msgr2=0x7f0e44069d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 shutdown_connections 2023-12-19T16:15:50.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.629+0000 7f0e4a509640 1 -- 172.21.15.73:0/2316657191 wait complete. 2023-12-19T16:15:50.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.789+0000 7f16cd22d640 1 Processor -- start 2023-12-19T16:15:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.789+0000 7f16cd22d640 1 -- start start 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16cd22d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16c806d410 0x7f16c80b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16cd22d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c80b0660 0x7f16c80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16cd22d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80cce80 con 0x7f16c81598c0 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16cd22d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80b0b10 con 0x7f16c806d410 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16cd22d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80cc270 con 0x7f16c80b0660 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16c806d410 0x7f16c80b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c6d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f16c81598c0 0x7f16c806c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56672/0 (socket says 172.21.15.73:56672) 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16c806d410 0x7f16c80b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39280/0 (socket says 172.21.15.73:39280) 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c6d9d640 1 -- 172.21.15.73:0/2155222207 learned_addr learned my addr 172.21.15.73:0/2155222207 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c759e640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c80b0660 0x7f16c80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 -- 172.21.15.73:0/2155222207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c80b0660 msgr2=0x7f16c80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c80b0660 0x7f16c80cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 -- 172.21.15.73:0/2155222207 >> v1:172.21.15.73:6789/0 conn(0x7f16c81598c0 legacy=0x7f16c806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c659c640 1 -- 172.21.15.73:0/2155222207 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80cc550 con 0x7f16c806d410 2023-12-19T16:15:50.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.793+0000 7f16c5d9b640 1 -- 172.21.15.73:0/2155222207 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108051665 0 0) 0x7f16c80cce80 con 0x7f16c81598c0 2023-12-19T16:15:50.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16c659c640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c80b0120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03d4d8c106a748f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16c5d9b640 1 -- 172.21.15.73:0/2155222207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ab650 con 0x7f16c806d410 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16c5d9b640 1 -- 172.21.15.73:0/2155222207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0ab7b0 con 0x7f16c806d410 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16c5d9b640 1 -- 172.21.15.73:0/2155222207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0abb40 con 0x7f16c806d410 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- 172.21.15.73:0/2155222207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 msgr2=0x7f16c80b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c80b0120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0097c0 tx=0x7f16bc01c450 comp rx=0 tx=0).stop 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- 172.21.15.73:0/2155222207 shutdown_connections 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c80b0660 0x7f16c80cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 --2- 172.21.15.73:0/2155222207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c80b0120 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- 172.21.15.73:0/2155222207 >> 172.21.15.73:0/2155222207 conn(0x7f16c806a570 msgr2=0x7f16c80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- 172.21.15.73:0/2155222207 shutdown_connections 2023-12-19T16:15:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- 172.21.15.73:0/2155222207 wait complete. 2023-12-19T16:15:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 Processor -- start 2023-12-19T16:15:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 -- start start 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.797+0000 7f16cd22d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 0x7f16c814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c81598c0 0x7f16c814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8152b20 con 0x7f16c806d410 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80cace0 con 0x7f16c80b0660 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80cafa0 con 0x7f16c81598c0 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39288/0 (socket says 172.21.15.73:39288) 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 -- 172.21.15.73:0/3459413523 learned_addr learned my addr 172.21.15.73:0/3459413523 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:50.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c759e640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c81598c0 0x7f16c814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c659c640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 0x7f16c814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 -- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c81598c0 msgr2=0x7f16c814e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c81598c0 0x7f16c814e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 -- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 msgr2=0x7f16c814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 0x7f16c814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 -- 172.21.15.73:0/3459413523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc009420 con 0x7f16c806d410 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c659c640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 0x7f16c814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16c6d9d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16b80011f0 tx=0x7f16b800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80074e0 con 0x7f16c806d410 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8007640 con 0x7f16c806d410 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8004a10 con 0x7f16c806d410 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c8152d90 con 0x7f16c806d410 2023-12-19T16:15:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c80cb280 con 0x7f16c806d410 2023-12-19T16:15:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c804e070 con 0x7f16c806d410 2023-12-19T16:15:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.801+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16b8004b70 con 0x7f16c806d410 2023-12-19T16:15:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.805+0000 7f16af7fe640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 0x7f16b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:50.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.805+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b8082540 con 0x7f16c806d410 2023-12-19T16:15:50.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.805+0000 7f16c659c640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 0x7f16b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:50.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.805+0000 7f16c659c640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 0x7f16b4067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0af000 tx=0x7f16bc0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:50.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.809+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16b804fe60 con 0x7f16c806d410 2023-12-19T16:15:50.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.953+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16c81586b0 con 0x7f16c806d410 2023-12-19T16:15:50.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16af7fe640 1 -- 172.21.15.73:0/3459413523 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16b8018020 con 0x7f16c806d410 2023-12-19T16:15:50.959 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:15:50.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 msgr2=0x7f16b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 0x7f16b4067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0af000 tx=0x7f16bc0a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 msgr2=0x7f16c8150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f16b80011f0 tx=0x7f16b800c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 shutdown_connections 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16c81598c0 0x7f16c814e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c80b0660 0x7f16c814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f16b4065a60 0x7f16b4067f20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 --2- 172.21.15.73:0/3459413523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16c806d410 0x7f16c8150910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 >> 172.21.15.73:0/3459413523 conn(0x7f16c806a570 msgr2=0x7f16c8158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 shutdown_connections 2023-12-19T16:15:50.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:50.957+0000 7f16cd22d640 1 -- 172.21.15.73:0/3459413523 wait complete. 2023-12-19T16:15:50.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:51.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 Processor -- start 2023-12-19T16:15:51.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 -- start start 2023-12-19T16:15:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 0x7f14dc0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 0x7f14dc1606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0b53c0 con 0x7f14dc0d2020 2023-12-19T16:15:51.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0d27c0 con 0x7f14dc15ff10 2023-12-19T16:15:51.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e3960640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0b4600 con 0x7f14dc0d3140 2023-12-19T16:15:51.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e1efd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 0x7f14dc1606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e0efb640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f14dc0d2020 0x7f14dc0d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42530/0 (socket says 172.21.15.73:42530) 2023-12-19T16:15:51.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e0efb640 1 -- 172.21.15.73:0/2922879587 learned_addr learned my addr 172.21.15.73:0/2922879587 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e16fc640 1 --2- 172.21.15.73:0/2922879587 >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 0x7f14dc0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14d3fff640 1 -- 172.21.15.73:0/2922879587 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504095899 0 0) 0x7f14dc0b53c0 con 0x7f14dc0d2020 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e1efd640 1 -- 172.21.15.73:0/2922879587 >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 msgr2=0x7f14dc0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e1efd640 1 --2- 172.21.15.73:0/2922879587 >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 0x7f14dc0cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e1efd640 1 -- 172.21.15.73:0/2922879587 >> v1:172.21.15.162:6789/0 conn(0x7f14dc0d2020 legacy=0x7f14dc0d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e1efd640 1 -- 172.21.15.73:0/2922879587 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0b48e0 con 0x7f14dc0d3140 2023-12-19T16:15:51.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.117+0000 7f14e16fc640 1 --2- 172.21.15.73:0/2922879587 >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 0x7f14dc0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:51.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e1efd640 1 --2- 172.21.15.73:0/2922879587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 0x7f14dc1606d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3dab2de26c5488 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14d3fff640 1 -- 172.21.15.73:0/2922879587 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40a59e0 con 0x7f14dc0d3140 2023-12-19T16:15:51.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14d3fff640 1 -- 172.21.15.73:0/2922879587 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d40a5b40 con 0x7f14dc0d3140 2023-12-19T16:15:51.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14d3fff640 1 -- 172.21.15.73:0/2922879587 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40ad440 con 0x7f14dc0d3140 2023-12-19T16:15:51.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 -- 172.21.15.73:0/2922879587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 msgr2=0x7f14dc1606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 --2- 172.21.15.73:0/2922879587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 0x7f14dc1606d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009d90 tx=0x7f14d401c920 comp rx=0 tx=0).stop 2023-12-19T16:15:51.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 -- 172.21.15.73:0/2922879587 shutdown_connections 2023-12-19T16:15:51.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 --2- 172.21.15.73:0/2922879587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc0d3140 0x7f14dc1606d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 --2- 172.21.15.73:0/2922879587 >> v2:172.21.15.162:3300/0 conn(0x7f14dc15ff10 0x7f14dc0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 -- 172.21.15.73:0/2922879587 >> 172.21.15.73:0/2922879587 conn(0x7f14dc065ce0 msgr2=0x7f14dc0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 -- 172.21.15.73:0/2922879587 shutdown_connections 2023-12-19T16:15:51.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.121+0000 7f14e3960640 1 -- 172.21.15.73:0/2922879587 wait complete. 2023-12-19T16:15:51.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 Processor -- start 2023-12-19T16:15:51.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 -- start start 2023-12-19T16:15:51.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14dc0d2020 0x7f14dc0c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc15ff10 0x7f14dc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0c7bb0 con 0x7f14dc0d3140 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0c8730 con 0x7f14dc0d2020 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0c7e00 con 0x7f14dc15ff10 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39296/0 (socket says 172.21.15.73:39296) 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 -- 172.21.15.73:0/3352672973 learned_addr learned my addr 172.21.15.73:0/3352672973 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e16fc640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14dc0d2020 0x7f14dc0c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e1efd640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc15ff10 0x7f14dc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 -- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc15ff10 msgr2=0x7f14dc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc15ff10 0x7f14dc158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 -- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14dc0d2020 msgr2=0x7f14dc0c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14dc0d2020 0x7f14dc0c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 -- 172.21.15.73:0/3352672973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80093b0 con 0x7f14dc0d3140 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e0efb640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0011f0 tx=0x7f14cc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0074e0 con 0x7f14dc0d3140 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc007640 con 0x7f14dc0d3140 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d4009a70 con 0x7f14dc0d3140 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.125+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc004a10 con 0x7f14dc0d3140 2023-12-19T16:15:51.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc0c83c0 con 0x7f14dc0d3140 2023-12-19T16:15:51.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc0c88a0 con 0x7f14dc0d3140 2023-12-19T16:15:51.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14cc004b70 con 0x7f14dc0d3140 2023-12-19T16:15:51.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14d1ffb640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 0x7f14c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14cc082570 con 0x7f14dc0d3140 2023-12-19T16:15:51.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14e16fc640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 0x7f14c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.129+0000 7f14e16fc640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 0x7f14c0067f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0cff20 tx=0x7f14d8006f90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.133+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f14cc050070 con 0x7f14dc0d3140 2023-12-19T16:15:51.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.281+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14dc04e070 con 0x7f14dc0d3140 2023-12-19T16:15:51.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.281+0000 7f14d1ffb640 1 -- 172.21.15.73:0/3352672973 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14cc053690 con 0x7f14dc0d3140 2023-12-19T16:15:51.286 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 msgr2=0x7f14c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 0x7f14c0067f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0cff20 tx=0x7f14d8006f90 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 msgr2=0x7f14dc0c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14cc0011f0 tx=0x7f14cc00c9b0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 shutdown_connections 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14dc15ff10 0x7f14dc158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f14c0065a60 0x7f14c0067f20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14dc0d3140 0x7f14dc0c9bb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 --2- 172.21.15.73:0/3352672973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14dc0d2020 0x7f14dc0c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 >> 172.21.15.73:0/3352672973 conn(0x7f14dc065ce0 msgr2=0x7f14dc0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 shutdown_connections 2023-12-19T16:15:51.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.285+0000 7f14e3960640 1 -- 172.21.15.73:0/3352672973 wait complete. 2023-12-19T16:15:51.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:51.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 Processor -- start 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 -- start start 2023-12-19T16:15:51.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f80d1cb0 0x7f63f815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80b7250 con 0x7f63f80b4bd0 2023-12-19T16:15:51.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80b7530 con 0x7f63f80b47f0 2023-12-19T16:15:51.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63ff466640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80b7810 con 0x7f63f80d1cb0 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fca01640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f80d1cb0 0x7f63f815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fda03640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f63f80b4bd0 0x7f63f80b5c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56680/0 (socket says 172.21.15.73:56680) 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fda03640 1 -- 172.21.15.73:0/3101377617 learned_addr learned my addr 172.21.15.73:0/3101377617 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fca01640 1 -- 172.21.15.73:0/3101377617 >> v1:172.21.15.162:6789/0 conn(0x7f63f80b47f0 legacy=0x7f63f80b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fca01640 1 -- 172.21.15.73:0/3101377617 >> v1:172.21.15.73:6789/0 conn(0x7f63f80b4bd0 legacy=0x7f63f80b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.441+0000 7f63fca01640 1 -- 172.21.15.73:0/3101377617 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f80b7af0 con 0x7f63f80d1cb0 2023-12-19T16:15:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63fca01640 1 --2- 172.21.15.73:0/3101377617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80d1cb0 0x7f63f815c8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097c0 tx=0x7f63e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67f3bd83c6a9301 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63effff640 1 -- 172.21.15.73:0/3101377617 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80ab660 con 0x7f63f80d1cb0 2023-12-19T16:15:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63effff640 1 -- 172.21.15.73:0/3101377617 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80ab7c0 con 0x7f63f80d1cb0 2023-12-19T16:15:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63effff640 1 -- 172.21.15.73:0/3101377617 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80abb50 con 0x7f63f80d1cb0 2023-12-19T16:15:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 -- 172.21.15.73:0/3101377617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80d1cb0 msgr2=0x7f63f815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 --2- 172.21.15.73:0/3101377617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80d1cb0 0x7f63f815c8e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f63e80097c0 tx=0x7f63e801c480 comp rx=0 tx=0).stop 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 -- 172.21.15.73:0/3101377617 shutdown_connections 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 --2- 172.21.15.73:0/3101377617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80d1cb0 0x7f63f815c8e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 -- 172.21.15.73:0/3101377617 >> 172.21.15.73:0/3101377617 conn(0x7f63f8065ce0 msgr2=0x7f63f80660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 -- 172.21.15.73:0/3101377617 shutdown_connections 2023-12-19T16:15:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.445+0000 7f63ff466640 1 -- 172.21.15.73:0/3101377617 wait complete. 2023-12-19T16:15:51.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 Processor -- start 2023-12-19T16:15:51.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- start start 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f80b4bd0 0x7f63f80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63f80d1cb0 0x7f63f814e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f815b6b0 con 0x7f63f80b47f0 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f814a710 con 0x7f63f80b4bd0 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f8149d40 con 0x7f63f80d1cb0 2023-12-19T16:15:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39324/0 (socket says 172.21.15.73:39324) 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 -- 172.21.15.73:0/494116265 learned_addr learned my addr 172.21.15.73:0/494116265 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 -- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63f80d1cb0 msgr2=0x7f63f814e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63f80d1cb0 0x7f63f814e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 -- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f80b4bd0 msgr2=0x7f63f80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f80b4bd0 0x7f63f80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 -- 172.21.15.73:0/494116265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8009420 con 0x7f63f80b47f0 2023-12-19T16:15:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63fd202640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c530 tx=0x7f63f400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4005220 con 0x7f63f80b47f0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f4005380 con 0x7f63f80b47f0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007270 con 0x7f63f80b47f0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80c8b50 con 0x7f63f80b47f0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.449+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f8149410 con 0x7f63f80b47f0 2023-12-19T16:15:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8074050 con 0x7f63f80b47f0 2023-12-19T16:15:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63f40073d0 con 0x7f63f80b47f0 2023-12-19T16:15:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63edffb640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 0x7f63dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63f4082a10 con 0x7f63f80b47f0 2023-12-19T16:15:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63fca01640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 0x7f63dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.453+0000 7f63fca01640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 0x7f63dc067f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.457+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f63f4050460 con 0x7f63f80b47f0 2023-12-19T16:15:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.637+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63f80cfd90 con 0x7f63f80b47f0 2023-12-19T16:15:51.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.637+0000 7f63edffb640 1 -- 172.21.15.73:0/494116265 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f63f4053a80 con 0x7f63f80b47f0 2023-12-19T16:15:51.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:51.642 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:51.643 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:15:51.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 msgr2=0x7f63dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 0x7f63dc067f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63e80af000 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 msgr2=0x7f63f814a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f63f400c530 tx=0x7f63f400c9f0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 shutdown_connections 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63f80d1cb0 0x7f63f814e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63f80b4bd0 0x7f63f80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63dc065a90 0x7f63dc067f50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 --2- 172.21.15.73:0/494116265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f80b47f0 0x7f63f814a1d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 >> 172.21.15.73:0/494116265 conn(0x7f63f8065ce0 msgr2=0x7f63f80c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 shutdown_connections 2023-12-19T16:15:51.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.641+0000 7f63ff466640 1 -- 172.21.15.73:0/494116265 wait complete. 2023-12-19T16:15:51.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 Processor -- start 2023-12-19T16:15:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 -- start start 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f152c0d1cb0 0x7f152c15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0b4bd0 0x7f152c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0b7250 con 0x7f152c0b47f0 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0b7530 con 0x7f152c0d1cb0 2023-12-19T16:15:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1534212640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c0b7810 con 0x7f152c0b4bd0 2023-12-19T16:15:51.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15327af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0b4bd0 0x7f152c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15317ad640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f152c0d1cb0 0x7f152c15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1531fae640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f152c0b47f0 0x7f152c0b8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42550/0 (socket says 172.21.15.73:42550) 2023-12-19T16:15:51.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f1531fae640 1 -- 172.21.15.73:0/1025188577 learned_addr learned my addr 172.21.15.73:0/1025188577 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:51.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15317ad640 1 -- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0b4bd0 msgr2=0x7f152c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:51.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15317ad640 1 --2- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0b4bd0 0x7f152c15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15317ad640 1 -- 172.21.15.73:0/1025188577 >> v1:172.21.15.162:6789/0 conn(0x7f152c0b47f0 legacy=0x7f152c0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.797+0000 7f15317ad640 1 -- 172.21.15.73:0/1025188577 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0b7af0 con 0x7f152c0d1cb0 2023-12-19T16:15:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f15317ad640 1 --2- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0d1cb0 0x7f152c15c8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f151c0097c0 tx=0x7f151c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a48cefaa2f63fb1e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1530fac640 1 -- 172.21.15.73:0/1025188577 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0a6040 con 0x7f152c0d1cb0 2023-12-19T16:15:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1530fac640 1 -- 172.21.15.73:0/1025188577 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c0aa600 con 0x7f152c0d1cb0 2023-12-19T16:15:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1530fac640 1 -- 172.21.15.73:0/1025188577 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0aa990 con 0x7f152c0d1cb0 2023-12-19T16:15:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 -- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0d1cb0 msgr2=0x7f152c15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 --2- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0d1cb0 0x7f152c15c8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f151c0097c0 tx=0x7f151c01c480 comp rx=0 tx=0).stop 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 -- 172.21.15.73:0/1025188577 shutdown_connections 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 --2- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0b4bd0 0x7f152c15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 --2- 172.21.15.73:0/1025188577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0d1cb0 0x7f152c15c8e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 -- 172.21.15.73:0/1025188577 >> 172.21.15.73:0/1025188577 conn(0x7f152c065ce0 msgr2=0x7f152c0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 -- 172.21.15.73:0/1025188577 shutdown_connections 2023-12-19T16:15:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.801+0000 7f1534212640 1 -- 172.21.15.73:0/1025188577 wait complete. 2023-12-19T16:15:51.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 Processor -- start 2023-12-19T16:15:51.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 -- start start 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0b47f0 0x7f152c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0d1cb0 0x7f152c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c155de0 con 0x7f152c0b4bd0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1560c0 con 0x7f152c0b47f0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1563a0 con 0x7f152c0d1cb0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39340/0 (socket says 172.21.15.73:39340) 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 -- 172.21.15.73:0/1600982088 learned_addr learned my addr 172.21.15.73:0/1600982088 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15327af640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0d1cb0 0x7f152c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1531fae640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0b47f0 0x7f152c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 -- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0d1cb0 msgr2=0x7f152c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0d1cb0 0x7f152c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 -- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0b47f0 msgr2=0x7f152c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:51.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0b47f0 0x7f152c150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:51.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 -- 172.21.15.73:0/1600982088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009420 con 0x7f152c0b4bd0 2023-12-19T16:15:51.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15317ad640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f151c01a0b0 tx=0x7f151c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0b3800 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c0b3960 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c0b3cd0 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.805+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c156680 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c155a70 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c074050 con 0x7f152c0b4bd0 2023-12-19T16:15:51.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f151c0b2380 con 0x7f152c0b4bd0 2023-12-19T16:15:51.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f15227fc640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 0x7f1510067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:51.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f151c11d200 con 0x7f152c0b4bd0 2023-12-19T16:15:51.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f1531fae640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 0x7f1510067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:51.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.809+0000 7f1531fae640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 0x7f1510067f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f70 tx=0x7f1528009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:51.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.813+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f151c0eae20 con 0x7f152c0b4bd0 2023-12-19T16:15:52.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.997+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f152c156b30 con 0x7f152c0b4bd0 2023-12-19T16:15:52.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:51.997+0000 7f15227fc640 1 -- 172.21.15.73:0/1600982088 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f151c0ee440 con 0x7f152c0b4bd0 2023-12-19T16:15:52.001 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:52.002 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:52.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 msgr2=0x7f1510067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 0x7f1510067f50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1528000f70 tx=0x7f1528009040 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 msgr2=0x7f152c1526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f151c01a0b0 tx=0x7f151c01acc0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 shutdown_connections 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f152c0d1cb0 0x7f152c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1510065a90 0x7f1510067f50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f152c0b4bd0 0x7f152c1526e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 --2- 172.21.15.73:0/1600982088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f152c0b47f0 0x7f152c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 >> 172.21.15.73:0/1600982088 conn(0x7f152c065ce0 msgr2=0x7f152c154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 shutdown_connections 2023-12-19T16:15:52.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.001+0000 7f1534212640 1 -- 172.21.15.73:0/1600982088 wait complete. 2023-12-19T16:15:52.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:15:52.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:15:52.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 Processor -- start 2023-12-19T16:15:52.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 -- start start 2023-12-19T16:15:52.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35f406d410 0x7f35f40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f40b0660 0x7f35f40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f40cce80 con 0x7f35f41598c0 2023-12-19T16:15:52.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f40b0b10 con 0x7f35f406d410 2023-12-19T16:15:52.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35fa709640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40cc270 con 0x7f35f40b0660 2023-12-19T16:15:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35f406d410 0x7f35f40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f8ca6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f40b0660 0x7f35f40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f3fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f35f41598c0 0x7f35f406c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42558/0 (socket says 172.21.15.73:42558) 2023-12-19T16:15:52.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f3fff640 1 -- 172.21.15.73:0/231714767 learned_addr learned my addr 172.21.15.73:0/231714767 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f37fe640 1 -- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f40b0660 msgr2=0x7f35f40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f37fe640 1 --2- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f40b0660 0x7f35f40cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f37fe640 1 -- 172.21.15.73:0/231714767 >> v1:172.21.15.162:6789/0 conn(0x7f35f41598c0 legacy=0x7f35f406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f37fe640 1 -- 172.21.15.73:0/231714767 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f40cc550 con 0x7f35f406d410 2023-12-19T16:15:52.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.161+0000 7f35f2ffd640 1 -- 172.21.15.73:0/231714767 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128241709 0 0) 0x7f35f40cce80 con 0x7f35f41598c0 2023-12-19T16:15:52.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35f37fe640 1 --2- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f406d410 0x7f35f40b0120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097c0 tx=0x7f35e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2b12bc1b0a3c7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35f2ffd640 1 -- 172.21.15.73:0/231714767 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80ab650 con 0x7f35f406d410 2023-12-19T16:15:52.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35f2ffd640 1 -- 172.21.15.73:0/231714767 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80ab7b0 con 0x7f35f406d410 2023-12-19T16:15:52.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35f2ffd640 1 -- 172.21.15.73:0/231714767 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80abb40 con 0x7f35f406d410 2023-12-19T16:15:52.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 -- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f406d410 msgr2=0x7f35f40b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 --2- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f406d410 0x7f35f40b0120 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097c0 tx=0x7f35e801c450 comp rx=0 tx=0).stop 2023-12-19T16:15:52.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 -- 172.21.15.73:0/231714767 shutdown_connections 2023-12-19T16:15:52.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 --2- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f40b0660 0x7f35f40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 --2- 172.21.15.73:0/231714767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f406d410 0x7f35f40b0120 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 -- 172.21.15.73:0/231714767 >> 172.21.15.73:0/231714767 conn(0x7f35f406a570 msgr2=0x7f35f40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 -- 172.21.15.73:0/231714767 shutdown_connections 2023-12-19T16:15:52.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.165+0000 7f35fa709640 1 -- 172.21.15.73:0/231714767 wait complete. 2023-12-19T16:15:52.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 Processor -- start 2023-12-19T16:15:52.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- start start 2023-12-19T16:15:52.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f406d410 0x7f35f4163870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f40b0660 0x7f35f41f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40c16f0 con 0x7f35f41598c0 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f4163db0 con 0x7f35f40b0660 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40c5660 con 0x7f35f406d410 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39352/0 (socket says 172.21.15.73:39352) 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 -- 172.21.15.73:0/1332146026 learned_addr learned my addr 172.21.15.73:0/1332146026 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f3fff640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f406d410 0x7f35f4163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f37fe640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f40b0660 0x7f35f41f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 -- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f406d410 msgr2=0x7f35f4163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f406d410 0x7f35f4163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 -- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f40b0660 msgr2=0x7f35f41f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f40b0660 0x7f35f41f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 -- 172.21.15.73:0/1332146026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8009420 con 0x7f35f41598c0 2023-12-19T16:15:52.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f8ca6640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009dd0 tx=0x7f35ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec014480 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec00f040 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec014840 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f40c5f00 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.169+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f40c58b0 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f40c6090 con 0x7f35f41598c0 2023-12-19T16:15:52.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35ec0149a0 con 0x7f35f41598c0 2023-12-19T16:15:52.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35f0ff9640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 0x7f35e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35ec083b70 con 0x7f35f41598c0 2023-12-19T16:15:52.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35f3fff640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 0x7f35e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.173+0000 7f35f3fff640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 0x7f35e0067f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.177+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35ec0515e0 con 0x7f35f41598c0 2023-12-19T16:15:52.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.325+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35f404e070 con 0x7f35f41598c0 2023-12-19T16:15:52.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.325+0000 7f35f0ff9640 1 -- 172.21.15.73:0/1332146026 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35ec018020 con 0x7f35f41598c0 2023-12-19T16:15:52.330 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:15:52.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 msgr2=0x7f35e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 0x7f35e0067f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f35e4007fd0 tx=0x7f35e4007d60 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 msgr2=0x7f35f41f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009dd0 tx=0x7f35ec00c490 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 shutdown_connections 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f35e0065a60 0x7f35e0067f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35f41598c0 0x7f35f41f8960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35f40b0660 0x7f35f41f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 --2- 172.21.15.73:0/1332146026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35f406d410 0x7f35f4163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 >> 172.21.15.73:0/1332146026 conn(0x7f35f406a570 msgr2=0x7f35f4070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 shutdown_connections 2023-12-19T16:15:52.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.329+0000 7f35fa709640 1 -- 172.21.15.73:0/1332146026 wait complete. 2023-12-19T16:15:52.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:15:52.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 Processor -- start 2023-12-19T16:15:52.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 -- start start 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2984159230 0x7f29840ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29840cd520 0x7f298406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840ca9f0 con 0x7f29840cc160 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840c9760 con 0x7f29840cd520 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298ad6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29840c99d0 con 0x7f2984159230 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f297bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f29840cc160 0x7f29840cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56690/0 (socket says 172.21.15.73:56690) 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f297bfff640 1 -- 172.21.15.73:0/2051780375 learned_addr learned my addr 172.21.15.73:0/2051780375 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.489+0000 7f298930a640 1 --2- 172.21.15.73:0/2051780375 >> v2:172.21.15.73:3300/0 conn(0x7f29840cd520 0x7f298406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f2988b09640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2984159230 0x7f29840ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f297b7fe640 1 -- 172.21.15.73:0/2051780375 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843296558 0 0) 0x7f2974001120 con 0x7f29840cc160 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f297b7fe640 1 -- 172.21.15.73:0/2051780375 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c003530 con 0x7f29840cc160 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298930a640 1 -- 172.21.15.73:0/2051780375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2984159230 msgr2=0x7f29840ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298930a640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2984159230 0x7f29840ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298930a640 1 -- 172.21.15.73:0/2051780375 >> v1:172.21.15.73:6789/0 conn(0x7f29840cc160 legacy=0x7f29840cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298930a640 1 -- 172.21.15.73:0/2051780375 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840c9cb0 con 0x7f29840cd520 2023-12-19T16:15:52.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298930a640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298406bb80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f297c009d90 tx=0x7f297c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bbb5d0424c95aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f297b7fe640 1 -- 172.21.15.73:0/2051780375 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0a5870 con 0x7f29840cd520 2023-12-19T16:15:52.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f297b7fe640 1 -- 172.21.15.73:0/2051780375 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0a59d0 con 0x7f29840cd520 2023-12-19T16:15:52.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f297b7fe640 1 -- 172.21.15.73:0/2051780375 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0a5d60 con 0x7f29840cd520 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.493+0000 7f298ad6d640 1 -- 172.21.15.73:0/2051780375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 msgr2=0x7f298406bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298406bb80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f297c009d90 tx=0x7f297c01c920 comp rx=0 tx=0).stop 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- 172.21.15.73:0/2051780375 shutdown_connections 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298406bb80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- 172.21.15.73:0/2051780375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2984159230 0x7f29840ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- 172.21.15.73:0/2051780375 >> 172.21.15.73:0/2051780375 conn(0x7f298406a570 msgr2=0x7f29840ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- 172.21.15.73:0/2051780375 shutdown_connections 2023-12-19T16:15:52.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- 172.21.15.73:0/2051780375 wait complete. 2023-12-19T16:15:52.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 Processor -- start 2023-12-19T16:15:52.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- start start 2023-12-19T16:15:52.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29840cc160 0x7f2984150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29841f8a90 0x7f29840af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984150c50 con 0x7f29840cd520 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841f8f90 con 0x7f29841f8a90 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298ad6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29841f9270 con 0x7f29840cc160 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39368/0 (socket says 172.21.15.73:39368) 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 -- 172.21.15.73:0/3847623196 learned_addr learned my addr 172.21.15.73:0/3847623196 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f298930a640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29841f8a90 0x7f29840af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f2988b09640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29840cc160 0x7f2984150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 -- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29840cc160 msgr2=0x7f2984150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29840cc160 0x7f2984150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 -- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29841f8a90 msgr2=0x7f29840af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29841f8a90 0x7f29840af290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 -- 172.21.15.73:0/3847623196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c009a70 con 0x7f29840cd520 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.497+0000 7f297bfff640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f297400c4d0 tx=0x7f297400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974005cf0 con 0x7f29840cd520 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974005e50 con 0x7f29840cd520 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29841f9550 con 0x7f29840cd520 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974007290 con 0x7f29840cd520 2023-12-19T16:15:52.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29840b1280 con 0x7f29840cd520 2023-12-19T16:15:52.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29840b1470 con 0x7f29840cd520 2023-12-19T16:15:52.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f29740073f0 con 0x7f29840cd520 2023-12-19T16:15:52.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 0x7f2970067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29740825a0 con 0x7f29840cd520 2023-12-19T16:15:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f2988b09640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 0x7f2970067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.501+0000 7f2988b09640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 0x7f2970067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2980009ac0 tx=0x7f2980009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.505+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2974050000 con 0x7f29840cd520 2023-12-19T16:15:52.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29840ca9f0 con 0x7f29840cd520 2023-12-19T16:15:52.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f29797fa640 1 -- 172.21.15.73:0/3847623196 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29840ca9f0 con 0x7f29840cd520 2023-12-19T16:15:52.661 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 msgr2=0x7f2970067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 0x7f2970067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2980009ac0 tx=0x7f2980009190 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 msgr2=0x7f298415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.657+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f297400c4d0 tx=0x7f297400c990 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 shutdown_connections 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29841f8a90 0x7f29840af290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2970065a60 0x7f2970067f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29840cd520 0x7f298415b640 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 --2- 172.21.15.73:0/3847623196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29840cc160 0x7f2984150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 >> 172.21.15.73:0/3847623196 conn(0x7f298406a570 msgr2=0x7f298406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 shutdown_connections 2023-12-19T16:15:52.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.661+0000 7f298ad6d640 1 -- 172.21.15.73:0/3847623196 wait complete. 2023-12-19T16:15:52.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:15:52.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.817+0000 7f862d5b3640 1 Processor -- start 2023-12-19T16:15:52.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.817+0000 7f862d5b3640 1 -- start start 2023-12-19T16:15:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f862d5b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f862815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f862d5b3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280ca4d0 con 0x7f86280c8b20 2023-12-19T16:15:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f862d5b3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280cb9a0 con 0x7f86280cd080 2023-12-19T16:15:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f862d5b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280c9470 con 0x7f86280caba0 2023-12-19T16:15:52.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f861ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86280c8b20 0x7f86280caf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56704/0 (socket says 172.21.15.73:56704) 2023-12-19T16:15:52.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f861ffff640 1 -- 172.21.15.73:0/140038145 learned_addr learned my addr 172.21.15.73:0/140038145 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:52.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f862815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101933573 0 0) 0x7f86280ca4d0 con 0x7f86280c8b20 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8614003530 con 0x7f86280c8b20 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836098806 0 0) 0x7f8614003530 con 0x7f86280c8b20 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 msgr2=0x7f862815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f862815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 >> v1:172.21.15.162:6789/0 conn(0x7f86280cd080 legacy=0x7f86280cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280c9710 con 0x7f86280c8b20 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f8610001680 con 0x7f86280c8b20 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 >> v1:172.21.15.73:6789/0 conn(0x7f86280c8b20 legacy=0x7f86280caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86140039b0 0x7f8614003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f86140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8614004d10 0x7f8614005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280c9470 con 0x7f86140039b0 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861400cb50 con 0x7f8614004d10 2023-12-19T16:15:52.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86140059e0 con 0x7f86280caba0 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86140039b0 0x7f8614003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f861ffff640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f86140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f86277fe640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8614004d10 0x7f8614005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 -- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 msgr2=0x7f86140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280caba0 0x7f86140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 -- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8614004d10 msgr2=0x7f8614005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8614004d10 0x7f8614005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.821+0000 7f8626ffd640 1 -- 172.21.15.73:0/140038145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8614003530 con 0x7f86140039b0 2023-12-19T16:15:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f8626ffd640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86140039b0 0x7f8614003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8618009ae0 tx=0x7f861801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb1edea78318a36 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86180a55f0 con 0x7f86140039b0 2023-12-19T16:15:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86180a5750 con 0x7f86140039b0 2023-12-19T16:15:52.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f86267fc640 1 -- 172.21.15.73:0/140038145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86180a5b00 con 0x7f86140039b0 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 -- 172.21.15.73:0/140038145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86140039b0 msgr2=0x7f8614003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 --2- 172.21.15.73:0/140038145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86140039b0 0x7f8614003d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8618009ae0 tx=0x7f861801ca20 comp rx=0 tx=0).stop 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f86277fe640 1 -- 172.21.15.73:0/140038145 reap_dead start 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 -- 172.21.15.73:0/140038145 shutdown_connections 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 -- 172.21.15.73:0/140038145 >> 172.21.15.73:0/140038145 conn(0x7f862806a320 msgr2=0x7f862806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 -- 172.21.15.73:0/140038145 shutdown_connections 2023-12-19T16:15:52.829 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 -- 172.21.15.73:0/140038145 wait complete. 2023-12-19T16:15:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.825+0000 7f862d5b3640 1 Processor -- start 2023-12-19T16:15:52.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- start start 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86140039b0 0x7f8628153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280c7940 0x7f86280c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280c8300 con 0x7f8628154570 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280c2b70 con 0x7f86140039b0 2023-12-19T16:15:52.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86281eaf80 con 0x7f86280c7940 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39378/0 (socket says 172.21.15.73:39378) 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 -- 172.21.15.73:0/1242191106 learned_addr learned my addr 172.21.15.73:0/1242191106 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f8626ffd640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86140039b0 0x7f8628153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f86277fe640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280c7940 0x7f86280c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 -- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280c7940 msgr2=0x7f86280c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280c7940 0x7f86280c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 -- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86140039b0 msgr2=0x7f8628153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86140039b0 0x7f8628153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 -- 172.21.15.73:0/1242191106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86281eb260 con 0x7f8628154570 2023-12-19T16:15:52.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861ffff640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f861000e7f0 tx=0x7f861000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000c8d0 con 0x7f8628154570 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000ca30 con 0x7f8628154570 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280c2800 con 0x7f8628154570 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000cde0 con 0x7f8628154570 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86281eab50 con 0x7f8628154570 2023-12-19T16:15:52.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86280c2610 con 0x7f8628154570 2023-12-19T16:15:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.829+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f861001d460 con 0x7f8628154570 2023-12-19T16:15:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.833+0000 7f861f7fe640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 0x7f8608067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.833+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8610082fe0 con 0x7f8628154570 2023-12-19T16:15:52.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.833+0000 7f8626ffd640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 0x7f8608067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:52.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.833+0000 7f8626ffd640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 0x7f8608067f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86180af000 tx=0x7f86180046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:52.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.837+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8610050a10 con 0x7f8628154570 2023-12-19T16:15:52.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f862804e000 con 0x7f8628154570 2023-12-19T16:15:52.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f861f7fe640 1 -- 172.21.15.73:0/1242191106 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8610054030 con 0x7f8628154570 2023-12-19T16:15:52.988 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 msgr2=0x7f8608067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 0x7f8608067f50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f86180af000 tx=0x7f86180046d0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 msgr2=0x7f86281ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f861000e7f0 tx=0x7f861000ecb0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 shutdown_connections 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86280c7940 0x7f86280c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8608065a90 0x7f8608067f50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8628154570 0x7f86281ea610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 --2- 172.21.15.73:0/1242191106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86140039b0 0x7f8628153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:52.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 >> 172.21.15.73:0/1242191106 conn(0x7f862806a320 msgr2=0x7f8628155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 shutdown_connections 2023-12-19T16:15:52.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:52.985+0000 7f862d5b3640 1 -- 172.21.15.73:0/1242191106 wait complete. 2023-12-19T16:15:53.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.141+0000 7ff9f9804640 1 Processor -- start 2023-12-19T16:15:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.141+0000 7ff9f9804640 1 -- start start 2023-12-19T16:15:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f9804640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f40b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f9804640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9f40adad0 0x7ff9f406b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f9804640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f4160800 con 0x7ff9f4160420 2023-12-19T16:15:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f9804640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f40b0830 con 0x7ff9f40adad0 2023-12-19T16:15:53.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f9804640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40b0b10 con 0x7ff9f40af830 2023-12-19T16:15:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9f40adad0 0x7ff9f406b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9ea7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f40b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f2ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff9f4160420 0x7ff9f40ad3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:42566/0 (socket says 172.21.15.73:42566) 2023-12-19T16:15:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f2ffd640 1 -- 172.21.15.73:0/2846489559 learned_addr learned my addr 172.21.15.73:0/2846489559 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f37fe640 1 -- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 msgr2=0x7ff9f40b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f37fe640 1 --2- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f40b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f37fe640 1 -- 172.21.15.73:0/2846489559 >> v1:172.21.15.162:6789/0 conn(0x7ff9f4160420 legacy=0x7ff9f40ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f27fc640 1 -- 172.21.15.73:0/2846489559 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297940701 0 0) 0x7ff9f4160800 con 0x7ff9f4160420 2023-12-19T16:15:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.145+0000 7ff9f37fe640 1 -- 172.21.15.73:0/2846489559 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f40b0df0 con 0x7ff9f40adad0 2023-12-19T16:15:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f37fe640 1 --2- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40adad0 0x7ff9f406b510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097c0 tx=0x7ff9ec01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c4fb43ef87d551 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f27fc640 1 -- 172.21.15.73:0/2846489559 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0a8970 con 0x7ff9f40adad0 2023-12-19T16:15:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f27fc640 1 -- 172.21.15.73:0/2846489559 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec0a8ad0 con 0x7ff9f40adad0 2023-12-19T16:15:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f27fc640 1 -- 172.21.15.73:0/2846489559 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0a8e60 con 0x7ff9f40adad0 2023-12-19T16:15:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40adad0 msgr2=0x7ff9f406b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 --2- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40adad0 0x7ff9f406b510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097c0 tx=0x7ff9ec01ec70 comp rx=0 tx=0).stop 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- 172.21.15.73:0/2846489559 shutdown_connections 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 --2- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f40b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 --2- 172.21.15.73:0/2846489559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40adad0 0x7ff9f406b510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- 172.21.15.73:0/2846489559 >> 172.21.15.73:0/2846489559 conn(0x7ff9f40d0730 msgr2=0x7ff9f40d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- 172.21.15.73:0/2846489559 shutdown_connections 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- 172.21.15.73:0/2846489559 wait complete. 2023-12-19T16:15:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 Processor -- start 2023-12-19T16:15:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.149+0000 7ff9f9804640 1 -- start start 2023-12-19T16:15:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f41e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f4160420 0x7ff9f41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40b6180 con 0x7ff9f40adad0 2023-12-19T16:15:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40c7b50 con 0x7ff9f4160420 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f40c7e30 con 0x7ff9f40af830 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39380/0 (socket says 172.21.15.73:39380) 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 -- 172.21.15.73:0/3907048238 learned_addr learned my addr 172.21.15.73:0/3907048238 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f37fe640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f4160420 0x7ff9f41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9ea7fc640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f41e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 -- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 msgr2=0x7ff9f41e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f41e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 -- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f4160420 msgr2=0x7ff9f41537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f4160420 0x7ff9f41537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 -- 172.21.15.73:0/3907048238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009420 con 0x7ff9f40adad0 2023-12-19T16:15:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9ea7fc640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f41e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f2ffd640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c7c0 tx=0x7ff9e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400a640 con 0x7ff9f40adad0 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e400a7c0 con 0x7ff9f40adad0 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e400ab70 con 0x7ff9f40adad0 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f40ae0e0 con 0x7ff9f40adad0 2023-12-19T16:15:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f40c83f0 con 0x7ff9f40adad0 2023-12-19T16:15:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f404e000 con 0x7ff9f40adad0 2023-12-19T16:15:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.153+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9e400acd0 con 0x7ff9f40adad0 2023-12-19T16:15:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.157+0000 7ff9f0ff9640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 0x7ff9d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.157+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9e4082610 con 0x7ff9f40adad0 2023-12-19T16:15:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.157+0000 7ff9ea7fc640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 0x7ff9d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.157+0000 7ff9ea7fc640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 0x7ff9d4067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40cf9d0 tx=0x7ff9dc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.161+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9e4050110 con 0x7ff9f40adad0 2023-12-19T16:15:53.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9f406c9e0 con 0x7ff9f40adad0 2023-12-19T16:15:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f0ff9640 1 -- 172.21.15.73:0/3907048238 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7ff9e4018090 con 0x7ff9f40adad0 2023-12-19T16:15:53.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:53.344 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:53.344 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:15:53.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 msgr2=0x7ff9d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 0x7ff9d4067f20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9f40cf9d0 tx=0x7ff9dc008040 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 msgr2=0x7ff9f40b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400c7c0 tx=0x7ff9e400cc80 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 shutdown_connections 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f4160420 0x7ff9f41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40af830 0x7ff9f41e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9d4065a60 0x7ff9d4067f20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 --2- 172.21.15.73:0/3907048238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9f40adad0 0x7ff9f40b32b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 >> 172.21.15.73:0/3907048238 conn(0x7ff9f40d0730 msgr2=0x7ff9f40ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 shutdown_connections 2023-12-19T16:15:53.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.341+0000 7ff9f9804640 1 -- 172.21.15.73:0/3907048238 wait complete. 2023-12-19T16:15:53.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:15:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 Processor -- start 2023-12-19T16:15:53.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 -- start start 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feefc0b47f0 0x7feefc0b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 0x7feefc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc15d290 con 0x7feefc15ce20 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0b7250 con 0x7feefc0b47f0 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7fef01bf0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0b7530 con 0x7feefc0b4bd0 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feefc0b47f0 0x7feefc0b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feefc15ce20 0x7feefc0d0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56710/0 (socket says 172.21.15.73:56710) 2023-12-19T16:15:53.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefbfff640 1 -- 172.21.15.73:0/3131814731 learned_addr learned my addr 172.21.15.73:0/3131814731 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefb7fe640 1 -- 172.21.15.73:0/3131814731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 msgr2=0x7feefc15c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefaffd640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 0x7feefc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefa7fc640 1 -- 172.21.15.73:0/3131814731 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996698682 0 0) 0x7feefc15d290 con 0x7feefc15ce20 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefb7fe640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 0x7feefc15c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefb7fe640 1 -- 172.21.15.73:0/3131814731 >> v1:172.21.15.73:6789/0 conn(0x7feefc15ce20 legacy=0x7feefc0d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefb7fe640 1 -- 172.21.15.73:0/3131814731 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0b7810 con 0x7feefc0b47f0 2023-12-19T16:15:53.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.501+0000 7feefaffd640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 0x7feefc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:53.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7feefb7fe640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b47f0 0x7feefc0b8430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097c0 tx=0x7feeec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b98fac242a9278 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7feefa7fc640 1 -- 172.21.15.73:0/3131814731 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0ab600 con 0x7feefc0b47f0 2023-12-19T16:15:53.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7feefa7fc640 1 -- 172.21.15.73:0/3131814731 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec0a7050 con 0x7feefc0b47f0 2023-12-19T16:15:53.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7feefa7fc640 1 -- 172.21.15.73:0/3131814731 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec0ab980 con 0x7feefc0b47f0 2023-12-19T16:15:53.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 -- 172.21.15.73:0/3131814731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b47f0 msgr2=0x7feefc0b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b47f0 0x7feefc0b8430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097c0 tx=0x7feeec01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 -- 172.21.15.73:0/3131814731 shutdown_connections 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b4bd0 0x7feefc15c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 --2- 172.21.15.73:0/3131814731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b47f0 0x7feefc0b8430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 -- 172.21.15.73:0/3131814731 >> 172.21.15.73:0/3131814731 conn(0x7feefc065ce0 msgr2=0x7feefc0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 -- 172.21.15.73:0/3131814731 shutdown_connections 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.505+0000 7fef01bf0640 1 -- 172.21.15.73:0/3131814731 wait complete. 2023-12-19T16:15:53.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 Processor -- start 2023-12-19T16:15:53.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- start start 2023-12-19T16:15:53.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b47f0 0x7feefc146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc15ce20 0x7feefc0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc15b8c0 con 0x7feefc0b4bd0 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0c59d0 con 0x7feefc15ce20 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0c4ad0 con 0x7feefc0b47f0 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39406/0 (socket says 172.21.15.73:39406) 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 -- 172.21.15.73:0/2556658603 learned_addr learned my addr 172.21.15.73:0/2556658603 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefb7fe640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b47f0 0x7feefc146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefbfff640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc15ce20 0x7feefc0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 -- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b47f0 msgr2=0x7feefc146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b47f0 0x7feefc146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 -- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc15ce20 msgr2=0x7feefc0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc15ce20 0x7feefc0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 -- 172.21.15.73:0/2556658603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009420 con 0x7feefc0b4bd0 2023-12-19T16:15:53.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feefaffd640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feef000c7f0 tx=0x7feef000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0007820 con 0x7feefc0b4bd0 2023-12-19T16:15:53.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0007980 con 0x7feefc0b4bd0 2023-12-19T16:15:53.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0007d30 con 0x7feefc0b4bd0 2023-12-19T16:15:53.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc15b340 con 0x7feefc0b4bd0 2023-12-19T16:15:53.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0c5c20 con 0x7feefc0b4bd0 2023-12-19T16:15:53.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.509+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc074050 con 0x7feefc0b4bd0 2023-12-19T16:15:53.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.513+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feef00113f0 con 0x7feefc0b4bd0 2023-12-19T16:15:53.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.513+0000 7feee3fff640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 0x7feee8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.513+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feef0083550 con 0x7feefc0b4bd0 2023-12-19T16:15:53.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.513+0000 7feefb7fe640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 0x7feee8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.513+0000 7feefb7fe640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 0x7feee8067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ad000 tx=0x7feeec0a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.517+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feef0050e90 con 0x7feefc0b4bd0 2023-12-19T16:15:53.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feefc0cfd90 con 0x7feefc0b4bd0 2023-12-19T16:15:53.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7feee3fff640 1 -- 172.21.15.73:0/2556658603 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7feef00544b0 con 0x7feefc0b4bd0 2023-12-19T16:15:53.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:53.672 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:15:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 msgr2=0x7feee8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 0x7feee8067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feeec0ad000 tx=0x7feeec0a6000 comp rx=0 tx=0).stop 2023-12-19T16:15:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 msgr2=0x7feefc0c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feef000c7f0 tx=0x7feef000ccb0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 shutdown_connections 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feefc15ce20 0x7feefc0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feee8065a60 0x7feee8067f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feefc0b4bd0 0x7feefc0c4f50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 --2- 172.21.15.73:0/2556658603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feefc0b47f0 0x7feefc146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 >> 172.21.15.73:0/2556658603 conn(0x7feefc065ce0 msgr2=0x7feefc156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 shutdown_connections 2023-12-19T16:15:53.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.669+0000 7fef01bf0640 1 -- 172.21.15.73:0/2556658603 wait complete. 2023-12-19T16:15:53.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 Processor -- start 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 -- start start 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fa40cd580 0x7f2fa406c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2fa406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa40ca6f0 con 0x7f2fa406ddf0 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa40cccb0 con 0x7f2fa40cd580 2023-12-19T16:15:53.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fac525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4159530 con 0x7f2fa40cbe90 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2faa2c1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2fa406ddf0 0x7f2fa40cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56722/0 (socket says 172.21.15.73:56722) 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2faa2c1640 1 -- 172.21.15.73:0/3926506693 learned_addr learned my addr 172.21.15.73:0/3926506693 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa9ac0640 1 --2- 172.21.15.73:0/3926506693 >> v2:172.21.15.162:3300/0 conn(0x7f2fa40cd580 0x7f2fa406c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2faaac2640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2fa406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168125945 0 0) 0x7f2fa40ca6f0 con 0x7f2fa406ddf0 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f90003530 con 0x7f2fa406ddf0 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4253374249 0 0) 0x7f2f90003530 con 0x7f2fa406ddf0 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 msgr2=0x7f2fa406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2fa406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 >> v2:172.21.15.162:3300/0 conn(0x7f2fa40cd580 msgr2=0x7f2fa406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 --2- 172.21.15.73:0/3926506693 >> v2:172.21.15.162:3300/0 conn(0x7f2fa40cd580 0x7f2fa406c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40c9ae0 con 0x7f2fa406ddf0 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f2fa0001680 con 0x7f2fa406ddf0 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 >> v1:172.21.15.73:6789/0 conn(0x7f2fa406ddf0 legacy=0x7f2fa40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2f90003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90003f00 0x7f2f900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d10 0x7f2f90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4159530 con 0x7f2f90004d10 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9000b990 con 0x7f2f90003f00 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9000bad0 con 0x7f2fa40cbe90 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2faaac2640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d10 0x7f2f90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2fa9ac0640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90003f00 0x7f2f900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.829+0000 7f2faa2c1640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2f90003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 -- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 msgr2=0x7f2f90003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40cbe90 0x7f2f90003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 -- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90003f00 msgr2=0x7f2f900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:53.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90003f00 0x7f2f900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 -- 172.21.15.73:0/3926506693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90003530 con 0x7f2f90004d10 2023-12-19T16:15:53.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d10 0x7f2f90005190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009f90 tx=0x7f2f9c01cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317988eefe349822 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0a5e40 con 0x7f2f90004d10 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0ad440 con 0x7f2f90004d10 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fa92bf640 1 -- 172.21.15.73:0/3926506693 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0ad7f0 con 0x7f2f90004d10 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fac525640 1 -- 172.21.15.73:0/3926506693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d10 msgr2=0x7f2f90005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fac525640 1 --2- 172.21.15.73:0/3926506693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f90004d10 0x7f2f90005190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009f90 tx=0x7f2f9c01cdd0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2faaac2640 1 -- 172.21.15.73:0/3926506693 reap_dead start 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fac525640 1 -- 172.21.15.73:0/3926506693 shutdown_connections 2023-12-19T16:15:53.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.833+0000 7f2fac525640 1 -- 172.21.15.73:0/3926506693 >> 172.21.15.73:0/3926506693 conn(0x7f2fa40b0270 msgr2=0x7f2fa40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:53.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- 172.21.15.73:0/3926506693 shutdown_connections 2023-12-19T16:15:53.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- 172.21.15.73:0/3926506693 wait complete. 2023-12-19T16:15:53.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 Processor -- start 2023-12-19T16:15:53.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- start start 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40c8680 0x7f2fa414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40b3cf0 0x7f2fa415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa4155f40 con 0x7f2fa40b3cf0 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40b2c50 con 0x7f2f90004d10 2023-12-19T16:15:53.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fac525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa40b2f30 con 0x7f2fa40c8680 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:42762/0 (socket says 172.21.15.73:42762) 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 -- 172.21.15.73:0/110082427 learned_addr learned my addr 172.21.15.73:0/110082427 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2fa9ac0640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40c8680 0x7f2fa414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faaac2640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40b3cf0 0x7f2fa415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 -- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40c8680 msgr2=0x7f2fa414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40c8680 0x7f2fa414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 -- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40b3cf0 msgr2=0x7f2fa415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40b3cf0 0x7f2fa415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 -- 172.21.15.73:0/110082427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40b3210 con 0x7f2f90004d10 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.837+0000 7f2faa2c1640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000e8c0 tx=0x7f2fa000ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0017070 con 0x7f2f90004d10 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000c8d0 con 0x7f2f90004d10 2023-12-19T16:15:53.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000caa0 con 0x7f2f90004d10 2023-12-19T16:15:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa40b34f0 con 0x7f2f90004d10 2023-12-19T16:15:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa40c8ae0 con 0x7f2f90004d10 2023-12-19T16:15:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa4074050 con 0x7f2f90004d10 2023-12-19T16:15:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fa000cc00 con 0x7f2f90004d10 2023-12-19T16:15:53.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 0x7f2f88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:53.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fa00828b0 con 0x7f2f90004d10 2023-12-19T16:15:53.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2fa9ac0640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 0x7f2f88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:53.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.841+0000 7f2fa9ac0640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 0x7f2f88067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40b1180 tx=0x7f2f94014040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:53.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:53.845+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fa0050310 con 0x7f2f90004d10 2023-12-19T16:15:54.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.025+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fa40ce190 con 0x7f2f90004d10 2023-12-19T16:15:54.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2f9affd640 1 -- 172.21.15.73:0/110082427 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f2fa0053930 con 0x7f2f90004d10 2023-12-19T16:15:54.031 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:15:54.031 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:15:54.031 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 msgr2=0x7f2f88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 0x7f2f88067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40b1180 tx=0x7f2f94014040 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 msgr2=0x7f2fa40c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000e8c0 tx=0x7f2fa000ed80 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 shutdown_connections 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2f88065a60 0x7f2f88067f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fa40b3cf0 0x7f2fa415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fa40c8680 0x7f2fa414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 --2- 172.21.15.73:0/110082427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2f90004d10 0x7f2fa40c6d50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 >> 172.21.15.73:0/110082427 conn(0x7f2fa40b0270 msgr2=0x7f2fa40ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 shutdown_connections 2023-12-19T16:15:54.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.029+0000 7f2fac525640 1 -- 172.21.15.73:0/110082427 wait complete. 2023-12-19T16:15:54.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:15:40.526486+0000', 'modified': '2023-12-19T16:15:43.540418+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6834/859679048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 859679048}, {'type': 'v1', 'addr': '172.21.15.162:6834', 'nonce': 859679048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:15:54.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:15:54.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T16:15:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 Processor -- start 2023-12-19T16:15:54.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 -- start start 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f610c0cd7b0 0x7f610c06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f610c06bf50 0x7f610c0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0b1a40 con 0x7f610c0b0920 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0d1760 con 0x7f610c0cd7b0 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.593+0000 7f6111725640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0b0e30 con 0x7f610c06bf50 2023-12-19T16:15:54.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f610c0cd7b0 0x7f610c06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f61027fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f610c0b0920 0x7f610c06b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56726/0 (socket says 172.21.15.73:56726) 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f610c0cd7b0 0x7f610c06b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39442/0 (socket says 172.21.15.73:39442) 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f61027fc640 1 -- 172.21.15.73:0/4065986153 learned_addr learned my addr 172.21.15.73:0/4065986153 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610b7fe640 1 --2- 172.21.15.73:0/4065986153 >> v2:172.21.15.162:3300/0 conn(0x7f610c06bf50 0x7f610c0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 -- 172.21.15.73:0/4065986153 >> v2:172.21.15.162:3300/0 conn(0x7f610c06bf50 msgr2=0x7f610c0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 --2- 172.21.15.73:0/4065986153 >> v2:172.21.15.162:3300/0 conn(0x7f610c06bf50 0x7f610c0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 -- 172.21.15.73:0/4065986153 >> v1:172.21.15.73:6789/0 conn(0x7f610c0b0920 legacy=0x7f610c06b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 -- 172.21.15.73:0/4065986153 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0b1110 con 0x7f610c0cd7b0 2023-12-19T16:15:54.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610a7fc640 1 -- 172.21.15.73:0/4065986153 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423330766 0 0) 0x7f610c0b1a40 con 0x7f610c0b0920 2023-12-19T16:15:54.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610affd640 1 --2- 172.21.15.73:0/4065986153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c0cd7b0 0x7f610c06b160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f610c0c7950 tx=0x7f60fc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eae4083a962a3b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610a7fc640 1 -- 172.21.15.73:0/4065986153 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0a58c0 con 0x7f610c0cd7b0 2023-12-19T16:15:54.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610a7fc640 1 -- 172.21.15.73:0/4065986153 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc0a5a20 con 0x7f610c0cd7b0 2023-12-19T16:15:54.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.597+0000 7f610a7fc640 1 -- 172.21.15.73:0/4065986153 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0a5db0 con 0x7f610c0cd7b0 2023-12-19T16:15:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- 172.21.15.73:0/4065986153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c0cd7b0 msgr2=0x7f610c06b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- 172.21.15.73:0/4065986153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c0cd7b0 0x7f610c06b160 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f610c0c7950 tx=0x7f60fc01c910 comp rx=0 tx=0).stop 2023-12-19T16:15:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- 172.21.15.73:0/4065986153 shutdown_connections 2023-12-19T16:15:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- 172.21.15.73:0/4065986153 >> v2:172.21.15.162:3300/0 conn(0x7f610c06bf50 0x7f610c0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- 172.21.15.73:0/4065986153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c0cd7b0 0x7f610c06b160 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- 172.21.15.73:0/4065986153 >> 172.21.15.73:0/4065986153 conn(0x7f610c0d08f0 msgr2=0x7f610c0d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- 172.21.15.73:0/4065986153 shutdown_connections 2023-12-19T16:15:54.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- 172.21.15.73:0/4065986153 wait complete. 2023-12-19T16:15:54.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 Processor -- start 2023-12-19T16:15:54.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- start start 2023-12-19T16:15:54.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c0b0920 0x7f610c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 0x7f610c06e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c152890 con 0x7f610c06bf50 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15ef30 con 0x7f610c0cd7b0 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f6111725640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15f210 con 0x7f610c0b0920 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f610affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f610affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39458/0 (socket says 172.21.15.73:39458) 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f610affd640 1 -- 172.21.15.73:0/2640339727 learned_addr learned my addr 172.21.15.73:0/2640339727 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f610b7fe640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 0x7f610c06e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.601+0000 7f61027fc640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c0b0920 0x7f610c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 -- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c0b0920 msgr2=0x7f610c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c0b0920 0x7f610c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 -- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 msgr2=0x7f610c06e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 0x7f610c06e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 -- 172.21.15.73:0/2640339727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009a70 con 0x7f610c06bf50 2023-12-19T16:15:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610b7fe640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 0x7f610c06e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:15:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f610affd640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f60fc019520 tx=0x7f60fc0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6103fff640 1 -- 172.21.15.73:0/2640339727 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0ad850 con 0x7f610c06bf50 2023-12-19T16:15:54.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6103fff640 1 -- 172.21.15.73:0/2640339727 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc0ad9b0 con 0x7f610c06bf50 2023-12-19T16:15:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6103fff640 1 -- 172.21.15.73:0/2640339727 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0add40 con 0x7f610c06bf50 2023-12-19T16:15:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c0cdd10 con 0x7f610c06bf50 2023-12-19T16:15:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c15f7d0 con 0x7f610c06bf50 2023-12-19T16:15:54.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.605+0000 7f6103fff640 1 -- 172.21.15.73:0/2640339727 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60fc0b4050 con 0x7f610c06bf50 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6103fff640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 0x7f60ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6103fff640 1 -- 172.21.15.73:0/2640339727 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60fc11dec0 con 0x7f610c06bf50 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 0x7f60ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 Processor -- start 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 0x7f60ec067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b0460 tx=0x7f60f4007b60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 -- start start 2023-12-19T16:15:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 0x55792306e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230245a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e47c90 con 0x55792306e990 2023-12-19T16:15:54.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e79220 con 0x5579230241c0 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x557922e767f0 con 0x55792306e070 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39466/0 (socket says 172.21.15.73:39466) 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 -- 172.21.15.73:0/2834330893 learned_addr learned my addr 172.21.15.73:0/2834330893 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 0x55792306e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610b7fe640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230245a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 -- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 msgr2=0x5579230245a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230245a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 -- 172.21.15.73:0/2834330893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 msgr2=0x557923023c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 -- 172.21.15.73:0/2834330893 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557922b6e890 con 0x55792306e070 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f61027fc640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:54.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f610affd640 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 0x55792306e450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60fc11c440 tx=0x7f60fc0ac460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ee7990df24af10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6100ff9640 1 -- 172.21.15.73:0/2834330893 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc105070 con 0x55792306e070 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6100ff9640 1 -- 172.21.15.73:0/2834330893 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc0ef660 con 0x55792306e070 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6100ff9640 1 -- 172.21.15.73:0/2834330893 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0f3490 con 0x55792306e070 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 -- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 msgr2=0x55792306e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.609+0000 7f6114a8b000 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 0x55792306e450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60fc11c440 tx=0x7f60fc0ac460 comp rx=0 tx=0).stop 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/2834330893 shutdown_connections 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230245a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x557923023c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- 172.21.15.73:0/2834330893 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e070 0x55792306e450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/2834330893 >> 172.21.15.73:0/2834330893 conn(0x55792302a950 msgr2=0x557923022560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/2834330893 shutdown_connections 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/2834330893 wait complete. 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- start start 2023-12-19T16:15:54.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 Processor -- start 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923029750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e070 0x557923030080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e720e0 con 0x55792306e990 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e11310 con 0x55792306e070 2023-12-19T16:15:54.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x557922e2f770 con 0x5579230241c0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 10 client.0 _ll_register_callbacks cb 0x55792300fb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39476/0 (socket says 172.21.15.73:39476) 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 -- 172.21.15.73:0/821132784 learned_addr learned my addr 172.21.15.73:0/821132784 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f61027fc640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e070 0x557923030080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610affd640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923029750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 -- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 msgr2=0x557923029750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923029750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 -- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e070 msgr2=0x557923030080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e070 0x557923030080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 -- 172.21.15.73:0/821132784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f400f040 con 0x55792306e990 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f610b7fe640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6104014400 tx=0x7f61040148c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73576c9f1411138 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040169c0 con 0x55792306e990 2023-12-19T16:15:54.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f610401a070 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557922e41c10 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6104016b20 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 10 client.4608 fetch_fsmap learned FSMap version 8 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f610c15f7d0 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557922e41c10 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6104016c80 con 0x55792306e990 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 10 client.4608 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 10 client.4608 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.613+0000 7f6114a8b000 20 client.4608 populate_metadata read hostname 'smithi073' 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230758d0 0x557923075cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 4 client.4608 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 --> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557922e70a30 con 0x5579230758d0 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f610affd640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230758d0 0x557923075cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f610affd640 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230758d0 0x557923075cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0b37ea2cdcf2d2 server_cookie=e3263171b45b1a71 in_seq=0 out_seq=0 2023-12-19T16:15:54.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f60e9ffb640 10 client.4608 ms_handle_connect on v2:172.21.15.162:6832/859679048 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f60e9ffb640 1 -- 172.21.15.73:0/821132784 <== mds.0 v2:172.21.15.162:6832/859679048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x557922e70a30 con 0x5579230758d0 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f60e9ffb640 10 client.4608 handle_command_reply: tid=0 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 client.4608 shutdown 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 msgr2=0x5579230305c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6104014400 tx=0x7f61040148c0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 shutdown_connections 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230758d0 0x557923075cb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e990 0x5579230305c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e070 0x557923030080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f60e9ffb640 0 client.4608 ms_handle_reset on v2:172.21.15.162:6832/859679048 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 --2- 172.21.15.73:0/821132784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923029750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 >> 172.21.15.73:0/821132784 conn(0x55792302a950 msgr2=0x557923022c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 shutdown_connections 2023-12-19T16:15:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 1 -- 172.21.15.73:0/821132784 wait complete. 2023-12-19T16:15:54.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.617+0000 7f6114a8b000 20 client.4608 trim_cache size 0 max 16384 2023-12-19T16:15:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 Processor -- start 2023-12-19T16:15:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- start start 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 0x5579230c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922b2f940 con 0x55792306e070 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e767f0 con 0x5579230241c0 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x557923007da0 con 0x55792306e990 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39492/0 (socket says 172.21.15.73:39492) 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 -- 172.21.15.73:0/88472066 learned_addr learned my addr 172.21.15.73:0/88472066 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 -- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 msgr2=0x5579230c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f610b7fe640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 0x5579230c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f610affd640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 0x5579230c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 -- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 msgr2=0x5579230c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 -- 172.21.15.73:0/88472066 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557922e37260 con 0x55792306e070 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f610b7fe640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 0x5579230c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f610affd640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61027fc640 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60f4001ba0 tx=0x7f60f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2085364a914a75b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61017fa640 1 -- 172.21.15.73:0/88472066 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4023440 con 0x55792306e070 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61017fa640 1 -- 172.21.15.73:0/88472066 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f40235a0 con 0x55792306e070 2023-12-19T16:15:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f61017fa640 1 -- 172.21.15.73:0/88472066 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4023710 con 0x55792306e070 2023-12-19T16:15:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- 172.21.15.73:0/88472066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 msgr2=0x5579230c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f60f4001ba0 tx=0x7f60f4012000 comp rx=0 tx=0).stop 2023-12-19T16:15:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- 172.21.15.73:0/88472066 shutdown_connections 2023-12-19T16:15:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55792306e990 0x5579230c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x5579230c6830 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 --2- 172.21.15.73:0/88472066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579230241c0 0x5579230c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- 172.21.15.73:0/88472066 >> 172.21.15.73:0/88472066 conn(0x55792302a950 msgr2=0x55792302ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.633+0000 7f6114a8b000 1 -- 172.21.15.73:0/88472066 shutdown_connections 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- 172.21.15.73:0/88472066 wait complete. 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- start start 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 Processor -- start 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923080700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e990 0x557923081180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922e74c40 con 0x55792306e070 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557922eb5ce0 con 0x55792306e990 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x557922e17570 con 0x5579230241c0 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 10 client.0 _ll_register_callbacks cb 0x557922e20640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:15:54.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39498/0 (socket says 172.21.15.73:39498) 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 -- 172.21.15.73:0/3279488683 learned_addr learned my addr 172.21.15.73:0/3279488683 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f610affd640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923080700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f610b7fe640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e990 0x557923081180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 -- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 msgr2=0x557923080700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923080700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 -- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e990 msgr2=0x557923081180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e990 0x557923081180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 -- 172.21.15.73:0/3279488683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f4001910 con 0x55792306e070 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f61027fc640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60f4025040 tx=0x7f60f4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273297afb83f52bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4023cd0 con 0x55792306e070 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60f4023e30 con 0x55792306e070 2023-12-19T16:15:54.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557922e37e00 con 0x55792306e070 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f402c450 con 0x55792306e070 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 10 client.4614 fetch_fsmap learned FSMap version 8 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x557922e1d3b0 con 0x55792306e070 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557922e37e00 con 0x55792306e070 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f60f4020050 con 0x55792306e070 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 10 client.4614 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 20 client.4614 populate_metadata read hostname 'smithi073' 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230816c0 0x5579230d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:54.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 4 client.4614 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-12-19T16:15:54.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 --> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557922e6b160 con 0x5579230816c0 2023-12-19T16:15:54.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.637+0000 7f610affd640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230816c0 0x5579230d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f60e9ffb640 10 client.4614 ms_handle_connect on v2:172.21.15.162:6832/859679048 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f610affd640 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230816c0 0x5579230d3590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5abdec136ab59bd0 server_cookie=9c4f7a4bda90a9d9 in_seq=0 out_seq=0 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f60e9ffb640 1 -- 172.21.15.73:0/3279488683 <== mds.0 v2:172.21.15.162:6832/859679048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557922e6b160 con 0x5579230816c0 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f60e9ffb640 10 client.4614 handle_command_reply: tid=0 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 client.4614 shutdown 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 msgr2=0x557923080c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f60f4025040 tx=0x7f60f4000ee0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 shutdown_connections 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:6832/859679048,v1:172.21.15.162:6834/859679048] conn(0x5579230816c0 0x5579230d3590 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55792306e990 0x557923081180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55792306e070 0x557923080c40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f60e9ffb640 0 client.4614 ms_handle_reset on v2:172.21.15.162:6832/859679048 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 --2- 172.21.15.73:0/3279488683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5579230241c0 0x557923080700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 >> 172.21.15.73:0/3279488683 conn(0x55792302a950 msgr2=0x55792306b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 shutdown_connections 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 1 -- 172.21.15.73:0/3279488683 wait complete. 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6114a8b000 20 client.4614 trim_cache size 0 max 16384 2023-12-19T16:15:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "90ec874a-c348-4a69-99d9-d4bef3b9261d", 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4294, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 14.111996136, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 8, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 23, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 23, 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 20.542176964999999 2023-12-19T16:15:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 msgr2=0x7f60ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 0x7f60ec067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b0460 tx=0x7f60f4007b60 comp rx=0 tx=0).stop 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 msgr2=0x7f610c152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f60fc019520 tx=0x7f60fc0196b0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 shutdown_connections 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c0cd7b0 0x7f610c06e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c0b0920 0x7f610c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f60ec065a60 0x7f60ec067f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 --2- 172.21.15.73:0/2640339727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f610c06bf50 0x7f610c152350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 >> 172.21.15.73:0/2640339727 conn(0x7f610c0d08f0 msgr2=0x7f610c0cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 shutdown_connections 2023-12-19T16:15:54.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:54.641+0000 7f6111725640 1 -- 172.21.15.73:0/2640339727 wait complete. 2023-12-19T16:15:54.663 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T16:15:54.686 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T16:15:54.686 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-19T16:15:54.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.686 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:15:54.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T16:15:54.765 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-12-19T16:15:54.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:15:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.767 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:15:54.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T16:15:54.889 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-12-19T16:15:54.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:15:54.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.892 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:15:54.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.903 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-12-19T16:15:54.976 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-12-19T16:15:54.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:15:54.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:54.978 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:15:55.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-12-19T16:15:55.095 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-12-19T16:15:55.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:15:55.098 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-19T16:15:55.098 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:55.098 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:55.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 Processor -- start 2023-12-19T16:15:55.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 -- start start 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5000b7250 con 0x7fe5000b4bd0 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5000b7530 con 0x7fe50015cff0 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe50536d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000b7810 con 0x7fe5000b47f0 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4ff7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:42386/0 (socket says 172.21.15.73:42386) 2023-12-19T16:15:55.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4ff7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:60976/0 (socket says 172.21.15.73:60976) 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 -- 172.21.15.73:0/461918100 learned_addr learned my addr 172.21.15.73:0/461918100 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4f67fc640 1 --1- 172.21.15.73:0/461918100 >> v1:172.21.15.162:6789/0 conn(0x7fe5000b4bd0 0x7fe50015c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:49326/0 (socket says 172.21.15.73:49326) 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 -- 172.21.15.73:0/461918100 >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 msgr2=0x7fe5000b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 --2- 172.21.15.73:0/461918100 >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 -- 172.21.15.73:0/461918100 >> v1:172.21.15.162:6789/0 conn(0x7fe5000b4bd0 legacy=0x7fe50015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4feffd640 1 -- 172.21.15.73:0/461918100 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5000b7af0 con 0x7fe5000b47f0 2023-12-19T16:15:55.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.233+0000 7fe4ff7fe640 1 --2- 172.21.15.73:0/461918100 >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:15:55.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe4feffd640 1 --2- 172.21.15.73:0/461918100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009870 tx=0x7fe4f001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc839640f3f0140f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe4fe7fc640 1 -- 172.21.15.73:0/461918100 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00a6040 con 0x7fe5000b47f0 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe4fe7fc640 1 -- 172.21.15.73:0/461918100 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f00aa600 con 0x7fe5000b47f0 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe4fe7fc640 1 -- 172.21.15.73:0/461918100 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00aa990 con 0x7fe5000b47f0 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 -- 172.21.15.73:0/461918100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 msgr2=0x7fe5000b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 --2- 172.21.15.73:0/461918100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0009870 tx=0x7fe4f001c480 comp rx=0 tx=0).stop 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 -- 172.21.15.73:0/461918100 shutdown_connections 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 --2- 172.21.15.73:0/461918100 >> v2:172.21.15.162:3300/0 conn(0x7fe50015cff0 0x7fe5000b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 --2- 172.21.15.73:0/461918100 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5000b47f0 0x7fe5000b8430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 -- 172.21.15.73:0/461918100 >> 172.21.15.73:0/461918100 conn(0x7fe500065ce0 msgr2=0x7fe5000660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 -- 172.21.15.73:0/461918100 shutdown_connections 2023-12-19T16:15:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.237+0000 7fe50536d640 1 -- 172.21.15.73:0/461918100 wait complete. 2023-12-19T16:15:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 Processor -- start 2023-12-19T16:15:55.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- start start 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5000b47f0 0x7fe5000c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe50015cff0 0x7fe5000c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50015f000 con 0x7fe5000b4bd0 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500152960 con 0x7fe5000b47f0 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe500152c40 con 0x7fe50015cff0 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58378/0 (socket says 172.21.15.73:58378) 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 -- 172.21.15.73:0/2576428620 learned_addr learned my addr 172.21.15.73:0/2576428620 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4feffd640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5000b47f0 0x7fe5000c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4ff7fe640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe50015cff0 0x7fe5000c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 -- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe50015cff0 msgr2=0x7fe5000c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe50015cff0 0x7fe5000c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 -- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5000b47f0 msgr2=0x7fe5000c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5000b47f0 0x7fe5000c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 -- 172.21.15.73:0/2576428620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8009420 con 0x7fe5000b4bd0 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f67fc640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c870 tx=0x7fe4e800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e800a640 con 0x7fe5000b4bd0 2023-12-19T16:15:55.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e800a7a0 con 0x7fe5000b4bd0 2023-12-19T16:15:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e800ab10 con 0x7fe5000b4bd0 2023-12-19T16:15:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f00094d0 con 0x7fe5000b4bd0 2023-12-19T16:15:55.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.241+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5000c5510 con 0x7fe5000b4bd0 2023-12-19T16:15:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50015f170 con 0x7fe5000b4bd0 2023-12-19T16:15:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4e800ac70 con 0x7fe5000b4bd0 2023-12-19T16:15:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe4f7fff640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 0x7fe4e0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4e80828e0 con 0x7fe5000b4bd0 2023-12-19T16:15:55.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe4feffd640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 0x7fe4e0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:55.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.245+0000 7fe4feffd640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 0x7fe4e0067f50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00ae000 tx=0x7fe4f00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:55.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.249+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4e80503e0 con 0x7fe5000b4bd0 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe500074050 con 0x7fe5000b4bd0 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe4f7fff640 1 -- 172.21.15.73:0/2576428620 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4e8017070 con 0x7fe5000b4bd0 2023-12-19T16:15:55.436 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:15:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 msgr2=0x7fe4e0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 0x7fe4e0067f50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00ae000 tx=0x7fe4f00a7000 comp rx=0 tx=0).stop 2023-12-19T16:15:55.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 msgr2=0x7fe500149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c870 tx=0x7fe4e800cd30 comp rx=0 tx=0).stop 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 shutdown_connections 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe50015cff0 0x7fe5000c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe4e0065a90 0x7fe4e0067f50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5000b4bd0 0x7fe500149290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 --2- 172.21.15.73:0/2576428620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5000b47f0 0x7fe5000c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 >> 172.21.15.73:0/2576428620 conn(0x7fe500065ce0 msgr2=0x7fe5001530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 shutdown_connections 2023-12-19T16:15:55.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:55.433+0000 7fe50536d640 1 -- 172.21.15.73:0/2576428620 wait complete. 2023-12-19T16:15:55.457 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:55.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:55.457 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T16:15:55.457 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:15:55.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:55.458 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:55.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:55.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:55.458 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:15:55.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.458 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.468 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42409sec preferred_lft 42409sec 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:c8:3e:2d:c3 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:55.469 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:55.470 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:55.473 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:15:55.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.473 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:15:55.474 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:55.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.581 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:55.600 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T16:15:55.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.602 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T16:15:55.681 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T16:15:55.681 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:55.681 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:55.681 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:55.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.682 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:55.683 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:55.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:55.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:55.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:55.683 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:55.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.773 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:15:55.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.783 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-12-19T16:15:55.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.840 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:55.840 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:55.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:15:55.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T16:15:55.840 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:55.922 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T16:15:55.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T16:15:55.923 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:56.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.094 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:56.094 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:56.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-19T16:15:56.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:15:56.094 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:56.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:56.136 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:56.191 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:15:56.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:56.192 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:56.247 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:15:56.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:15:56.351 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:15:56.351 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:15:56.351 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:56.446 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:15:56.446 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:15:56.446 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:56.446 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:56.447 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:56.460 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:15:56.460 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:15:56.460 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:56.460 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:56.460 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:56.461 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:15:56.461 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:15:56.461 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:15:56.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:15:56.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.465 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:15:56.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.487 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:56.559 INFO:teuthology.orchestra.run.smithi073.stdout:client4529 2023-12-19T16:15:56.559 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:56.560 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:15:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.612 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:56.677 INFO:teuthology.orchestra.run.smithi073.stdout:client4529 2023-12-19T16:15:56.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.678 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:56.742 INFO:teuthology.orchestra.run.smithi073.stdout:client4529 2023-12-19T16:15:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:56.743 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/90ec874a-c348-4a69-99d9-d4bef3b9261d.client4529/status') 2023-12-19T16:15:56.814 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4529 (3)172.21.15.73:0/2155329247 2023-12-19T16:15:56.815 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-12-19T16:15:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-12-19T16:15:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-12-19T16:15:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 6.8444e-05 s, 1.0 MB/s 2023-12-19T16:15:56.817 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-12-19T16:15:56.817 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:56.817 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:56.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.993+0000 7f963af09640 1 Processor -- start 2023-12-19T16:15:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.993+0000 7f963af09640 1 -- start start 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f963af09640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f963406ddf0 0x7f96340cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f963af09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96340cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f963af09640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340ca6f0 con 0x7f963415cc80 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f963af09640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340cccb0 con 0x7f963406ddf0 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f963af09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9634159530 con 0x7f96340cbe90 2023-12-19T16:15:57.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96340cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f9638ca5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f963406ddf0 0x7f96340cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f96394a6640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f963415cc80 0x7f9634070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:49328/0 (socket says 172.21.15.73:49328) 2023-12-19T16:15:57.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f96394a6640 1 -- 172.21.15.73:0/225658283 learned_addr learned my addr 172.21.15.73:0/225658283 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962bfff640 1 -- 172.21.15.73:0/225658283 >> v2:172.21.15.162:3300/0 conn(0x7f963406ddf0 msgr2=0x7f96340cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962bfff640 1 --2- 172.21.15.73:0/225658283 >> v2:172.21.15.162:3300/0 conn(0x7f963406ddf0 0x7f96340cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962bfff640 1 -- 172.21.15.73:0/225658283 >> v1:172.21.15.162:6789/0 conn(0x7f963415cc80 legacy=0x7f9634070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962bfff640 1 -- 172.21.15.73:0/225658283 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340c9ae0 con 0x7f96340cbe90 2023-12-19T16:15:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:56.997+0000 7f962b7fe640 1 -- 172.21.15.73:0/225658283 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507965877 0 0) 0x7f96340ca6f0 con 0x7f963415cc80 2023-12-19T16:15:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f962bfff640 1 --2- 172.21.15.73:0/225658283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96340cd3b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96240097f0 tx=0x7f962401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c8a3fe2dec00a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f962b7fe640 1 -- 172.21.15.73:0/225658283 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240ab600 con 0x7f96340cbe90 2023-12-19T16:15:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f962b7fe640 1 -- 172.21.15.73:0/225658283 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240a7050 con 0x7f96340cbe90 2023-12-19T16:15:57.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f962b7fe640 1 -- 172.21.15.73:0/225658283 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240ab980 con 0x7f96340cbe90 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 -- 172.21.15.73:0/225658283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 msgr2=0x7f96340cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 --2- 172.21.15.73:0/225658283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96340cd3b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96240097f0 tx=0x7f962401c450 comp rx=0 tx=0).stop 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 -- 172.21.15.73:0/225658283 shutdown_connections 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 --2- 172.21.15.73:0/225658283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96340cd3b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 --2- 172.21.15.73:0/225658283 >> v2:172.21.15.162:3300/0 conn(0x7f963406ddf0 0x7f96340cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 -- 172.21.15.73:0/225658283 >> 172.21.15.73:0/225658283 conn(0x7f96340b0270 msgr2=0x7f96340b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 -- 172.21.15.73:0/225658283 shutdown_connections 2023-12-19T16:15:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.001+0000 7f963af09640 1 -- 172.21.15.73:0/225658283 wait complete. 2023-12-19T16:15:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 Processor -- start 2023-12-19T16:15:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- start start 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f963406ddf0 0x7f963415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96341672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c5e20 con 0x7f963415cc80 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9634167a50 con 0x7f963406ddf0 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96341677f0 con 0x7f96340cbe90 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58388/0 (socket says 172.21.15.73:58388) 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 -- 172.21.15.73:0/115359556 learned_addr learned my addr 172.21.15.73:0/115359556 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f9638ca5640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f963406ddf0 0x7f963415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f962bfff640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96341672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 -- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 msgr2=0x7f96341672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96341672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 -- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f963406ddf0 msgr2=0x7f963415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f963406ddf0 0x7f963415c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 -- 172.21.15.73:0/115359556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009420 con 0x7f963415cc80 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96394a6640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c700 tx=0x7f962c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00ce10 con 0x7f963415cc80 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c00a640 con 0x7f963415cc80 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c00aa30 con 0x7f963415cc80 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f963415b7d0 con 0x7f963415cc80 2023-12-19T16:15:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.005+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963415bd90 con 0x7f963415cc80 2023-12-19T16:15:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96340c5f60 con 0x7f963415cc80 2023-12-19T16:15:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f962c00ab90 con 0x7f963415cc80 2023-12-19T16:15:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f96297fa640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f962c0825a0 con 0x7f963415cc80 2023-12-19T16:15:57.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f9638ca5640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.009+0000 7f9638ca5640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 0x7f9620067f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9630009b60 tx=0x7f9630009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:57.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.013+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f96340c5f60 con 0x7f963415cc80 2023-12-19T16:15:57.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96340c5f60 con 0x7f963415cc80 2023-12-19T16:15:57.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f96297fa640 1 -- 172.21.15.73:0/115359556 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96340c5f60 con 0x7f963415cc80 2023-12-19T16:15:57.201 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 msgr2=0x7f9620067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 0x7f9620067f20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9630009b60 tx=0x7f9630009190 comp rx=0 tx=0).stop 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 msgr2=0x7f963414d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.197+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c700 tx=0x7f962c00cbc0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 shutdown_connections 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9620065a60 0x7f9620067f20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963415cc80 0x7f963414d2e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f96340cbe90 0x7f96341672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 --2- 172.21.15.73:0/115359556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f963406ddf0 0x7f963415c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 >> 172.21.15.73:0/115359556 conn(0x7f96340b0270 msgr2=0x7f96340af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 shutdown_connections 2023-12-19T16:15:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:57.201+0000 7f963af09640 1 -- 172.21.15.73:0/115359556 wait complete. 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:57.222 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-19T16:15:57.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.222 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.232 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:57.233 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:c8:3e:2d:c3 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-12-19T16:15:57.234 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.235 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:57.298 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T16:15:57.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.300 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:57.357 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:57.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:57.358 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:57.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.449 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:15:57.458 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:15:57.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.459 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-12-19T16:15:57.511 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-19T16:15:57.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.511 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:57.511 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:57.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:15:57.512 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-19T16:15:57.512 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:57.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T16:15:57.655 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:57.655 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 06:11:b0:9a:38:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::411:b0ff:fe9a:3816/64 scope link 2023-12-19T16:15:57.656 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T16:15:57.719 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:57.719 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:15:57.720 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 06:11:b0:9a:38:16 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:15:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:15:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::411:b0ff:fe9a:3816/64 scope link 2023-12-19T16:15:57.721 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:57.726 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-19T16:15:57.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.727 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:57.727 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:57.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-19T16:15:57.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:57.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-19T16:15:57.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-19T16:15:57.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-19T16:15:57.728 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:57.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:57.862 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:15:57.862 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:15:57.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2023-12-19T16:15:57.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T16:15:57.863 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:15:57.903 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:57.903 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:57.954 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-19T16:15:57.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:57.955 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:58.006 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:15:58.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-19T16:15:58.100 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-19T16:15:58.100 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-19T16:15:58.100 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:58.115 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-19T16:15:58.115 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-19T16:15:58.116 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:58.116 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:58.116 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:58.125 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-19T16:15:58.125 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:15:58.126 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:15:58.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:15:58.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-19T16:15:58.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.150 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:58.206 INFO:teuthology.orchestra.run.smithi073.stdout:client4538 2023-12-19T16:15:58.206 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:15:58.207 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:15:58.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.259 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:58.313 INFO:teuthology.orchestra.run.smithi073.stdout:client4538 2023-12-19T16:15:58.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.314 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:58.366 INFO:teuthology.orchestra.run.smithi073.stdout:client4538 2023-12-19T16:15:58.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.366 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/90ec874a-c348-4a69-99d9-d4bef3b9261d.client4538/status') 2023-12-19T16:15:58.430 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4538 (3)172.21.15.73:0/2542419649 2023-12-19T16:15:58.430 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2023-12-19T16:15:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2023-12-19T16:15:58.430 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2023-12-19T16:15:58.431 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 5.1061e-05 s, 1.4 MB/s 2023-12-19T16:15:58.432 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-19T16:15:58.432 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:15:58.432 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:58.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:15:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 Processor -- start 2023-12-19T16:15:58.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 -- start start 2023-12-19T16:15:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0280cb860 0x7fb0280adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:58.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280cc4b0 con 0x7fb0280c1c10 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0280cc790 con 0x7fb028165800 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02f4b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb028165d70 con 0x7fb0280cb860 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02d252640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0280c1c10 0x7fb0280cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43640/0 (socket says 172.21.15.73:43640) 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02d252640 1 -- 172.21.15.73:0/2760466655 learned_addr learned my addr 172.21.15.73:0/2760466655 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02ca51640 1 --2- 172.21.15.73:0/2760466655 >> v2:172.21.15.73:3300/0 conn(0x7fb0280cb860 0x7fb0280adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:58.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02ca51640 1 -- 172.21.15.73:0/2760466655 >> v1:172.21.15.162:6789/0 conn(0x7fb028165800 legacy=0x7fb0280c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:15:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02ca51640 1 -- 172.21.15.73:0/2760466655 >> v1:172.21.15.73:6789/0 conn(0x7fb0280c1c10 legacy=0x7fb0280cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb02ca51640 1 -- 172.21.15.73:0/2760466655 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280cca70 con 0x7fb0280cb860 2023-12-19T16:15:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.613+0000 7fb01ffff640 1 -- 172.21.15.73:0/2760466655 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567408525 0 0) 0x7fb0280cc4b0 con 0x7fb0280c1c10 2023-12-19T16:15:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02ca51640 1 --2- 172.21.15.73:0/2760466655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0280cb860 0x7fb0280adc90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0180097c0 tx=0x7fb01801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634fda3e11c47e09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb01ffff640 1 -- 172.21.15.73:0/2760466655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180a8050 con 0x7fb0280cb860 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb01ffff640 1 -- 172.21.15.73:0/2760466655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0180ac5f0 con 0x7fb0280cb860 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb01ffff640 1 -- 172.21.15.73:0/2760466655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180ac980 con 0x7fb0280cb860 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 -- 172.21.15.73:0/2760466655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0280cb860 msgr2=0x7fb0280adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/2760466655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0280cb860 0x7fb0280adc90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0180097c0 tx=0x7fb01801cee0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 -- 172.21.15.73:0/2760466655 shutdown_connections 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/2760466655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0280cb860 0x7fb0280adc90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 -- 172.21.15.73:0/2760466655 >> 172.21.15.73:0/2760466655 conn(0x7fb0280b0270 msgr2=0x7fb0280b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:58.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 -- 172.21.15.73:0/2760466655 shutdown_connections 2023-12-19T16:15:58.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.617+0000 7fb02f4b6640 1 -- 172.21.15.73:0/2760466655 wait complete. 2023-12-19T16:15:58.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 Processor -- start 2023-12-19T16:15:58.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- start start 2023-12-19T16:15:58.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0280c1c10 0x7fb02815f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:58.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0280cb860 0x7fb02815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028160800 con 0x7fb028165800 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028160240 con 0x7fb0280c1c10 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb028160520 con 0x7fb0280cb860 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58408/0 (socket says 172.21.15.73:58408) 2023-12-19T16:15:58.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 -- 172.21.15.73:0/1559693102 learned_addr learned my addr 172.21.15.73:0/1559693102 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02d252640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0280c1c10 0x7fb02815f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02ca51640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0280cb860 0x7fb02815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 -- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0280cb860 msgr2=0x7fb02815c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0280cb860 0x7fb02815c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 -- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0280c1c10 msgr2=0x7fb02815f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0280c1c10 0x7fb02815f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 -- 172.21.15.73:0/1559693102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018009420 con 0x7fb028165800 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02da53640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c730 tx=0x7fb02000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020003b80 con 0x7fb028165800 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020003ce0 con 0x7fb028165800 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000aa30 con 0x7fb028165800 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0280c58b0 con 0x7fb028165800 2023-12-19T16:15:58.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.621+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02815fe30 con 0x7fb028165800 2023-12-19T16:15:58.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0281640c0 con 0x7fb028165800 2023-12-19T16:15:58.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb02000ab90 con 0x7fb028165800 2023-12-19T16:15:58.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb01dffb640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 0x7fb00c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:15:58.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb020082de0 con 0x7fb028165800 2023-12-19T16:15:58.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb02d252640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 0x7fb00c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:15:58.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.625+0000 7fb02d252640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 0x7fb00c067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb024000f70 tx=0x7fb024007240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:15:58.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.629+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb020050850 con 0x7fb028165800 2023-12-19T16:15:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.809+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb028074050 con 0x7fb028165800 2023-12-19T16:15:58.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.809+0000 7fb01dffb640 1 -- 172.21.15.73:0/1559693102 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb020053e70 con 0x7fb028165800 2023-12-19T16:15:58.813 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:15:58.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 msgr2=0x7fb00c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 0x7fb00c067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb024000f70 tx=0x7fb024007240 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 msgr2=0x7fb028147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb02000c730 tx=0x7fb02000cbf0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 shutdown_connections 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb00c065a60 0x7fb00c067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb028165800 0x7fb028147a90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0280cb860 0x7fb02815c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 --2- 172.21.15.73:0/1559693102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0280c1c10 0x7fb02815f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 >> 172.21.15.73:0/1559693102 conn(0x7fb0280b0270 msgr2=0x7fb028073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 shutdown_connections 2023-12-19T16:15:58.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:15:58.813+0000 7fb02f4b6640 1 -- 172.21.15.73:0/1559693102 wait complete. 2023-12-19T16:15:58.834 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:15:58.834 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:15:58.834 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2023-12-19T16:15:58.834 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T16:15:58.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:58.835 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:15:58.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:15:58.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:15:58.835 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T16:15:58.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.835 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2023-12-19T16:15:58.846 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:15:58.846 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:15:58.846 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:15:58.846 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.846 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42356sec preferred_lft 42356sec 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 02:42:31:c0:6e:a5 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:15:58.848 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:15:58.849 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T16:15:58.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T16:15:58.849 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:15:58.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.970 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:15:58.989 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-12-19T16:15:58.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:58.991 DEBUG:teuthology.orchestra.run.smithi162:> route 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:15:59.068 INFO:teuthology.orchestra.run.smithi162.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.069 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.069 INFO:teuthology.orchestra.run.smithi162.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:15:59.069 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:15:59.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.069 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:15:59.069 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:15:59.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:15:59.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:15:59.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:15:59.070 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:15:59.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.162 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:15:59.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.172 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2023-12-19T16:15:59.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.227 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:15:59.227 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:15:59.227 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:15:59.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T16:15:59.228 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:15:59.311 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T16:15:59.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T16:15:59.311 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:15:59.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.478 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:15:59.478 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:15:59.478 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2023-12-19T16:15:59.478 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T16:15:59.478 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:15:59.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:59.520 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:59.571 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T16:15:59.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:15:59.571 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:59.622 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:15:59.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.622 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-19T16:15:59.726 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-19T16:15:59.726 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-19T16:15:59.726 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:15:59.834 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-19T16:15:59.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-19T16:15:59.834 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:15:59.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:59.834 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:15:59.846 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:15:59.847 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:15:59.847 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:15:59.850 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:15:59.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.850 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T16:15:59.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.871 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:15:59.934 INFO:teuthology.orchestra.run.smithi162.stdout:client4632 2023-12-19T16:15:59.934 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:15:59.934 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:15:59.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:15:59.988 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:00.045 INFO:teuthology.orchestra.run.smithi162.stdout:client4632 2023-12-19T16:16:00.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.046 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:00.097 INFO:teuthology.orchestra.run.smithi162.stdout:client4632 2023-12-19T16:16:00.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.098 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/90ec874a-c348-4a69-99d9-d4bef3b9261d.client4632/status') 2023-12-19T16:16:00.158 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4632 (3)172.21.15.162:0/214950963 2023-12-19T16:16:00.158 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2023-12-19T16:16:00.158 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2023-12-19T16:16:00.158 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2023-12-19T16:16:00.159 INFO:teuthology.orchestra.run.smithi162.stderr:70 bytes copied, 4.9088e-05 s, 1.4 MB/s 2023-12-19T16:16:00.160 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-12-19T16:16:00.160 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T16:16:00.160 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:00.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:16:00.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 Processor -- start 2023-12-19T16:16:00.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 -- start start 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb92c0d15e0 0x7fb92c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c0d3000 0x7fb92c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92c0cdf10 con 0x7fb92c160270 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92c06b040 con 0x7fb92c0d15e0 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb93335a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0ce160 con 0x7fb92c0d3000 2023-12-19T16:16:00.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb92c0d15e0 0x7fb92c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb92c0d15e0 0x7fb92c0d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58420/0 (socket says 172.21.15.73:58420) 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb932358640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb92c160270 0x7fb92c0d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43650/0 (socket says 172.21.15.73:43650) 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 -- 172.21.15.73:0/3172919808 learned_addr learned my addr 172.21.15.73:0/3172919808 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb932b59640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c0d3000 0x7fb92c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 -- 172.21.15.73:0/3172919808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c0d3000 msgr2=0x7fb92c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c0d3000 0x7fb92c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 -- 172.21.15.73:0/3172919808 >> v1:172.21.15.73:6789/0 conn(0x7fb92c160270 legacy=0x7fb92c0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931b57640 1 -- 172.21.15.73:0/3172919808 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c0ce440 con 0x7fb92c0d15e0 2023-12-19T16:16:00.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.297+0000 7fb931356640 1 -- 172.21.15.73:0/3172919808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687912732 0 0) 0x7fb92c0cdf10 con 0x7fb92c160270 2023-12-19T16:16:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb931b57640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d15e0 0x7fb92c0d0820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009870 tx=0x7fb91c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a54a8b6cedfa30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb931356640 1 -- 172.21.15.73:0/3172919808 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0ab650 con 0x7fb92c0d15e0 2023-12-19T16:16:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb931356640 1 -- 172.21.15.73:0/3172919808 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0ab7b0 con 0x7fb92c0d15e0 2023-12-19T16:16:00.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb931356640 1 -- 172.21.15.73:0/3172919808 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0abb40 con 0x7fb92c0d15e0 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 -- 172.21.15.73:0/3172919808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d15e0 msgr2=0x7fb92c0d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d15e0 0x7fb92c0d0820 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009870 tx=0x7fb91c01c540 comp rx=0 tx=0).stop 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 -- 172.21.15.73:0/3172919808 shutdown_connections 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c0d3000 0x7fb92c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 --2- 172.21.15.73:0/3172919808 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d15e0 0x7fb92c0d0820 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 -- 172.21.15.73:0/3172919808 >> 172.21.15.73:0/3172919808 conn(0x7fb92c09bc10 msgr2=0x7fb92c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 -- 172.21.15.73:0/3172919808 shutdown_connections 2023-12-19T16:16:00.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.301+0000 7fb93335a640 1 -- 172.21.15.73:0/3172919808 wait complete. 2023-12-19T16:16:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 Processor -- start 2023-12-19T16:16:00.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- start start 2023-12-19T16:16:00.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c0d15e0 0x7fb92c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c160270 0x7fb92c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0b2640 con 0x7fb92c0d3000 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c151810 con 0x7fb92c0d15e0 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c153ac0 con 0x7fb92c160270 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58426/0 (socket says 172.21.15.73:58426) 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 -- 172.21.15.73:0/2768559621 learned_addr learned my addr 172.21.15.73:0/2768559621 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb932358640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c0d15e0 0x7fb92c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb932b59640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c160270 0x7fb92c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 -- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c160270 msgr2=0x7fb92c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c160270 0x7fb92c0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 -- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c0d15e0 msgr2=0x7fb92c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c0d15e0 0x7fb92c14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 -- 172.21.15.73:0/2768559621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0094d0 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb931b57640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0ad040 tx=0x7fb91c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0abd30 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0b8070 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c004220 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c151a60 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.305+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c0b22d0 con 0x7fb92c0d3000 2023-12-19T16:16:00.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.309+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c04e000 con 0x7fb92c0d3000 2023-12-19T16:16:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.309+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb91c004380 con 0x7fb92c0d3000 2023-12-19T16:16:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.309+0000 7fb922ffd640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 0x7fb910067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.309+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb91c11d8c0 con 0x7fb92c0d3000 2023-12-19T16:16:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.309+0000 7fb932358640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 0x7fb910067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:00.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.313+0000 7fb932358640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 0x7fb910067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb928000f70 tx=0x7fb928007df0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:00.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.313+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb91c0eb410 con 0x7fb92c0d3000 2023-12-19T16:16:00.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.497+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb92c0d3800 con 0x7fb92c0d3000 2023-12-19T16:16:00.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb922ffd640 1 -- 172.21.15.73:0/2768559621 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb91c0eea30 con 0x7fb92c0d3000 2023-12-19T16:16:00.503 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 msgr2=0x7fb910067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 0x7fb910067f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb928000f70 tx=0x7fb928007df0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 msgr2=0x7fb92c153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0ad040 tx=0x7fb91c01ad80 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 shutdown_connections 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb92c160270 0x7fb92c0af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb910065a60 0x7fb910067f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb92c0d3000 0x7fb92c153580 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 --2- 172.21.15.73:0/2768559621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c0d15e0 0x7fb92c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 >> 172.21.15.73:0/2768559621 conn(0x7fb92c09bc10 msgr2=0x7fb92c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 shutdown_connections 2023-12-19T16:16:00.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:00.501+0000 7fb93335a640 1 -- 172.21.15.73:0/2768559621 wait complete. 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:16:00.524 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-19T16:16:00.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.525 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:00.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 02:42:31:c0:6e:a5 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:16:00.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.538 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:16:00.597 INFO:teuthology.orchestra.run.smithi162.stdout:1 2023-12-19T16:16:00.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.600 DEBUG:teuthology.orchestra.run.smithi162:> route 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:16:00.653 INFO:teuthology.orchestra.run.smithi162.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:00.654 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:00.654 INFO:teuthology.orchestra.run.smithi162.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:00.654 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:16:00.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:16:00.654 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:16:00.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.745 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:16:00.754 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T16:16:00.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.755 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2023-12-19T16:16:00.807 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-19T16:16:00.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.808 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:16:00.808 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:16:00.808 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T16:16:00.808 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-19T16:16:00.808 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:16:00.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.890 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T16:16:00.955 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:00.955 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:00.955 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:00.955 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 82:57:58:68:91:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8057:58ff:fe68:9176/64 scope link tentative 2023-12-19T16:16:00.956 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:00.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:00.957 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T16:16:01.019 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:01.019 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:01.019 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 82:57:58:68:91:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.020 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8057:58ff:fe68:9176/64 scope link tentative 2023-12-19T16:16:01.021 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:01.022 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-19T16:16:01.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.023 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:16:01.023 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:16:01.023 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-19T16:16:01.023 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T16:16:01.023 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-19T16:16:01.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-19T16:16:01.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-19T16:16:01.024 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:16:01.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.164 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec bash -c ' 2023-12-19T16:16:01.164 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2023-12-19T16:16:01.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2023-12-19T16:16:01.164 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T16:16:01.164 DEBUG:teuthology.orchestra.run.smithi162:> ') 2023-12-19T16:16:01.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:01.204 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:01.259 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-19T16:16:01.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:01.259 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:01.314 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:16:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-19T16:16:01.405 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-19T16:16:01.406 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-19T16:16:01.406 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:16:01.419 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-19T16:16:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-19T16:16:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:16:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:16:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:16:01.429 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-19T16:16:01.429 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-19T16:16:01.429 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2023-12-19T16:16:01.429 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:16:01.430 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:16:01.430 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:16:01.430 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:16:01.430 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:16:01.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:16:01.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.433 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-19T16:16:01.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.495 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:01.553 INFO:teuthology.orchestra.run.smithi162.stdout:client4644 2023-12-19T16:16:01.553 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:01.554 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:01.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.603 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:01.657 INFO:teuthology.orchestra.run.smithi162.stdout:client4644 2023-12-19T16:16:01.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.658 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:01.709 INFO:teuthology.orchestra.run.smithi162.stdout:client4644 2023-12-19T16:16:01.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:01.709 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/90ec874a-c348-4a69-99d9-d4bef3b9261d.client4644/status') 2023-12-19T16:16:01.771 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4644 (3)172.21.15.162:0/1859039267 2023-12-19T16:16:01.771 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2023-12-19T16:16:01.771 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2023-12-19T16:16:01.771 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2023-12-19T16:16:01.771 INFO:teuthology.orchestra.run.smithi162.stderr:71 bytes copied, 5.2824e-05 s, 1.3 MB/s 2023-12-19T16:16:01.773 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T16:16:01.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.937+0000 7f2ba3c2d640 1 Processor -- start 2023-12-19T16:16:01.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba3c2d640 1 -- start start 2023-12-19T16:16:01.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba3c2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 0x7f2b9c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba3c2d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c15ad00 con 0x7f2b9c0b40b0 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba3c2d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9c0ce2d0 con 0x7f2b9c0cdc40 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba3c2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c15e110 con 0x7f2b9c159830 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba11c8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2b9c0b40b0 0x7f2b9c0cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43652/0 (socket says 172.21.15.73:43652) 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba11c8640 1 -- 172.21.15.73:0/2122344582 learned_addr learned my addr 172.21.15.73:0/2122344582 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba19c9640 1 --2- 172.21.15.73:0/2122344582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 0x7f2b9c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720177411 0 0) 0x7f2b9c15ad00 con 0x7f2b9c0b40b0 2023-12-19T16:16:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b88005740 con 0x7f2b9c0b40b0 2023-12-19T16:16:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462426616 0 0) 0x7f2b9c0ce2d0 con 0x7f2b9c0cdc40 2023-12-19T16:16:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b9c15ad00 con 0x7f2b9c0cdc40 2023-12-19T16:16:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba19c9640 1 -- 172.21.15.73:0/2122344582 >> v1:172.21.15.162:6789/0 conn(0x7f2b9c0cdc40 legacy=0x7f2b9c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba19c9640 1 -- 172.21.15.73:0/2122344582 >> v1:172.21.15.73:6789/0 conn(0x7f2b9c0b40b0 legacy=0x7f2b9c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.941+0000 7f2ba19c9640 1 -- 172.21.15.73:0/2122344582 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c15d490 con 0x7f2b9c159830 2023-12-19T16:16:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba19c9640 1 --2- 172.21.15.73:0/2122344582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 0x7f2b9c15a7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097f0 tx=0x7f2b9801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19c961178121f87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980ab600 con 0x7f2b9c159830 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980ab760 con 0x7f2b9c159830 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba09c7640 1 -- 172.21.15.73:0/2122344582 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980abaf0 con 0x7f2b9c159830 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2122344582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 msgr2=0x7f2b9c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2122344582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 0x7f2b9c15a7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097f0 tx=0x7f2b9801c400 comp rx=0 tx=0).stop 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2122344582 shutdown_connections 2023-12-19T16:16:01.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2122344582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c159830 0x7f2b9c15a7c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2122344582 >> 172.21.15.73:0/2122344582 conn(0x7f2b9c0b0270 msgr2=0x7f2b9c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2122344582 shutdown_connections 2023-12-19T16:16:01.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2122344582 wait complete. 2023-12-19T16:16:01.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.945+0000 7f2ba3c2d640 1 Processor -- start 2023-12-19T16:16:01.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- start start 2023-12-19T16:16:01.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c0b40b0 0x7f2b9c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b9c0cdc40 0x7f2b9c0afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1513a0 con 0x7f2b9c159830 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0b0050 con 0x7f2b9c0cdc40 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c0c8250 con 0x7f2b9c0b40b0 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58430/0 (socket says 172.21.15.73:58430) 2023-12-19T16:16:01.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 -- 172.21.15.73:0/2533563570 learned_addr learned my addr 172.21.15.73:0/2533563570 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba11c8640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b9c0cdc40 0x7f2b9c0afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba19c9640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c0b40b0 0x7f2b9c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 -- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c0b40b0 msgr2=0x7f2b9c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c0b40b0 0x7f2b9c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 -- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b9c0cdc40 msgr2=0x7f2b9c0afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:01.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b9c0cdc40 0x7f2b9c0afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 -- 172.21.15.73:0/2533563570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009420 con 0x7f2b9c159830 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba21ca640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c790 tx=0x7f2b9400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400cea0 con 0x7f2b9c159830 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94003b80 con 0x7f2b9c159830 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c0c8530 con 0x7f2b9c159830 2023-12-19T16:16:01.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400a850 con 0x7f2b9c159830 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c0ae260 con 0x7f2b9c159830 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.949+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9c074050 con 0x7f2b9c159830 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.953+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b9400a9b0 con 0x7f2b9c159830 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.953+0000 7f2b927fc640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 0x7f2b80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.953+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b94082f10 con 0x7f2b9c159830 2023-12-19T16:16:01.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.953+0000 7f2ba19c9640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 0x7f2b80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:01.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.953+0000 7f2ba19c9640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 0x7f2b80067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b980af000 tx=0x7f2b980b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:01.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:01.957+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b94050970 con 0x7f2b9c159830 2023-12-19T16:16:02.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.105+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b9c0cbfc0 con 0x7f2b9c159830 2023-12-19T16:16:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2b927fc640 1 -- 172.21.15.73:0/2533563570 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f2b94053f90 con 0x7f2b9c159830 2023-12-19T16:16:02.112 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:02.112 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:02.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 msgr2=0x7f2b80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 0x7f2b80067f20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2b980af000 tx=0x7f2b980b6040 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 msgr2=0x7f2b9c1527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400c790 tx=0x7f2b9400cc50 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 shutdown_connections 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b80065a60 0x7f2b80067f20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b9c159830 0x7f2b9c1527f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b9c0cdc40 0x7f2b9c0afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 --2- 172.21.15.73:0/2533563570 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9c0b40b0 0x7f2b9c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 >> 172.21.15.73:0/2533563570 conn(0x7f2b9c0b0270 msgr2=0x7f2b9c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 shutdown_connections 2023-12-19T16:16:02.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.109+0000 7f2ba3c2d640 1 -- 172.21.15.73:0/2533563570 wait complete. 2023-12-19T16:16:02.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:02.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:02.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.269+0000 7f542f2f0640 1 Processor -- start 2023-12-19T16:16:02.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.269+0000 7f542f2f0640 1 -- start start 2023-12-19T16:16:02.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542f2f0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54280cb390 0x7f54280cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542f2f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542f2f0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542815aed0 con 0x7f542815aaf0 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542f2f0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280cbd60 con 0x7f54280cb390 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542f2f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542815f580 con 0x7f54280ccd20 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:42476/0 (socket says 172.21.15.73:42476) 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 -- 172.21.15.73:0/3073016331 learned_addr learned my addr 172.21.15.73:0/3073016331 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:02.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542daed640 1 --2- 172.21.15.73:0/3073016331 >> v2:172.21.15.162:3300/0 conn(0x7f54280cb390 0x7f54280cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 -- 172.21.15.73:0/3073016331 >> v2:172.21.15.162:3300/0 conn(0x7f54280cb390 msgr2=0x7f54280cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:02.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 --2- 172.21.15.73:0/3073016331 >> v2:172.21.15.162:3300/0 conn(0x7f54280cb390 0x7f54280cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 -- 172.21.15.73:0/3073016331 >> v1:172.21.15.162:6789/0 conn(0x7f542815aaf0 legacy=0x7f542815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542eaef640 1 -- 172.21.15.73:0/3073016331 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542815ed10 con 0x7f54280ccd20 2023-12-19T16:16:02.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.273+0000 7f542d2ec640 1 -- 172.21.15.73:0/3073016331 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416526475 0 0) 0x7f542815aed0 con 0x7f542815aaf0 2023-12-19T16:16:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542eaef640 1 --2- 172.21.15.73:0/3073016331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5420009e50 tx=0x7f542001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ebd7f659af8c924 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542d2ec640 1 -- 172.21.15.73:0/3073016331 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200a58a0 con 0x7f54280ccd20 2023-12-19T16:16:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542d2ec640 1 -- 172.21.15.73:0/3073016331 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200a5a00 con 0x7f54280ccd20 2023-12-19T16:16:02.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542d2ec640 1 -- 172.21.15.73:0/3073016331 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200a5d90 con 0x7f54280ccd20 2023-12-19T16:16:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- 172.21.15.73:0/3073016331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 msgr2=0x7f54280cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3073016331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5420009e50 tx=0x7f542001c9e0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- 172.21.15.73:0/3073016331 shutdown_connections 2023-12-19T16:16:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3073016331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54280ccd20 0x7f54280cd130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3073016331 >> v2:172.21.15.162:3300/0 conn(0x7f54280cb390 0x7f54280cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- 172.21.15.73:0/3073016331 >> 172.21.15.73:0/3073016331 conn(0x7f542806a120 msgr2=0x7f542806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- 172.21.15.73:0/3073016331 shutdown_connections 2023-12-19T16:16:02.281 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- 172.21.15.73:0/3073016331 wait complete. 2023-12-19T16:16:02.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 Processor -- start 2023-12-19T16:16:02.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.277+0000 7f542f2f0640 1 -- start start 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54280cb390 0x7f5428142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 0x7f54280c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 0x7f54280c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428142c50 con 0x7f54280ccd20 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c7d60 con 0x7f54280cb390 2023-12-19T16:16:02.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c7f60 con 0x7f542815aaf0 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542daed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 0x7f54280c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542e2ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54280cb390 0x7f5428142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 0x7f54280c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542daed640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 0x7f54280c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58434/0 (socket says 172.21.15.73:58434) 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542daed640 1 -- 172.21.15.73:0/3975016497 learned_addr learned my addr 172.21.15.73:0/3975016497 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 -- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54280cb390 msgr2=0x7f5428142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54280cb390 0x7f5428142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 -- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 msgr2=0x7f54280c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 0x7f54280c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 -- 172.21.15.73:0/3975016497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009b30 con 0x7f542815aaf0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542eaef640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 0x7f54280c7820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54200ab000 tx=0x7f5420019780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200bd070 con 0x7f542815aaf0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200b8470 con 0x7f542815aaf0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200b8820 con 0x7f542815aaf0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280c8240 con 0x7f542815aaf0 2023-12-19T16:16:02.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5428150ed0 con 0x7f542815aaf0 2023-12-19T16:16:02.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542804e000 con 0x7f542815aaf0 2023-12-19T16:16:02.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.281+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54200b8980 con 0x7f542815aaf0 2023-12-19T16:16:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.285+0000 7f541effd640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 0x7f540c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.285+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f542011dfe0 con 0x7f542815aaf0 2023-12-19T16:16:02.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.285+0000 7f542e2ee640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 0x7f540c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.285+0000 7f542e2ee640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 0x7f540c067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5424000fc0 tx=0x7f5424009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.289+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54200eb9a0 con 0x7f542815aaf0 2023-12-19T16:16:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54280adcb0 con 0x7f542815aaf0 2023-12-19T16:16:02.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f541effd640 1 -- 172.21.15.73:0/3975016497 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54200eefc0 con 0x7f542815aaf0 2023-12-19T16:16:02.441 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 msgr2=0x7f540c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 0x7f540c067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5424000fc0 tx=0x7f5424009040 comp rx=0 tx=0).stop 2023-12-19T16:16:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 msgr2=0x7f54280c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 0x7f54280c7820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54200ab000 tx=0x7f5420019780 comp rx=0 tx=0).stop 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 shutdown_connections 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f542815aaf0 0x7f54280c7820 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f540c065a60 0x7f540c067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54280ccd20 0x7f54280c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 --2- 172.21.15.73:0/3975016497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54280cb390 0x7f5428142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 >> 172.21.15.73:0/3975016497 conn(0x7f542806a120 msgr2=0x7f5428156890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 shutdown_connections 2023-12-19T16:16:02.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.437+0000 7f542f2f0640 1 -- 172.21.15.73:0/3975016497 wait complete. 2023-12-19T16:16:02.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:02.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.597+0000 7f79bb80b640 1 Processor -- start 2023-12-19T16:16:02.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79bb80b640 1 -- start start 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79bb80b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79b4158270 0x7f79b415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79bb80b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b406ffb0 con 0x7f79b4158650 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79bb80b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b415b730 con 0x7f79b415e4d0 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79bb80b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b415ba10 con 0x7f79b4158270 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b95a7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79b4158270 0x7f79b415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b8da6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f79b4158650 0x7f79b4070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43664/0 (socket says 172.21.15.73:43664) 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b8da6640 1 -- 172.21.15.73:0/3467486558 learned_addr learned my addr 172.21.15.73:0/3467486558 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b95a7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79b4158270 0x7f79b415aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58436/0 (socket says 172.21.15.73:58436) 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b95a7640 1 -- 172.21.15.73:0/3467486558 >> v1:172.21.15.162:6789/0 conn(0x7f79b415e4d0 legacy=0x7f79b406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b95a7640 1 -- 172.21.15.73:0/3467486558 >> v1:172.21.15.73:6789/0 conn(0x7f79b4158650 legacy=0x7f79b4070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79b95a7640 1 -- 172.21.15.73:0/3467486558 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b415bcf0 con 0x7f79b4158270 2023-12-19T16:16:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.601+0000 7f79abfff640 1 -- 172.21.15.73:0/3467486558 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740806596 0 0) 0x7f79b406ffb0 con 0x7f79b4158650 2023-12-19T16:16:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79b95a7640 1 --2- 172.21.15.73:0/3467486558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b415aee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79b40701a0 tx=0x7f79b001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06eb67a0763df05 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79abfff640 1 -- 172.21.15.73:0/3467486558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00ad660 con 0x7f79b4158270 2023-12-19T16:16:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79abfff640 1 -- 172.21.15.73:0/3467486558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00ad7c0 con 0x7f79b4158270 2023-12-19T16:16:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79abfff640 1 -- 172.21.15.73:0/3467486558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00adb50 con 0x7f79b4158270 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- 172.21.15.73:0/3467486558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 msgr2=0x7f79b415aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 --2- 172.21.15.73:0/3467486558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b415aee0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79b40701a0 tx=0x7f79b001c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- 172.21.15.73:0/3467486558 shutdown_connections 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 --2- 172.21.15.73:0/3467486558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b415aee0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- 172.21.15.73:0/3467486558 >> 172.21.15.73:0/3467486558 conn(0x7f79b406a570 msgr2=0x7f79b40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- 172.21.15.73:0/3467486558 shutdown_connections 2023-12-19T16:16:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- 172.21.15.73:0/3467486558 wait complete. 2023-12-19T16:16:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 Processor -- start 2023-12-19T16:16:02.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.605+0000 7f79bb80b640 1 -- start start 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79b4158650 0x7f79b40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79b415e4d0 0x7f79b414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4153e00 con 0x7f79b4158270 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b1ae0 con 0x7f79b415e4d0 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b40b1dc0 con 0x7f79b4158650 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58442/0 (socket says 172.21.15.73:58442) 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 -- 172.21.15.73:0/44425376 learned_addr learned my addr 172.21.15.73:0/44425376 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:02.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b9da8640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79b415e4d0 0x7f79b414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b8da6640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79b4158650 0x7f79b40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 -- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79b4158650 msgr2=0x7f79b40cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79b4158650 0x7f79b40cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 -- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79b415e4d0 msgr2=0x7f79b414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79b415e4d0 0x7f79b414ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 -- 172.21.15.73:0/44425376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009420 con 0x7f79b4158270 2023-12-19T16:16:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79b95a7640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f79b0018fb0 tx=0x7f79b001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00b9650 con 0x7f79b4158270 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00b97d0 con 0x7f79b4158270 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00b9b80 con 0x7f79b4158270 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40b20a0 con 0x7f79b4158270 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b414f160 con 0x7f79b4158270 2023-12-19T16:16:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.609+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b404e070 con 0x7f79b4158270 2023-12-19T16:16:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.613+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f79b00b9ce0 con 0x7f79b4158270 2023-12-19T16:16:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.613+0000 7f79a9ffb640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 0x7f7998067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.613+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79b011dcc0 con 0x7f79b4158270 2023-12-19T16:16:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.613+0000 7f79b8da6640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 0x7f7998067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.613+0000 7f79b8da6640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 0x7f7998067f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b2ed0 tx=0x7f79a4007240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.617+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f79b00eb7a0 con 0x7f79b4158270 2023-12-19T16:16:02.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.765+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79b40b1f00 con 0x7f79b4158270 2023-12-19T16:16:02.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.765+0000 7f79a9ffb640 1 -- 172.21.15.73:0/44425376 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79b40b1f00 con 0x7f79b4158270 2023-12-19T16:16:02.770 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 msgr2=0x7f7998067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 0x7f7998067f70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f79b40b2ed0 tx=0x7f79a4007240 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 msgr2=0x7f79b4154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f79b0018fb0 tx=0x7f79b001abe0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 shutdown_connections 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f79b415e4d0 0x7f79b414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f79b4158650 0x7f79b40cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7998065ab0 0x7f7998067f70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 --2- 172.21.15.73:0/44425376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79b4158270 0x7f79b4154880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 >> 172.21.15.73:0/44425376 conn(0x7f79b406a570 msgr2=0x7f79b415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 shutdown_connections 2023-12-19T16:16:02.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.769+0000 7f79bb80b640 1 -- 172.21.15.73:0/44425376 wait complete. 2023-12-19T16:16:02.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 Processor -- start 2023-12-19T16:16:02.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 -- start start 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49dc0ce280 0x7f49dc161160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49dc0cc6b0 0x7f49dc0d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc1606c0 con 0x7f49dc0ce660 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc15de30 con 0x7f49dc0ce280 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49e0803640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc06c990 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49dc0ce280 0x7f49dc161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49dc0ce280 0x7f49dc161160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58446/0 (socket says 172.21.15.73:58446) 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 -- 172.21.15.73:0/3432592401 learned_addr learned my addr 172.21.15.73:0/3432592401 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:02.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49da59c640 1 --2- 172.21.15.73:0/3432592401 >> v2:172.21.15.162:3300/0 conn(0x7f49dc0cc6b0 0x7f49dc0d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 -- 172.21.15.73:0/3432592401 >> v2:172.21.15.162:3300/0 conn(0x7f49dc0cc6b0 msgr2=0x7f49dc0d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 --2- 172.21.15.73:0/3432592401 >> v2:172.21.15.162:3300/0 conn(0x7f49dc0cc6b0 0x7f49dc0d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 -- 172.21.15.73:0/3432592401 >> v1:172.21.15.162:6789/0 conn(0x7f49dc0ce660 legacy=0x7f49dc06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.929+0000 7f49dad9d640 1 -- 172.21.15.73:0/3432592401 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc160960 con 0x7f49dc0ce280 2023-12-19T16:16:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49dad9d640 1 --2- 172.21.15.73:0/3432592401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce280 0x7f49dc161160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0cacb0 tx=0x7f49cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed200805ef647e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49d9d9b640 1 -- 172.21.15.73:0/3432592401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0a4ea0 con 0x7f49dc0ce280 2023-12-19T16:16:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49d9d9b640 1 -- 172.21.15.73:0/3432592401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc0a7050 con 0x7f49dc0ce280 2023-12-19T16:16:02.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49d9d9b640 1 -- 172.21.15.73:0/3432592401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0ab820 con 0x7f49dc0ce280 2023-12-19T16:16:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 -- 172.21.15.73:0/3432592401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce280 msgr2=0x7f49dc161160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 --2- 172.21.15.73:0/3432592401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce280 0x7f49dc161160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0cacb0 tx=0x7f49cc01c470 comp rx=0 tx=0).stop 2023-12-19T16:16:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 -- 172.21.15.73:0/3432592401 shutdown_connections 2023-12-19T16:16:02.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 --2- 172.21.15.73:0/3432592401 >> v2:172.21.15.162:3300/0 conn(0x7f49dc0cc6b0 0x7f49dc0d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 --2- 172.21.15.73:0/3432592401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce280 0x7f49dc161160 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 -- 172.21.15.73:0/3432592401 >> 172.21.15.73:0/3432592401 conn(0x7f49dc0658e0 msgr2=0x7f49dc065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 -- 172.21.15.73:0/3432592401 shutdown_connections 2023-12-19T16:16:02.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.933+0000 7f49e0803640 1 -- 172.21.15.73:0/3432592401 wait complete. 2023-12-19T16:16:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 Processor -- start 2023-12-19T16:16:02.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- start start 2023-12-19T16:16:02.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0ce280 0x7f49dc1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc153120 con 0x7f49dc0ce660 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc152c90 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0b6430 con 0x7f49dc0ce280 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49db59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:32848/0 (socket says 172.21.15.73:32848) 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 -- 172.21.15.73:0/2264658585 learned_addr learned my addr 172.21.15.73:0/2264658585 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49db59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58448/0 (socket says 172.21.15.73:58448) 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49da59c640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0ce280 0x7f49dc1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 -- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0ce280 msgr2=0x7f49dc1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0ce280 0x7f49dc1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 -- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 msgr2=0x7f49dc15efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 -- 172.21.15.73:0/2264658585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc0094d0 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49db59e640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49dad9d640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01a0a0 tx=0x7f49cc01acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0b6420 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc0b65a0 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc152080 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0b6950 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.937+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc152640 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc04e000 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f49cc0b2040 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49c37fe640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 0x7f49c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:02.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49cc11d480 con 0x7f49dc0cc6b0 2023-12-19T16:16:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49da59c640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 0x7f49c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:02.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.941+0000 7f49da59c640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 0x7f49c8067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0cc2b0 tx=0x7f49d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:02.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:02.945+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f49cc0eae50 con 0x7f49dc0cc6b0 2023-12-19T16:16:03.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.093+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49dc0b2ed0 con 0x7f49dc0cc6b0 2023-12-19T16:16:03.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.093+0000 7f49c37fe640 1 -- 172.21.15.73:0/2264658585 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49cc0ee470 con 0x7f49dc0cc6b0 2023-12-19T16:16:03.097 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 msgr2=0x7f49c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 0x7f49c8067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0cc2b0 tx=0x7f49d0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:03.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 msgr2=0x7f49dc0b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49cc01a0a0 tx=0x7f49cc01acb0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 shutdown_connections 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49c8065a60 0x7f49c8067f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49dc0ce660 0x7f49dc15efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49dc0ce280 0x7f49dc1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 --2- 172.21.15.73:0/2264658585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49dc0cc6b0 0x7f49dc0b5ef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 >> 172.21.15.73:0/2264658585 conn(0x7f49dc0658e0 msgr2=0x7f49dc0d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 shutdown_connections 2023-12-19T16:16:03.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.097+0000 7f49e0803640 1 -- 172.21.15.73:0/2264658585 wait complete. 2023-12-19T16:16:03.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:03.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 Processor -- start 2023-12-19T16:16:03.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 -- start start 2023-12-19T16:16:03.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 0x7f09300b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09300b4bd0 0x7f093015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093015d270 con 0x7f093015ce20 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300b7250 con 0x7f09300b4bd0 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f093616d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09300b7530 con 0x7f09300b47f0 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09300b4bd0 0x7f093015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f093015ce20 0x7f09300d0ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43674/0 (socket says 172.21.15.73:43674) 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09300b4bd0 0x7f093015c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58460/0 (socket says 172.21.15.73:58460) 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092ffff640 1 -- 172.21.15.73:0/1002297126 learned_addr learned my addr 172.21.15.73:0/1002297126 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092f7fe640 1 --2- 172.21.15.73:0/1002297126 >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 0x7f09300b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 -- 172.21.15.73:0/1002297126 >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 msgr2=0x7f09300b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:03.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 --2- 172.21.15.73:0/1002297126 >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 0x7f09300b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 -- 172.21.15.73:0/1002297126 >> v1:172.21.15.73:6789/0 conn(0x7f093015ce20 legacy=0x7f09300d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092effd640 1 -- 172.21.15.73:0/1002297126 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300b7810 con 0x7f09300b4bd0 2023-12-19T16:16:03.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.253+0000 7f092f7fe640 1 --2- 172.21.15.73:0/1002297126 >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 0x7f09300b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f092effd640 1 --2- 172.21.15.73:0/1002297126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b4bd0 0x7f093015c8e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09300cfcd0 tx=0x7f092401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6a9f58065cd8b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f092e7fc640 1 -- 172.21.15.73:0/1002297126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09240ab600 con 0x7f09300b4bd0 2023-12-19T16:16:03.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f092e7fc640 1 -- 172.21.15.73:0/1002297126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09240a7050 con 0x7f09300b4bd0 2023-12-19T16:16:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f092e7fc640 1 -- 172.21.15.73:0/1002297126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09240ab980 con 0x7f09300b4bd0 2023-12-19T16:16:03.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 -- 172.21.15.73:0/1002297126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b4bd0 msgr2=0x7f093015c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 --2- 172.21.15.73:0/1002297126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b4bd0 0x7f093015c8e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f09300cfcd0 tx=0x7f092401c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 -- 172.21.15.73:0/1002297126 shutdown_connections 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 --2- 172.21.15.73:0/1002297126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b4bd0 0x7f093015c8e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 --2- 172.21.15.73:0/1002297126 >> v2:172.21.15.162:3300/0 conn(0x7f09300b47f0 0x7f09300b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 -- 172.21.15.73:0/1002297126 >> 172.21.15.73:0/1002297126 conn(0x7f0930065ce0 msgr2=0x7f09300660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 -- 172.21.15.73:0/1002297126 shutdown_connections 2023-12-19T16:16:03.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.257+0000 7f093616d640 1 -- 172.21.15.73:0/1002297126 wait complete. 2023-12-19T16:16:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 Processor -- start 2023-12-19T16:16:03.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- start start 2023-12-19T16:16:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09300b4bd0 0x7f09300c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f093015ce20 0x7f09300c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09300c8b40 con 0x7f09300b47f0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093015a310 con 0x7f09300b4bd0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093015ae00 con 0x7f093015ce20 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58464/0 (socket says 172.21.15.73:58464) 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 -- 172.21.15.73:0/2776167823 learned_addr learned my addr 172.21.15.73:0/2776167823 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092effd640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09300b4bd0 0x7f09300c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092ffff640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f093015ce20 0x7f09300c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 -- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f093015ce20 msgr2=0x7f09300c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f093015ce20 0x7f09300c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 -- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09300b4bd0 msgr2=0x7f09300c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09300b4bd0 0x7f09300c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 -- 172.21.15.73:0/2776167823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009420 con 0x7f09300b47f0 2023-12-19T16:16:03.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f092f7fe640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f092000ec10 tx=0x7f092000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092000cc30 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092000cd90 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0920013690 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0924009420 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093015a840 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.261+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0930074050 con 0x7f09300b47f0 2023-12-19T16:16:03.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.265+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09200137f0 con 0x7f09300b47f0 2023-12-19T16:16:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.265+0000 7f0917fff640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 0x7f091c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.265+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09200837f0 con 0x7f09300b47f0 2023-12-19T16:16:03.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.265+0000 7f092effd640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 0x7f091c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.265+0000 7f092effd640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 0x7f091c067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09240ad000 tx=0x7f0924008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.269+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f09200511c0 con 0x7f09300b47f0 2023-12-19T16:16:03.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.421+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09300cfd90 con 0x7f09300b47f0 2023-12-19T16:16:03.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.421+0000 7f0917fff640 1 -- 172.21.15.73:0/2776167823 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f09200547e0 con 0x7f09300b47f0 2023-12-19T16:16:03.426 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:03.427 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:03.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 msgr2=0x7f091c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 0x7f091c067f50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f09240ad000 tx=0x7f0924008040 comp rx=0 tx=0).stop 2023-12-19T16:16:03.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 msgr2=0x7f093014bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f092000ec10 tx=0x7f092000c520 comp rx=0 tx=0).stop 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 shutdown_connections 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f093015ce20 0x7f09300c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09300b4bd0 0x7f09300c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f091c065a90 0x7f091c067f50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 --2- 172.21.15.73:0/2776167823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09300b47f0 0x7f093014bbf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 >> 172.21.15.73:0/2776167823 conn(0x7f0930065ce0 msgr2=0x7f0930154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 shutdown_connections 2023-12-19T16:16:03.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.425+0000 7f093616d640 1 -- 172.21.15.73:0/2776167823 wait complete. 2023-12-19T16:16:03.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:03.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:03.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.585+0000 7ffbeb10b640 1 Processor -- start 2023-12-19T16:16:03.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.585+0000 7ffbeb10b640 1 -- start start 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbeb10b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbe40cb390 0x7ffbe40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbeb10b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40ccd20 0x7ffbe40cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbeb10b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe415aed0 con 0x7ffbe415aaf0 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbeb10b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe40cbd60 con 0x7ffbe40cb390 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbeb10b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415f580 con 0x7ffbe40ccd20 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbe40cb390 0x7ffbe40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbe40cb390 0x7ffbe40cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58480/0 (socket says 172.21.15.73:58480) 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 -- 172.21.15.73:0/3462136150 learned_addr learned my addr 172.21.15.73:0/3462136150 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbea90a640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40ccd20 0x7ffbe40cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 -- 172.21.15.73:0/3462136150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40ccd20 msgr2=0x7ffbe40cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40ccd20 0x7ffbe40cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 -- 172.21.15.73:0/3462136150 >> v1:172.21.15.73:6789/0 conn(0x7ffbe415aaf0 legacy=0x7ffbe415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.589+0000 7ffbe9908640 1 -- 172.21.15.73:0/3462136150 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe415ed10 con 0x7ffbe40cb390 2023-12-19T16:16:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbe9908640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40cb390 0x7ffbe40cb820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cce1159c6aca77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbe9107640 1 -- 172.21.15.73:0/3462136150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40aa670 con 0x7ffbe40cb390 2023-12-19T16:16:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbe9107640 1 -- 172.21.15.73:0/3462136150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40aa7d0 con 0x7ffbe40cb390 2023-12-19T16:16:03.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbe9107640 1 -- 172.21.15.73:0/3462136150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40aab60 con 0x7ffbe40cb390 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3462136150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40cb390 msgr2=0x7ffbe40cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40cb390 0x7ffbe40cb820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401c510 comp rx=0 tx=0).stop 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3462136150 shutdown_connections 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40ccd20 0x7ffbe40cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3462136150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40cb390 0x7ffbe40cb820 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3462136150 >> 172.21.15.73:0/3462136150 conn(0x7ffbe406a120 msgr2=0x7ffbe406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3462136150 shutdown_connections 2023-12-19T16:16:03.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3462136150 wait complete. 2023-12-19T16:16:03.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 Processor -- start 2023-12-19T16:16:03.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.593+0000 7ffbeb10b640 1 -- start start 2023-12-19T16:16:03.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40cb390 0x7ffbe414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbe415aaf0 0x7ffbe40c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c3d20 con 0x7ffbe40ccd20 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415a230 con 0x7ffbe415aaf0 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c30a0 con 0x7ffbe40cb390 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58490/0 (socket says 172.21.15.73:58490) 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 -- 172.21.15.73:0/3420106605 learned_addr learned my addr 172.21.15.73:0/3420106605 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbea109640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40cb390 0x7ffbe414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbea90a640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbe415aaf0 0x7ffbe40c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 -- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40cb390 msgr2=0x7ffbe414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40cb390 0x7ffbe414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 -- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbe415aaf0 msgr2=0x7ffbe40c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbe415aaf0 0x7ffbe40c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 -- 172.21.15.73:0/3420106605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40094d0 con 0x7ffbe40ccd20 2023-12-19T16:16:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbe9908640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401a140 tx=0x7ffbd401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b3800 con 0x7ffbe40ccd20 2023-12-19T16:16:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40b3980 con 0x7ffbe40ccd20 2023-12-19T16:16:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40c3380 con 0x7ffbe40ccd20 2023-12-19T16:16:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b3d30 con 0x7ffbe40ccd20 2023-12-19T16:16:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40c3940 con 0x7ffbe40ccd20 2023-12-19T16:16:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe404e000 con 0x7ffbe40ccd20 2023-12-19T16:16:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.597+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffbd40c6440 con 0x7ffbe40ccd20 2023-12-19T16:16:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.601+0000 7ffbdaffd640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 0x7ffbc8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.601+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbd411ddc0 con 0x7ffbe40ccd20 2023-12-19T16:16:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.601+0000 7ffbea109640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 0x7ffbc8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.601+0000 7ffbea109640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 0x7ffbc8067f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0007fd0 tx=0x7ffbe0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.601+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffbd40eb8c0 con 0x7ffbe40ccd20 2023-12-19T16:16:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.749+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbe406ca50 con 0x7ffbe40ccd20 2023-12-19T16:16:03.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbdaffd640 1 -- 172.21.15.73:0/3420106605 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffbd40eeee0 con 0x7ffbe40ccd20 2023-12-19T16:16:03.755 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 msgr2=0x7ffbc8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 0x7ffbc8067f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0007fd0 tx=0x7ffbe0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 msgr2=0x7ffbe414d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffbd401a140 tx=0x7ffbd401ad50 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 shutdown_connections 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbe415aaf0 0x7ffbe40c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffbc8065a90 0x7ffbc8067f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbe40ccd20 0x7ffbe414d3b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 --2- 172.21.15.73:0/3420106605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffbe40cb390 0x7ffbe414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 >> 172.21.15.73:0/3420106605 conn(0x7ffbe406a120 msgr2=0x7ffbe4157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 shutdown_connections 2023-12-19T16:16:03.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.753+0000 7ffbeb10b640 1 -- 172.21.15.73:0/3420106605 wait complete. 2023-12-19T16:16:03.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:03.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 Processor -- start 2023-12-19T16:16:03.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 -- start start 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb90160260 0x7feb900cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feb900d0030 0x7feb900b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900d38f0 con 0x7feb900d2090 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900d2850 con 0x7feb900d0030 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb95952640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb900d2b30 con 0x7feb90160260 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feb900d0030 0x7feb900b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feb900d2090 0x7feb900cf920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43690/0 (socket says 172.21.15.73:43690) 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8e7fc640 1 -- 172.21.15.73:0/3922935464 learned_addr learned my addr 172.21.15.73:0/3922935464 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8effd640 1 --2- 172.21.15.73:0/3922935464 >> v2:172.21.15.162:3300/0 conn(0x7feb90160260 0x7feb900cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8f7fe640 1 -- 172.21.15.73:0/3922935464 >> v2:172.21.15.162:3300/0 conn(0x7feb90160260 msgr2=0x7feb900cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:03.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8f7fe640 1 --2- 172.21.15.73:0/3922935464 >> v2:172.21.15.162:3300/0 conn(0x7feb90160260 0x7feb900cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8f7fe640 1 -- 172.21.15.73:0/3922935464 >> v1:172.21.15.73:6789/0 conn(0x7feb900d2090 legacy=0x7feb900cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.913+0000 7feb8f7fe640 1 -- 172.21.15.73:0/3922935464 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900d2e10 con 0x7feb900d0030 2023-12-19T16:16:03.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb8f7fe640 1 --2- 172.21.15.73:0/3922935464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d0030 0x7feb900b5b70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb900cf4c0 tx=0x7feb8801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97fec1314cac1f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb8dffb640 1 -- 172.21.15.73:0/3922935464 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b0440 con 0x7feb900d0030 2023-12-19T16:16:03.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb8dffb640 1 -- 172.21.15.73:0/3922935464 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880b05a0 con 0x7feb900d0030 2023-12-19T16:16:03.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb8dffb640 1 -- 172.21.15.73:0/3922935464 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880b0930 con 0x7feb900d0030 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 -- 172.21.15.73:0/3922935464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d0030 msgr2=0x7feb900b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 --2- 172.21.15.73:0/3922935464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d0030 0x7feb900b5b70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feb900cf4c0 tx=0x7feb8801f0f0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 -- 172.21.15.73:0/3922935464 shutdown_connections 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 --2- 172.21.15.73:0/3922935464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d0030 0x7feb900b5b70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 --2- 172.21.15.73:0/3922935464 >> v2:172.21.15.162:3300/0 conn(0x7feb90160260 0x7feb900cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 -- 172.21.15.73:0/3922935464 >> 172.21.15.73:0/3922935464 conn(0x7feb90065ae0 msgr2=0x7feb90065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:03.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 -- 172.21.15.73:0/3922935464 shutdown_connections 2023-12-19T16:16:03.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.917+0000 7feb95952640 1 -- 172.21.15.73:0/3922935464 wait complete. 2023-12-19T16:16:03.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 Processor -- start 2023-12-19T16:16:03.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- start start 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 0x7feb900b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 0x7feb901f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900b1540 con 0x7feb900d2090 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900aad10 con 0x7feb900d0030 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900aaff0 con 0x7feb90160260 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58508/0 (socket says 172.21.15.73:58508) 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 -- 172.21.15.73:0/4207406240 learned_addr learned my addr 172.21.15.73:0/4207406240 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8effd640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 0x7feb900b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8f7fe640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 0x7feb901f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 -- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 msgr2=0x7feb901f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 0x7feb901f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 -- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 msgr2=0x7feb900b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 0x7feb900b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 -- 172.21.15.73:0/4207406240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009a70 con 0x7feb900d2090 2023-12-19T16:16:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8effd640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 0x7feb900b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8f7fe640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 0x7feb901f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb8e7fc640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c500 tx=0x7feb8400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84005cf0 con 0x7feb900d2090 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84005e50 con 0x7feb900d2090 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840072f0 con 0x7feb900d2090 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb901f3430 con 0x7feb900d2090 2023-12-19T16:16:03.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.921+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900ab2d0 con 0x7feb900d2090 2023-12-19T16:16:03.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb900b8620 con 0x7feb900d2090 2023-12-19T16:16:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb84007450 con 0x7feb900d2090 2023-12-19T16:16:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb77fff640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb84082650 con 0x7feb900d2090 2023-12-19T16:16:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb8effd640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:03.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.925+0000 7feb8effd640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 0x7feb7c067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb800097a0 tx=0x7feb80008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:03.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:03.929+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb84050150 con 0x7feb900d2090 2023-12-19T16:16:04.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.077+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb9004e070 con 0x7feb900d2090 2023-12-19T16:16:04.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.077+0000 7feb77fff640 1 -- 172.21.15.73:0/4207406240 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb84053770 con 0x7feb900d2090 2023-12-19T16:16:04.081 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.077+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 msgr2=0x7feb7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 0x7feb7c067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7feb800097a0 tx=0x7feb80008040 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 msgr2=0x7feb901f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c500 tx=0x7feb8400c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 shutdown_connections 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb90160260 0x7feb901f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb7c065a60 0x7feb7c067f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb900d2090 0x7feb901f5850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 --2- 172.21.15.73:0/4207406240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb900d0030 0x7feb900b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 >> 172.21.15.73:0/4207406240 conn(0x7feb90065ae0 msgr2=0x7feb90073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 shutdown_connections 2023-12-19T16:16:04.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.081+0000 7feb95952640 1 -- 172.21.15.73:0/4207406240 wait complete. 2023-12-19T16:16:04.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:04.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 Processor -- start 2023-12-19T16:16:04.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 -- start start 2023-12-19T16:16:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 0x7f839c06bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c0c9760 con 0x7f839c159230 2023-12-19T16:16:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839c0cc870 con 0x7f839c0ca4b0 2023-12-19T16:16:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f83a1c95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c0c99d0 con 0x7f839c0cd520 2023-12-19T16:16:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f839b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f839c159230 0x7f839c0cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43700/0 (socket says 172.21.15.73:43700) 2023-12-19T16:16:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.241+0000 7f839b7fe640 1 -- 172.21.15.73:0/2367763808 learned_addr learned my addr 172.21.15.73:0/2367763808 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839bfff640 1 --2- 172.21.15.73:0/2367763808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 0x7f839c06bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555861396 0 0) 0x7f839c0c9760 con 0x7f839c159230 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8388003530 con 0x7f839c159230 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574586168 0 0) 0x7f839c0cc870 con 0x7f839c0ca4b0 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f839c0c9760 con 0x7f839c0ca4b0 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839bfff640 1 -- 172.21.15.73:0/2367763808 >> v1:172.21.15.162:6789/0 conn(0x7f839c0ca4b0 legacy=0x7f839c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839bfff640 1 -- 172.21.15.73:0/2367763808 >> v1:172.21.15.73:6789/0 conn(0x7f839c159230 legacy=0x7f839c0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839bfff640 1 -- 172.21.15.73:0/2367763808 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c0c9cb0 con 0x7f839c0cd520 2023-12-19T16:16:04.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839bfff640 1 --2- 172.21.15.73:0/2367763808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 0x7f839c06bb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f839400aed0 tx=0x7f839401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d719f66e769f3492 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400a2d0 con 0x7f839c0cd520 2023-12-19T16:16:04.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940a57a0 con 0x7f839c0cd520 2023-12-19T16:16:04.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.245+0000 7f839affd640 1 -- 172.21.15.73:0/2367763808 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a5b30 con 0x7f839c0cd520 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- 172.21.15.73:0/2367763808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 msgr2=0x7f839c06bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2367763808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 0x7f839c06bb80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f839400aed0 tx=0x7f839401c960 comp rx=0 tx=0).stop 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- 172.21.15.73:0/2367763808 shutdown_connections 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2367763808 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0cd520 0x7f839c06bb80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- 172.21.15.73:0/2367763808 >> 172.21.15.73:0/2367763808 conn(0x7f839c06a570 msgr2=0x7f839c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- 172.21.15.73:0/2367763808 shutdown_connections 2023-12-19T16:16:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- 172.21.15.73:0/2367763808 wait complete. 2023-12-19T16:16:04.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 Processor -- start 2023-12-19T16:16:04.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- start start 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0ca4b0 0x7f839c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f839c157dc0 0x7f839c15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c158250 con 0x7f839c0cd520 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839c159620 con 0x7f839c157dc0 2023-12-19T16:16:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f83a1c95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839c15a1a0 con 0x7f839c0ca4b0 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58510/0 (socket says 172.21.15.73:58510) 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 -- 172.21.15.73:0/2009816284 learned_addr learned my addr 172.21.15.73:0/2009816284 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f839b7fe640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0ca4b0 0x7f839c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f839bfff640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f839c157dc0 0x7f839c15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 -- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0ca4b0 msgr2=0x7f839c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0ca4b0 0x7f839c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 -- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f839c157dc0 msgr2=0x7f839c15b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f839c157dc0 0x7f839c15b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.249+0000 7f8393fff640 1 -- 172.21.15.73:0/2009816284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839400ab80 con 0x7f839c0cd520 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8393fff640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f838400c490 tx=0x7f838400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840052d0 con 0x7f839c0cd520 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8384005430 con 0x7f839c0cd520 2023-12-19T16:16:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384012870 con 0x7f839c0cd520 2023-12-19T16:16:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839c159870 con 0x7f839c0cd520 2023-12-19T16:16:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839c159e30 con 0x7f839c0cd520 2023-12-19T16:16:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839c0ca8b0 con 0x7f839c0cd520 2023-12-19T16:16:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83840129d0 con 0x7f839c0cd520 2023-12-19T16:16:04.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 0x7f837c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8384082c40 con 0x7f839c0cd520 2023-12-19T16:16:04.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.253+0000 7f839b7fe640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 0x7f837c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.257+0000 7f839b7fe640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 0x7f837c067f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f838c0011f0 tx=0x7f838c007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.257+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8384054140 con 0x7f839c0cd520 2023-12-19T16:16:04.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f839c15a310 con 0x7f839c0cd520 2023-12-19T16:16:04.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f8398ff9640 1 -- 172.21.15.73:0/2009816284 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8384053cd0 con 0x7f839c0cd520 2023-12-19T16:16:04.413 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:04.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 msgr2=0x7f837c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 0x7f837c067f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f838c0011f0 tx=0x7f838c007d40 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 msgr2=0x7f839c157880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f838400c490 tx=0x7f838400c950 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 shutdown_connections 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f839c157dc0 0x7f839c15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f837c065a90 0x7f837c067f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f839c0cd520 0x7f839c157880 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 --2- 172.21.15.73:0/2009816284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f839c0ca4b0 0x7f839c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.409+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 >> 172.21.15.73:0/2009816284 conn(0x7f839c06a570 msgr2=0x7f839c06c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.413+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 shutdown_connections 2023-12-19T16:16:04.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.413+0000 7f83a1c95640 1 -- 172.21.15.73:0/2009816284 wait complete. 2023-12-19T16:16:04.434 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 Processor -- start 2023-12-19T16:16:04.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 -- start start 2023-12-19T16:16:04.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f494c159830 0x7f494c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f494c0b40b0 0x7f494c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c15ad00 con 0x7f494c0cda70 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c15e110 con 0x7f494c0b40b0 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4952552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c0cdf00 con 0x7f494c159830 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f494b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f494c0b40b0 0x7f494c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4950aef640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f494c0cda70 0x7f494c0cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43714/0 (socket says 172.21.15.73:43714) 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f4950aef640 1 -- 172.21.15.73:0/942495513 learned_addr learned my addr 172.21.15.73:0/942495513 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.573+0000 7f494bfff640 1 --2- 172.21.15.73:0/942495513 >> v2:172.21.15.162:3300/0 conn(0x7f494c159830 0x7f494c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494b7fe640 1 -- 172.21.15.73:0/942495513 >> v2:172.21.15.162:3300/0 conn(0x7f494c159830 msgr2=0x7f494c15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494b7fe640 1 --2- 172.21.15.73:0/942495513 >> v2:172.21.15.162:3300/0 conn(0x7f494c159830 0x7f494c15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494b7fe640 1 -- 172.21.15.73:0/942495513 >> v1:172.21.15.73:6789/0 conn(0x7f494c0cda70 legacy=0x7f494c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494b7fe640 1 -- 172.21.15.73:0/942495513 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0ce2d0 con 0x7f494c0b40b0 2023-12-19T16:16:04.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494affd640 1 -- 172.21.15.73:0/942495513 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589114957 0 0) 0x7f494c15ad00 con 0x7f494c0cda70 2023-12-19T16:16:04.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494b7fe640 1 --2- 172.21.15.73:0/942495513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0cd530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f494c06bf10 tx=0x7f494001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a7f11dbcefcea1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494affd640 1 -- 172.21.15.73:0/942495513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400ac600 con 0x7f494c0b40b0 2023-12-19T16:16:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494affd640 1 -- 172.21.15.73:0/942495513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49400a8050 con 0x7f494c0b40b0 2023-12-19T16:16:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f494affd640 1 -- 172.21.15.73:0/942495513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49400ac980 con 0x7f494c0b40b0 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 -- 172.21.15.73:0/942495513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 msgr2=0x7f494c0cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 --2- 172.21.15.73:0/942495513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0cd530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f494c06bf10 tx=0x7f494001c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 -- 172.21.15.73:0/942495513 shutdown_connections 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 --2- 172.21.15.73:0/942495513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0cd530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 --2- 172.21.15.73:0/942495513 >> v2:172.21.15.162:3300/0 conn(0x7f494c159830 0x7f494c15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.577+0000 7f4952552640 1 -- 172.21.15.73:0/942495513 >> 172.21.15.73:0/942495513 conn(0x7f494c0b0270 msgr2=0x7f494c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- 172.21.15.73:0/942495513 shutdown_connections 2023-12-19T16:16:04.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- 172.21.15.73:0/942495513 wait complete. 2023-12-19T16:16:04.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 Processor -- start 2023-12-19T16:16:04.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- start start 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 0x7f494c157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f494c159830 0x7f494c0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c4050 con 0x7f494c0b40b0 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1575b0 con 0x7f494c159830 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4952552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c34d0 con 0x7f494c0cda70 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58530/0 (socket says 172.21.15.73:58530) 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 -- 172.21.15.73:0/550888578 learned_addr learned my addr 172.21.15.73:0/550888578 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f4950aef640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f494c159830 0x7f494c0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494b7fe640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 0x7f494c157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 -- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 msgr2=0x7f494c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 0x7f494c157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 -- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f494c159830 msgr2=0x7f494c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f494c159830 0x7f494c0c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 -- 172.21.15.73:0/550888578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4940009420 con 0x7f494c0b40b0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494b7fe640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 0x7f494c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.581+0000 7f494bfff640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f493c00e870 tx=0x7f493c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c009510 con 0x7f494c0b40b0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00eec0 con 0x7f494c0b40b0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00cb40 con 0x7f494c0b40b0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0c37b0 con 0x7f494c0b40b0 2023-12-19T16:16:04.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0c3d70 con 0x7f494c0b40b0 2023-12-19T16:16:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c074050 con 0x7f494c0b40b0 2023-12-19T16:16:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f493c00cca0 con 0x7f494c0b40b0 2023-12-19T16:16:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 0x7f4938067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f493c0831f0 con 0x7f494c0b40b0 2023-12-19T16:16:04.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f494b7fe640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 0x7f4938067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.585+0000 7f494b7fe640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 0x7f4938067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49400ae000 tx=0x7f4940008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.589+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f493c050c60 con 0x7f494c0b40b0 2023-12-19T16:16:04.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f494c0ada00 con 0x7f494c0b40b0 2023-12-19T16:16:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4948ff9640 1 -- 172.21.15.73:0/550888578 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f493c054280 con 0x7f494c0b40b0 2023-12-19T16:16:04.745 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:04.745 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 msgr2=0x7f4938067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 0x7f4938067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f49400ae000 tx=0x7f4940008040 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 msgr2=0x7f494c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f493c00e870 tx=0x7f493c00ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 shutdown_connections 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f494c159830 0x7f494c0c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f494c0cda70 0x7f494c157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4938065a60 0x7f4938067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 --2- 172.21.15.73:0/550888578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f494c0b40b0 0x7f494c0b2350 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.741+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 >> 172.21.15.73:0/550888578 conn(0x7f494c0b0270 msgr2=0x7f494c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.745+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 shutdown_connections 2023-12-19T16:16:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.745+0000 7f4952552640 1 -- 172.21.15.73:0/550888578 wait complete. 2023-12-19T16:16:04.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:04.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:04.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.901+0000 7f75f3f52640 1 Processor -- start 2023-12-19T16:16:04.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.901+0000 7f75f3f52640 1 -- start start 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f3f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158270 0x7f75ec15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f3f52640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75ec158650 0x7f75ec070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f3f52640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec06ffb0 con 0x7f75ec15e4d0 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f3f52640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec15b730 con 0x7f75ec158650 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f3f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec15ba10 con 0x7f75ec158270 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75ec158650 0x7f75ec070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f75ec158650 0x7f75ec070790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60570/0 (socket says 172.21.15.73:60570) 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 -- 172.21.15.73:0/837893157 learned_addr learned my addr 172.21.15.73:0/837893157 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f1cee640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158270 0x7f75ec15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 -- 172.21.15.73:0/837893157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158270 msgr2=0x7f75ec15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:04.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158270 0x7f75ec15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 -- 172.21.15.73:0/837893157 >> v1:172.21.15.162:6789/0 conn(0x7f75ec15e4d0 legacy=0x7f75ec06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.905+0000 7f75f14ed640 1 -- 172.21.15.73:0/837893157 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec15bcf0 con 0x7f75ec158650 2023-12-19T16:16:04.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f14ed640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158650 0x7f75ec070790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009870 tx=0x7f75dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359ec040bc459017 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f0cec640 1 -- 172.21.15.73:0/837893157 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0ab620 con 0x7f75ec158650 2023-12-19T16:16:04.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f0cec640 1 -- 172.21.15.73:0/837893157 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75dc0ab780 con 0x7f75ec158650 2023-12-19T16:16:04.911 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f0cec640 1 -- 172.21.15.73:0/837893157 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc0abb10 con 0x7f75ec158650 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- 172.21.15.73:0/837893157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158650 msgr2=0x7f75ec070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158650 0x7f75ec070790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009870 tx=0x7f75dc01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- 172.21.15.73:0/837893157 shutdown_connections 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158650 0x7f75ec070790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- 172.21.15.73:0/837893157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158270 0x7f75ec15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- 172.21.15.73:0/837893157 >> 172.21.15.73:0/837893157 conn(0x7f75ec06a570 msgr2=0x7f75ec0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- 172.21.15.73:0/837893157 shutdown_connections 2023-12-19T16:16:04.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- 172.21.15.73:0/837893157 wait complete. 2023-12-19T16:16:04.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 Processor -- start 2023-12-19T16:16:04.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- start start 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158650 0x7f75ec164a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 0x7f75ec164fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec1f71a0 con 0x7f75ec158270 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec1f6570 con 0x7f75ec15e4d0 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.909+0000 7f75f3f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec1f6870 con 0x7f75ec158650 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60572/0 (socket says 172.21.15.73:60572) 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 -- 172.21.15.73:0/749016360 learned_addr learned my addr 172.21.15.73:0/749016360 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f14ed640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158650 0x7f75ec164a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f24ef640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 0x7f75ec164fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 -- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158650 msgr2=0x7f75ec164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158650 0x7f75ec164a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 -- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 msgr2=0x7f75ec164fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 0x7f75ec164fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 -- 172.21.15.73:0/749016360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0094d0 con 0x7f75ec158270 2023-12-19T16:16:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f24ef640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 0x7f75ec164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f1cee640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75e800d620 tx=0x7f75e800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800b620 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e800b780 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800bb10 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec1f6b50 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec154fc0 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec04e070 con 0x7f75ec158270 2023-12-19T16:16:04.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f75e800bc70 con 0x7f75ec158270 2023-12-19T16:16:04.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.913+0000 7f75e27fc640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 0x7f75d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:04.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.917+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75e8083580 con 0x7f75ec158270 2023-12-19T16:16:04.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.917+0000 7f75f14ed640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 0x7f75d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:04.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.917+0000 7f75f14ed640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 0x7f75d0067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0af000 tx=0x7f75dc0b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:04.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:04.917+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f75e8050fd0 con 0x7f75ec158270 2023-12-19T16:16:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.065+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75ec0cf200 con 0x7f75ec158270 2023-12-19T16:16:05.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75e27fc640 1 -- 172.21.15.73:0/749016360 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75e8007380 con 0x7f75ec158270 2023-12-19T16:16:05.071 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 msgr2=0x7f75d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 0x7f75d0067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0af000 tx=0x7f75dc0b6040 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 msgr2=0x7f75ec154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75e800d620 tx=0x7f75e800dae0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 shutdown_connections 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75ec15e4d0 0x7f75ec164fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75ec158650 0x7f75ec164a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f75d0065a60 0x7f75d0067f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 --2- 172.21.15.73:0/749016360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75ec158270 0x7f75ec154a80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 >> 172.21.15.73:0/749016360 conn(0x7f75ec06a570 msgr2=0x7f75ec157560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 shutdown_connections 2023-12-19T16:16:05.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.069+0000 7f75f3f52640 1 -- 172.21.15.73:0/749016360 wait complete. 2023-12-19T16:16:05.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:05.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.229+0000 7f44f8e66640 1 Processor -- start 2023-12-19T16:16:05.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.229+0000 7f44f8e66640 1 -- start start 2023-12-19T16:16:05.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f8e66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f406d410 0x7f44f40b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f8e66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f44f40b0660 0x7f44f40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f8e66640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f40cce80 con 0x7f44f41598c0 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f8e66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f40b0ae0 con 0x7f44f40b0660 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f8e66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40cc270 con 0x7f44f406d410 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f44f41598c0 0x7f44f406c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44652/0 (socket says 172.21.15.73:44652) 2023-12-19T16:16:05.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f259c640 1 -- 172.21.15.73:0/2342373215 learned_addr learned my addr 172.21.15.73:0/2342373215 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f2d9d640 1 --2- 172.21.15.73:0/2342373215 >> v2:172.21.15.162:3300/0 conn(0x7f44f40b0660 0x7f44f40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44e9d9b640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f406d410 0x7f44f40b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320331585 0 0) 0x7f44f40cce80 con 0x7f44f41598c0 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44e0003530 con 0x7f44f41598c0 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247576850 0 0) 0x7f44e0003530 con 0x7f44f41598c0 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f2d9d640 1 -- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f406d410 msgr2=0x7f44f40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f2d9d640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f406d410 0x7f44f40b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f2d9d640 1 -- 172.21.15.73:0/2342373215 >> v1:172.21.15.73:6789/0 conn(0x7f44f41598c0 legacy=0x7f44f406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.233+0000 7f44f2d9d640 1 -- 172.21.15.73:0/2342373215 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40cc550 con 0x7f44f40b0660 2023-12-19T16:16:05.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f2d9d640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f40b0660 0x7f44f40cd310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00ba60 tx=0x7f44ec01ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c43225625fba627 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4001a00 con 0x7f44f40b0660 2023-12-19T16:16:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec0a7850 con 0x7f44f40b0660 2023-12-19T16:16:05.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f1d9b640 1 -- 172.21.15.73:0/2342373215 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0a7bc0 con 0x7f44f40b0660 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 -- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f40b0660 msgr2=0x7f44f40cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f40b0660 0x7f44f40cd310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00ba60 tx=0x7f44ec01ea40 comp rx=0 tx=0).stop 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 -- 172.21.15.73:0/2342373215 shutdown_connections 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f40b0660 0x7f44f40cd310 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 --2- 172.21.15.73:0/2342373215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f406d410 0x7f44f40b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 -- 172.21.15.73:0/2342373215 >> 172.21.15.73:0/2342373215 conn(0x7f44f406a570 msgr2=0x7f44f40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 -- 172.21.15.73:0/2342373215 shutdown_connections 2023-12-19T16:16:05.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.237+0000 7f44f8e66640 1 -- 172.21.15.73:0/2342373215 wait complete. 2023-12-19T16:16:05.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 Processor -- start 2023-12-19T16:16:05.243 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- start start 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 0x7f44f4147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f41598c0 0x7f44f40c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c7e20 con 0x7f44f40b0660 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40c5660 con 0x7f44f406d410 2023-12-19T16:16:05.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4147f80 con 0x7f44f41598c0 2023-12-19T16:16:05.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60576/0 (socket says 172.21.15.73:60576) 2023-12-19T16:16:05.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 -- 172.21.15.73:0/617313305 learned_addr learned my addr 172.21.15.73:0/617313305 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 -- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f41598c0 msgr2=0x7f44f40c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f41598c0 0x7f44f40c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f259c640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 0x7f44f4147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 -- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 msgr2=0x7f44f4147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 0x7f44f4147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 -- 172.21.15.73:0/617313305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec00b6c0 con 0x7f44f40b0660 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f259c640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 0x7f44f4147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44e9d9b640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e900 tx=0x7f44dc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc009690 con 0x7f44f40b0660 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00ca00 con 0x7f44f40b0660 2023-12-19T16:16:05.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00cd90 con 0x7f44f40b0660 2023-12-19T16:16:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f40c7860 con 0x7f44f40b0660 2023-12-19T16:16:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f40c58b0 con 0x7f44f40b0660 2023-12-19T16:16:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.241+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f404e070 con 0x7f44f40b0660 2023-12-19T16:16:05.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.245+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f44dc013470 con 0x7f44f40b0660 2023-12-19T16:16:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.245+0000 7f44eb7fe640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 0x7f44d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.245+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44dc0833d0 con 0x7f44f40b0660 2023-12-19T16:16:05.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.245+0000 7f44f259c640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 0x7f44d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.249 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.245+0000 7f44f259c640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 0x7f44d4067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d260 tx=0x7f44e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.249+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f44dc050d80 con 0x7f44f40b0660 2023-12-19T16:16:05.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.397+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44f4070f80 con 0x7f44f40b0660 2023-12-19T16:16:05.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44eb7fe640 1 -- 172.21.15.73:0/617313305 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44dc0543a0 con 0x7f44f40b0660 2023-12-19T16:16:05.403 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:05.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 msgr2=0x7f44d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 0x7f44d4067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44e400d260 tx=0x7f44e4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:05.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 msgr2=0x7f44f40c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e900 tx=0x7f44dc00edc0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 shutdown_connections 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44f41598c0 0x7f44f40c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f44d4065a60 0x7f44d4067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44f40b0660 0x7f44f40c6f80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 --2- 172.21.15.73:0/617313305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44f406d410 0x7f44f4147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 >> 172.21.15.73:0/617313305 conn(0x7f44f406a570 msgr2=0x7f44f40af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 shutdown_connections 2023-12-19T16:16:05.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.401+0000 7f44f8e66640 1 -- 172.21.15.73:0/617313305 wait complete. 2023-12-19T16:16:05.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 Processor -- start 2023-12-19T16:16:05.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 -- start start 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f30a015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30a015d900 0x7f30a006c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a015cee0 con 0x7f30a015cb00 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00c8be0 con 0x7f30a015d900 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a8525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0161620 con 0x7f30a00b0830 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a62c1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f30a015cb00 0x7f30a00b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44656/0 (socket says 172.21.15.73:44656) 2023-12-19T16:16:05.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.561+0000 7f30a62c1640 1 -- 172.21.15.73:0/365197486 learned_addr learned my addr 172.21.15.73:0/365197486 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a5ac0640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f30a015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/365197486 >> v2:172.21.15.162:3300/0 conn(0x7f30a015d900 0x7f30a006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934837307 0 0) 0x7f30a015cee0 con 0x7f30a015cb00 2023-12-19T16:16:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308c003530 con 0x7f30a015cb00 2023-12-19T16:16:05.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199926016 0 0) 0x7f308c003530 con 0x7f30a015cb00 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 msgr2=0x7f30a015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f30a015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 >> v2:172.21.15.162:3300/0 conn(0x7f30a015d900 msgr2=0x7f30a006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 --2- 172.21.15.73:0/365197486 >> v2:172.21.15.162:3300/0 conn(0x7f30a015d900 0x7f30a006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0160860 con 0x7f30a015cb00 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f309c001680 con 0x7f30a015cb00 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 >> v1:172.21.15.73:6789/0 conn(0x7f30a015cb00 legacy=0x7f30a00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308c003980 0x7f308c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f308c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f308c004d10 0x7f308c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c8be0 con 0x7f308c004d10 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0161620 con 0x7f308c003980 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c00b990 con 0x7f30a00b0830 2023-12-19T16:16:05.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f308c004d10 0x7f308c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a62c1640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308c003980 0x7f308c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a5ac0640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f308c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 -- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 msgr2=0x7f308c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30a00b0830 0x7f308c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 -- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308c003980 msgr2=0x7f308c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f308c003980 0x7f308c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.565+0000 7f30a6ac2640 1 -- 172.21.15.73:0/365197486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c003530 con 0x7f308c004d10 2023-12-19T16:16:05.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f308c004d10 0x7f308c005190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fc0 tx=0x7f309801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc69ad9b2a81940 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980a5cb0 con 0x7f308c004d10 2023-12-19T16:16:05.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800f040 con 0x7f308c004d10 2023-12-19T16:16:05.571 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a52bf640 1 -- 172.21.15.73:0/365197486 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980ad680 con 0x7f308c004d10 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- 172.21.15.73:0/365197486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f308c004d10 msgr2=0x7f308c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 --2- 172.21.15.73:0/365197486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f308c004d10 0x7f308c005190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fc0 tx=0x7f309801cca0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a6ac2640 1 -- 172.21.15.73:0/365197486 reap_dead start 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- 172.21.15.73:0/365197486 shutdown_connections 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- 172.21.15.73:0/365197486 >> 172.21.15.73:0/365197486 conn(0x7f30a006a570 msgr2=0x7f30a00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- 172.21.15.73:0/365197486 shutdown_connections 2023-12-19T16:16:05.572 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- 172.21.15.73:0/365197486 wait complete. 2023-12-19T16:16:05.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 Processor -- start 2023-12-19T16:16:05.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.569+0000 7f30a8525640 1 -- start start 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308c004d10 0x7f30a00c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 0x7f30a00b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01f35a0 con 0x7f30a00b18f0 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c5ba0 con 0x7f30a00b2570 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01f2990 con 0x7f308c004d10 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60598/0 (socket says 172.21.15.73:60598) 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 -- 172.21.15.73:0/587118256 learned_addr learned my addr 172.21.15.73:0/587118256 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a62c1640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308c004d10 0x7f30a00c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a5ac0640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 0x7f30a00b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 -- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308c004d10 msgr2=0x7f30a00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308c004d10 0x7f30a00c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 -- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 msgr2=0x7f30a00b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 0x7f30a00b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 -- 172.21.15.73:0/587118256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a01f2c70 con 0x7f30a00b18f0 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a5ac0640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 0x7f30a00b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a6ac2640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30980b0040 tx=0x7f3098009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980039a0 con 0x7f30a00b18f0 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3098003b20 con 0x7f30a00b18f0 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a01f2f50 con 0x7f30a00b18f0 2023-12-19T16:16:05.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30980ae890 con 0x7f30a00b18f0 2023-12-19T16:16:05.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00b29f0 con 0x7f30a00b18f0 2023-12-19T16:16:05.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a004e070 con 0x7f30a00b18f0 2023-12-19T16:16:05.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.573+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f30980b4040 con 0x7f30a00b18f0 2023-12-19T16:16:05.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.577+0000 7f3096ffd640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 0x7f3084067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.577+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f309811cf80 con 0x7f30a00b18f0 2023-12-19T16:16:05.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.577+0000 7f30a62c1640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 0x7f3084067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.577+0000 7f30a62c1640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 0x7f3084067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c10 tx=0x7f309c007900 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.581+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f30980ea940 con 0x7f30a00b18f0 2023-12-19T16:16:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.729+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30a015c100 con 0x7f30a00b18f0 2023-12-19T16:16:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.729+0000 7f3096ffd640 1 -- 172.21.15.73:0/587118256 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30980b2020 con 0x7f30a00b18f0 2023-12-19T16:16:05.734 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 msgr2=0x7f3084067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 0x7f3084067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f309c000c10 tx=0x7f309c007900 comp rx=0 tx=0).stop 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 msgr2=0x7f30a00ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30980b0040 tx=0x7f3098009750 comp rx=0 tx=0).stop 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 shutdown_connections 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3084065a60 0x7f3084067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30a00b18f0 0x7f30a00ac930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30a00b2570 0x7f30a00b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 --2- 172.21.15.73:0/587118256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308c004d10 0x7f30a00c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 >> 172.21.15.73:0/587118256 conn(0x7f30a006a570 msgr2=0x7f30a006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 shutdown_connections 2023-12-19T16:16:05.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.733+0000 7f30a8525640 1 -- 172.21.15.73:0/587118256 wait complete. 2023-12-19T16:16:05.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:05.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.889+0000 7f9e05ee5640 1 Processor -- start 2023-12-19T16:16:05.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.889+0000 7f9e05ee5640 1 -- start start 2023-12-19T16:16:05.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e00159830 0x7f9e0015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e000b40b0 0x7f9e000cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e000cda70 0x7f9e000cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0015e110 con 0x7f9e000b40b0 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000cdf00 con 0x7f9e000cda70 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9e05ee5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015ad00 con 0x7f9e00159830 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e000b40b0 0x7f9e000cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e000b40b0 0x7f9e000cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60614/0 (socket says 172.21.15.73:60614) 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1613977467 learned_addr learned my addr 172.21.15.73:0/1613977467 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfffff640 1 --2- 172.21.15.73:0/1613977467 >> v2:172.21.15.162:3300/0 conn(0x7f9e000cda70 0x7f9e000cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dff7fe640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e00159830 0x7f9e0015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1613977467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e00159830 msgr2=0x7f9e0015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e00159830 0x7f9e0015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1613977467 >> v2:172.21.15.162:3300/0 conn(0x7f9e000cda70 msgr2=0x7f9e000cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1613977467 >> v2:172.21.15.162:3300/0 conn(0x7f9e000cda70 0x7f9e000cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.896 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1613977467 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000ce2d0 con 0x7f9e000b40b0 2023-12-19T16:16:05.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.893+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000b40b0 0x7f9e000cd530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e000c57c0 tx=0x7f9df401c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865fe073e79492e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9dfe7fc640 1 -- 172.21.15.73:0/1613977467 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ab600 con 0x7f9e000b40b0 2023-12-19T16:16:05.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9dfe7fc640 1 -- 172.21.15.73:0/1613977467 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40a7050 con 0x7f9e000b40b0 2023-12-19T16:16:05.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9dfe7fc640 1 -- 172.21.15.73:0/1613977467 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ab980 con 0x7f9e000b40b0 2023-12-19T16:16:05.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1613977467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000b40b0 msgr2=0x7f9e000cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000b40b0 0x7f9e000cd530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9e000c57c0 tx=0x7f9df401c180 comp rx=0 tx=0).stop 2023-12-19T16:16:05.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1613977467 shutdown_connections 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1613977467 >> v2:172.21.15.162:3300/0 conn(0x7f9e000cda70 0x7f9e000cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000b40b0 0x7f9e000cd530 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1613977467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e00159830 0x7f9e0015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1613977467 >> 172.21.15.73:0/1613977467 conn(0x7f9e000b0270 msgr2=0x7f9e000b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1613977467 shutdown_connections 2023-12-19T16:16:05.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1613977467 wait complete. 2023-12-19T16:16:05.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 Processor -- start 2023-12-19T16:16:05.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- start start 2023-12-19T16:16:05.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e000b40b0 0x7f9e00157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e00159830 0x7f9e001f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001584c0 con 0x7f9e000cda70 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000af030 con 0x7f9e00159830 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9e05ee5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001f9030 con 0x7f9e000b40b0 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.897+0000 7f9dfeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60628/0 (socket says 172.21.15.73:60628) 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1309341950 learned_addr learned my addr 172.21.15.73:0/1309341950 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dff7fe640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e000b40b0 0x7f9e00157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfffff640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e00159830 0x7f9e001f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e000b40b0 msgr2=0x7f9e00157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e000b40b0 0x7f9e00157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e00159830 msgr2=0x7f9e001f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e00159830 0x7f9e001f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 -- 172.21.15.73:0/1309341950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40094d0 con 0x7f9e000cda70 2023-12-19T16:16:05.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dfeffd640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c10 tx=0x7f9df4018f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b4840 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40b49a0 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b4d30 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000b0040 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000afd60 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e001f91a0 con 0x7f9e000cda70 2023-12-19T16:16:05.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9df40b2040 con 0x7f9e000cda70 2023-12-19T16:16:05.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 0x7f9dec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:05.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9df411d1f0 con 0x7f9e000cda70 2023-12-19T16:16:05.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.901+0000 7f9dff7fe640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 0x7f9dec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:05.907 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.905+0000 7f9dff7fe640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 0x7f9dec067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b08e0 tx=0x7f9df0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:05.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:05.905+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9df40eabc0 con 0x7f9e000cda70 2023-12-19T16:16:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.057+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e000c1fd0 con 0x7f9e000cda70 2023-12-19T16:16:06.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.057+0000 7f9de7fff640 1 -- 172.21.15.73:0/1309341950 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9df40ee1e0 con 0x7f9e000cda70 2023-12-19T16:16:06.063 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:06.063 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 msgr2=0x7f9dec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 0x7f9dec067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b08e0 tx=0x7f9df0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 msgr2=0x7f9e000aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c10 tx=0x7f9df4018f20 comp rx=0 tx=0).stop 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 shutdown_connections 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e00159830 0x7f9e001f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9dec065a90 0x7f9dec067f50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e000cda70 0x7f9e000aeaf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 --2- 172.21.15.73:0/1309341950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e000b40b0 0x7f9e00157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 >> 172.21.15.73:0/1309341950 conn(0x7f9e000b0270 msgr2=0x7f9e000b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 shutdown_connections 2023-12-19T16:16:06.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.061+0000 7f9e05ee5640 1 -- 172.21.15.73:0/1309341950 wait complete. 2023-12-19T16:16:06.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:06.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 Processor -- start 2023-12-19T16:16:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 -- start start 2023-12-19T16:16:06.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f280815e4d0 0x7f280806bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280806ffb0 con 0x7f2808158650 2023-12-19T16:16:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280815b730 con 0x7f2808158270 2023-12-19T16:16:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280e360640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280815ba10 con 0x7f280815e4d0 2023-12-19T16:16:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f28077fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2808158650 0x7f2808070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44664/0 (socket says 172.21.15.73:44664) 2023-12-19T16:16:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f28077fe640 1 -- 172.21.15.73:0/4089242248 learned_addr learned my addr 172.21.15.73:0/4089242248 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280c8fd640 1 --2- 172.21.15.73:0/4089242248 >> v2:172.21.15.162:3300/0 conn(0x7f280815e4d0 0x7f280806bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353881932 0 0) 0x7f280806ffb0 con 0x7f2808158650 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f0003530 con 0x7f2808158650 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1576458253 0 0) 0x7f27f0003530 con 0x7f2808158650 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 >> v2:172.21.15.162:3300/0 conn(0x7f280815e4d0 msgr2=0x7f280806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 --2- 172.21.15.73:0/4089242248 >> v2:172.21.15.162:3300/0 conn(0x7f280815e4d0 0x7f280806bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 >> v1:172.21.15.162:6789/0 conn(0x7f2808158270 legacy=0x7f280815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280815bcf0 con 0x7f2808158650 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f27fc001680 con 0x7f2808158650 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 >> v1:172.21.15.73:6789/0 conn(0x7f2808158650 legacy=0x7f2808070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 0x7f27f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f00047d0 0x7f27f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f00051e0 0x7f27f000fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280815ba10 con 0x7f27f0003980 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0010520 con 0x7f27f00047d0 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00106e0 con 0x7f27f00051e0 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 0x7f27f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f28077fe640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f00047d0 0x7f27f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280c8fd640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f00051e0 0x7f27f000fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 -- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f00051e0 msgr2=0x7f27f000fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f00051e0 0x7f27f000fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 -- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f00047d0 msgr2=0x7f27f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f00047d0 0x7f27f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f2807fff640 1 -- 172.21.15.73:0/4089242248 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0003530 con 0x7f27f0003980 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f280c8fd640 1 -- 172.21.15.73:0/4089242248 reap_dead start 2023-12-19T16:16:06.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.221+0000 7f28077fe640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f00047d0 0x7f27f0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f2807fff640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 0x7f27f0003dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27f8001780 tx=0x7f27f801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fd06321352bf1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80052d0 con 0x7f27f0003980 2023-12-19T16:16:06.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f80a7050 con 0x7f27f0003980 2023-12-19T16:16:06.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f2806ffd640 1 -- 172.21.15.73:0/4089242248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8003600 con 0x7f27f0003980 2023-12-19T16:16:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 -- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 msgr2=0x7f27f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 0x7f27f0003dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f27f8001780 tx=0x7f27f801c3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 -- 172.21.15.73:0/4089242248 shutdown_connections 2023-12-19T16:16:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 --2- 172.21.15.73:0/4089242248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27f0003980 0x7f27f0003dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 -- 172.21.15.73:0/4089242248 >> 172.21.15.73:0/4089242248 conn(0x7f280806a570 msgr2=0x7f28080ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 -- 172.21.15.73:0/4089242248 shutdown_connections 2023-12-19T16:16:06.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.225+0000 7f280e360640 1 -- 172.21.15.73:0/4089242248 wait complete. 2023-12-19T16:16:06.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 Processor -- start 2023-12-19T16:16:06.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- start start 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f0003980 0x7f28080c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2808153ee0 0x7f28081f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b2110 con 0x7f28080c4990 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808154790 con 0x7f27f0003980 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2808154a70 con 0x7f2808153ee0 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60636/0 (socket says 172.21.15.73:60636) 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 -- 172.21.15.73:0/3242853698 learned_addr learned my addr 172.21.15.73:0/3242853698 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f2807fff640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f0003980 0x7f28080c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280c8fd640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2808153ee0 0x7f28081f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 -- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2808153ee0 msgr2=0x7f28081f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2808153ee0 0x7f28081f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 -- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f0003980 msgr2=0x7f28080c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f0003980 0x7f28080c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 -- 172.21.15.73:0/3242853698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280815b500 con 0x7f28080c4990 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f28077fe640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27fc001bc0 tx=0x7f27fc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00ee00 con 0x7f28080c4990 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00c8d0 con 0x7f28080c4990 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2808154d50 con 0x7f28080c4990 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00cc40 con 0x7f28080c4990 2023-12-19T16:16:06.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.229+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080c4df0 con 0x7f28080c4990 2023-12-19T16:16:06.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280804e070 con 0x7f28080c4990 2023-12-19T16:16:06.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27fc01d460 con 0x7f28080c4990 2023-12-19T16:16:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f2804ff9640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 0x7f27f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27fc082ec0 con 0x7f28080c4990 2023-12-19T16:16:06.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f2807fff640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 0x7f27f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.233+0000 7f2807fff640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 0x7f27f4067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27f8001750 tx=0x7f27f80011a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.237+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f27fc050930 con 0x7f28080c4990 2023-12-19T16:16:06.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.389+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28080cf200 con 0x7f28080c4990 2023-12-19T16:16:06.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.389+0000 7f2804ff9640 1 -- 172.21.15.73:0/3242853698 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27fc053f50 con 0x7f28080c4990 2023-12-19T16:16:06.393 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 msgr2=0x7f27f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 0x7f27f4067f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f27f8001750 tx=0x7f27f80011a0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 msgr2=0x7f28081539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f27fc001bc0 tx=0x7f27fc00ec10 comp rx=0 tx=0).stop 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 shutdown_connections 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2808153ee0 0x7f28081f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f27f4065a90 0x7f27f4067f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28080c4990 0x7f28081539a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 --2- 172.21.15.73:0/3242853698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f0003980 0x7f28080c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 >> 172.21.15.73:0/3242853698 conn(0x7f280806a570 msgr2=0x7f28080ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 shutdown_connections 2023-12-19T16:16:06.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.393+0000 7f280e360640 1 -- 172.21.15.73:0/3242853698 wait complete. 2023-12-19T16:16:06.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:06.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 Processor -- start 2023-12-19T16:16:06.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 -- start start 2023-12-19T16:16:06.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f40300b1d60 0x7f4030069d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403006a690 con 0x7f403015cbc0 2023-12-19T16:16:06.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403006fb20 con 0x7f40300b1d60 2023-12-19T16:16:06.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.553+0000 7f40386e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403006f840 con 0x7f403006a260 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f40300b1d60 0x7f4030069d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4036c82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4036481640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f403015cbc0 0x7f403006ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:47372/0 (socket says 172.21.15.73:47372) 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4036481640 1 -- 172.21.15.73:0/3987171374 learned_addr learned my addr 172.21.15.73:0/3987171374 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 -- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 msgr2=0x7f4030160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 --2- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 -- 172.21.15.73:0/3987171374 >> v1:172.21.15.162:6789/0 conn(0x7f403015cbc0 legacy=0x7f403006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 -- 172.21.15.73:0/3987171374 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300b1280 con 0x7f40300b1d60 2023-12-19T16:16:06.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f4035c80640 1 --2- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f4030069d20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40200097c0 tx=0x7f402001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39176a55fc2f7cb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f403547f640 1 -- 172.21.15.73:0/3987171374 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200ab650 con 0x7f40300b1d60 2023-12-19T16:16:06.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f403547f640 1 -- 172.21.15.73:0/3987171374 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200ab7b0 con 0x7f40300b1d60 2023-12-19T16:16:06.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.557+0000 7f403547f640 1 -- 172.21.15.73:0/3987171374 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200abb40 con 0x7f40300b1d60 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 msgr2=0x7f4030069d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f4030069d20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f40200097c0 tx=0x7f402001c450 comp rx=0 tx=0).stop 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- 172.21.15.73:0/3987171374 shutdown_connections 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- 172.21.15.73:0/3987171374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f4030069d20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- 172.21.15.73:0/3987171374 >> 172.21.15.73:0/3987171374 conn(0x7f40300cc1e0 msgr2=0x7f40300cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- 172.21.15.73:0/3987171374 shutdown_connections 2023-12-19T16:16:06.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- 172.21.15.73:0/3987171374 wait complete. 2023-12-19T16:16:06.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 Processor -- start 2023-12-19T16:16:06.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- start start 2023-12-19T16:16:06.566 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f40300ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40301538e0 con 0x7f403015cbc0 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030153d60 con 0x7f40300b1d60 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f40386e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4030152840 con 0x7f403006a260 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60644/0 (socket says 172.21.15.73:60644) 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 -- 172.21.15.73:0/781691569 learned_addr learned my addr 172.21.15.73:0/781691569 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036481640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4035c80640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f40300ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 -- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 msgr2=0x7f4030151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 -- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 msgr2=0x7f40300ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f40300ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 -- 172.21.15.73:0/781691569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020009420 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036481640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.561+0000 7f4036c82640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f402800efc0 tx=0x7f402800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028009ba0 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402800f040 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280146c0 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030152b20 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40301530e0 con 0x7f403015cbc0 2023-12-19T16:16:06.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403004e070 con 0x7f403015cbc0 2023-12-19T16:16:06.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4028014820 con 0x7f403015cbc0 2023-12-19T16:16:06.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 0x7f4014067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4028083c00 con 0x7f403015cbc0 2023-12-19T16:16:06.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.565+0000 7f4036481640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 0x7f4014067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.569+0000 7f4036481640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 0x7f4014067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f402c000f70 tx=0x7f402c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.569+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f402808a080 con 0x7f403015cbc0 2023-12-19T16:16:06.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4030073780 con 0x7f403015cbc0 2023-12-19T16:16:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f4026ffd640 1 -- 172.21.15.73:0/781691569 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4028051650 con 0x7f403015cbc0 2023-12-19T16:16:06.724 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 msgr2=0x7f4014067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 0x7f4014067f20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f402c000f70 tx=0x7f402c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 msgr2=0x7f4030157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f402800efc0 tx=0x7f402800c490 comp rx=0 tx=0).stop 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 shutdown_connections 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4014065a60 0x7f4014067f20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f403015cbc0 0x7f4030157230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40300b1d60 0x7f40300ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 --2- 172.21.15.73:0/781691569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f403006a260 0x7f4030151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 >> 172.21.15.73:0/781691569 conn(0x7f40300cc1e0 msgr2=0x7f40300cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 shutdown_connections 2023-12-19T16:16:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.721+0000 7f40386e5640 1 -- 172.21.15.73:0/781691569 wait complete. 2023-12-19T16:16:06.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.881+0000 7f6d36295640 1 Processor -- start 2023-12-19T16:16:06.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.881+0000 7f6d36295640 1 -- start start 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d36295640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d30158650 0x7f6d30070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d36295640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d3006bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d36295640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3006ffb0 con 0x7f6d30158270 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d36295640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3015b730 con 0x7f6d30158650 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d36295640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015ba10 con 0x7f6d3015e4d0 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6d30158270 0x7f6d3015aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44680/0 (socket says 172.21.15.73:44680) 2023-12-19T16:16:06.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 -- 172.21.15.73:0/568536773 learned_addr learned my addr 172.21.15.73:0/568536773 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:06.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d34832640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d3006bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2f7fe640 1 --2- 172.21.15.73:0/568536773 >> v2:172.21.15.162:3300/0 conn(0x7f6d30158650 0x7f6d30070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.889 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864565309 0 0) 0x7f6d3006ffb0 con 0x7f6d30158270 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d18003530 con 0x7f6d30158270 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1142641726 0 0) 0x7f6d18003530 con 0x7f6d30158270 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 msgr2=0x7f6d3006bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d3006bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 >> v2:172.21.15.162:3300/0 conn(0x7f6d30158650 msgr2=0x7f6d30070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 --2- 172.21.15.73:0/568536773 >> v2:172.21.15.162:3300/0 conn(0x7f6d30158650 0x7f6d30070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3015bcf0 con 0x7f6d30158270 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f6d20001680 con 0x7f6d30158270 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 >> v1:172.21.15.73:6789/0 conn(0x7f6d30158270 legacy=0x7f6d3015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d18003980 0x7f6d18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18004d10 0x7f6d18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015b730 con 0x7f6d18003980 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015ba10 con 0x7f6d18004d10 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1800b990 con 0x7f6d3015e4d0 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d18003980 0x7f6d18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d34832640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18004d10 0x7f6d18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2f7fe640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 -- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 msgr2=0x7f6d180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d3015e4d0 0x7f6d180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 -- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18004d10 msgr2=0x7f6d18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18004d10 0x7f6d18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.885+0000 7f6d2ffff640 1 -- 172.21.15.73:0/568536773 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d18003530 con 0x7f6d18003980 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d18003980 0x7f6d18003da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c240 tx=0x7f6d2001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4c6a9b3ea730c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20005ae0 con 0x7f6d18003980 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20005c40 con 0x7f6d18003980 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d2effd640 1 -- 172.21.15.73:0/568536773 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200a5800 con 0x7f6d18003980 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 -- 172.21.15.73:0/568536773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d18003980 msgr2=0x7f6d18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 --2- 172.21.15.73:0/568536773 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d18003980 0x7f6d18003da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c240 tx=0x7f6d2001cc10 comp rx=0 tx=0).stop 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d34832640 1 -- 172.21.15.73:0/568536773 reap_dead start 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 -- 172.21.15.73:0/568536773 shutdown_connections 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 -- 172.21.15.73:0/568536773 >> 172.21.15.73:0/568536773 conn(0x7f6d3006a570 msgr2=0x7f6d300ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 -- 172.21.15.73:0/568536773 shutdown_connections 2023-12-19T16:16:06.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 -- 172.21.15.73:0/568536773 wait complete. 2023-12-19T16:16:06.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.889+0000 7f6d36295640 1 Processor -- start 2023-12-19T16:16:06.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- start start 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 0x7f6d301f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d301f5f80 0x7f6d30153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015bf30 con 0x7f6d30155100 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015c140 con 0x7f6d18003980 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015c420 con 0x7f6d301f5f80 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60662/0 (socket says 172.21.15.73:60662) 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 -- 172.21.15.73:0/2834974454 learned_addr learned my addr 172.21.15.73:0/2834974454 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2f7fe640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d301f5f80 0x7f6d30153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 0x7f6d301f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 -- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d301f5f80 msgr2=0x7f6d30153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d301f5f80 0x7f6d30153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 -- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 msgr2=0x7f6d301f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 0x7f6d301f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 -- 172.21.15.73:0/2834974454 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3015c700 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 0x7f6d301f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d34832640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d3006e3b0 tx=0x7f6d2800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800e040 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800f040 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3015c9e0 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28015430 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d30155590 con 0x7f6d30155100 2023-12-19T16:16:06.899 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.893+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d301557b0 con 0x7f6d30155100 2023-12-19T16:16:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.897+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6d28015590 con 0x7f6d30155100 2023-12-19T16:16:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.897+0000 7f6d2cff9640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 0x7f6d1c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.897+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d280838a0 con 0x7f6d30155100 2023-12-19T16:16:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.897+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 0x7f6d1c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:06.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.897+0000 7f6d2ffff640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 0x7f6d1c067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d200ab000 tx=0x7f6d200a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:06.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:06.901+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6d280511c0 con 0x7f6d30155100 2023-12-19T16:16:07.052 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.049+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d3015cbd0 con 0x7f6d30155100 2023-12-19T16:16:07.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.049+0000 7f6d2cff9640 1 -- 172.21.15.73:0/2834974454 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d280547e0 con 0x7f6d30155100 2023-12-19T16:16:07.053 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 msgr2=0x7f6d1c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 0x7f6d1c067f20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6d200ab000 tx=0x7f6d200a7070 comp rx=0 tx=0).stop 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 msgr2=0x7f6d300b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6d3006e3b0 tx=0x7f6d2800f1b0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 shutdown_connections 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d1c065a60 0x7f6d1c067f20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d30155100 0x7f6d300b1920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d301f5f80 0x7f6d30153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 --2- 172.21.15.73:0/2834974454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d18003980 0x7f6d301f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 >> 172.21.15.73:0/2834974454 conn(0x7f6d3006a570 msgr2=0x7f6d300c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 shutdown_connections 2023-12-19T16:16:07.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.053+0000 7f6d36295640 1 -- 172.21.15.73:0/2834974454 wait complete. 2023-12-19T16:16:07.080 INFO:tasks.cephfs_test_runner:Starting test: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) The maximum number of openfiles omap objects keys are now equal to 2023-12-19T16:16:07.080 INFO:tasks.cephfs_test_runner:test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2023-12-19T16:16:07.081 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2023-12-19T16:16:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.213+0000 7f0510598640 1 Processor -- start 2023-12-19T16:16:07.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.213+0000 7f0510598640 1 -- start start 2023-12-19T16:16:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f0510598640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f050815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f0510598640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 0x7f05080ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f0510598640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050815ad00 con 0x7f05080b40b0 2023-12-19T16:16:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f0510598640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050815e110 con 0x7f05080cdc40 2023-12-19T16:16:07.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f0510598640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080ce2d0 con 0x7f0508159830 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050e334640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f050815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050db33640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f05080b40b0 0x7f05080cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:47374/0 (socket says 172.21.15.73:47374) 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050eb35640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 0x7f05080ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050db33640 1 -- 172.21.15.73:0/2149052475 learned_addr learned my addr 172.21.15.73:0/2149052475 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050e334640 1 -- 172.21.15.73:0/2149052475 >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 msgr2=0x7f05080ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050e334640 1 --2- 172.21.15.73:0/2149052475 >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 0x7f05080ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050e334640 1 -- 172.21.15.73:0/2149052475 >> v1:172.21.15.162:6789/0 conn(0x7f05080b40b0 legacy=0x7f05080cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050e334640 1 -- 172.21.15.73:0/2149052475 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050815d490 con 0x7f0508159830 2023-12-19T16:16:07.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.217+0000 7f050eb35640 1 --2- 172.21.15.73:0/2149052475 >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 0x7f05080ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f050e334640 1 --2- 172.21.15.73:0/2149052475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f050815a7c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05040097c0 tx=0x7f050401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4effba72b255d43a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f050d332640 1 -- 172.21.15.73:0/2149052475 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040ac620 con 0x7f0508159830 2023-12-19T16:16:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f050d332640 1 -- 172.21.15.73:0/2149052475 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040ac780 con 0x7f0508159830 2023-12-19T16:16:07.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f050d332640 1 -- 172.21.15.73:0/2149052475 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040acb10 con 0x7f0508159830 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 -- 172.21.15.73:0/2149052475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 msgr2=0x7f050815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 --2- 172.21.15.73:0/2149052475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f050815a7c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f05040097c0 tx=0x7f050401c3c0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 -- 172.21.15.73:0/2149052475 shutdown_connections 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 --2- 172.21.15.73:0/2149052475 >> v2:172.21.15.162:3300/0 conn(0x7f05080cdc40 0x7f05080ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 --2- 172.21.15.73:0/2149052475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f050815a7c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 -- 172.21.15.73:0/2149052475 >> 172.21.15.73:0/2149052475 conn(0x7f05080b0270 msgr2=0x7f05080b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:07.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 -- 172.21.15.73:0/2149052475 shutdown_connections 2023-12-19T16:16:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.221+0000 7f0510598640 1 -- 172.21.15.73:0/2149052475 wait complete. 2023-12-19T16:16:07.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 Processor -- start 2023-12-19T16:16:07.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- start start 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 0x7f0508151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f05080aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05080aea50 con 0x7f05080b40b0 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0508154760 con 0x7f05080cdc40 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0508153e00 con 0x7f0508159830 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60676/0 (socket says 172.21.15.73:60676) 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 -- 172.21.15.73:0/3933894743 learned_addr learned my addr 172.21.15.73:0/3933894743 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050db33640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 0x7f0508151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050eb35640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f05080aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 -- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 msgr2=0x7f05080aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f05080aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 -- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 msgr2=0x7f0508151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 0x7f0508151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 -- 172.21.15.73:0/3933894743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009a70 con 0x7f05080b40b0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050db33640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 0x7f0508151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f050e334640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0504019ff0 tx=0x7f0504019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040b5400 con 0x7f05080b40b0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040b5580 con 0x7f05080b40b0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040b5930 con 0x7f05080b40b0 2023-12-19T16:16:07.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0504009420 con 0x7f05080b40b0 2023-12-19T16:16:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05081540a0 con 0x7f05080b40b0 2023-12-19T16:16:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.225+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0508074050 con 0x7f05080b40b0 2023-12-19T16:16:07.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.229+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f05040b3040 con 0x7f05080b40b0 2023-12-19T16:16:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.229+0000 7f04feffd640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 0x7f04ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.229+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f050411d2e0 con 0x7f05080b40b0 2023-12-19T16:16:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.229+0000 7f050db33640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 0x7f04ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:07.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.229+0000 7f050db33640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 0x7f04ec067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f05080c1fb0 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:07.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.233+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f05040eac00 con 0x7f05080b40b0 2023-12-19T16:16:07.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:07.437+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7f05080cbfc0 con 0x7f05080b40b0 2023-12-19T16:16:08.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f04feffd640 1 -- 172.21.15.73:0/3933894743 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v51) v1 ==== 150+0+0 (secure 0 0 0) 0x7f05040ee220 con 0x7f05080b40b0 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 msgr2=0x7f04ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 0x7f04ec067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f05080c1fb0 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 msgr2=0x7f0508162790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0504019ff0 tx=0x7f0504019160 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 shutdown_connections 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0508159830 0x7f05080aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05080cdc40 0x7f0508151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f04ec065a60 0x7f04ec067f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 --2- 172.21.15.73:0/3933894743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05080b40b0 0x7f0508162790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 >> 172.21.15.73:0/3933894743 conn(0x7f05080b0270 msgr2=0x7f050806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 shutdown_connections 2023-12-19T16:16:08.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.321+0000 7f0510598640 1 -- 172.21.15.73:0/3933894743 wait complete. 2023-12-19T16:16:08.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T16:16:08.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:08.402 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:08.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.489+0000 7fabf507d640 1 Processor -- start 2023-12-19T16:16:08.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.489+0000 7fabf507d640 1 -- start start 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabf507d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabf00d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabf507d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf006af80 con 0x7fabf00d13f0 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabf507d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf006b540 con 0x7fabf00cdcd0 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabf507d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00d1830 con 0x7fabf015cc40 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabef7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fabf00d13f0 0x7fabf00cd5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44682/0 (socket says 172.21.15.73:44682) 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabef7fe640 1 -- 172.21.15.73:0/1377858650 learned_addr learned my addr 172.21.15.73:0/1377858650 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabf00d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240184054 0 0) 0x7fabf006af80 con 0x7fabf00d13f0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd8003530 con 0x7fabf00d13f0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680689236 0 0) 0x7fabf006b540 con 0x7fabf00cdcd0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf006af80 con 0x7fabf00cdcd0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652061853 0 0) 0x7fabd8003530 con 0x7fabf00d13f0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 msgr2=0x7fabf00d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabf00d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 >> v1:172.21.15.162:6789/0 conn(0x7fabf00cdcd0 legacy=0x7fabf006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00ce330 con 0x7fabf00d13f0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fabe4001680 con 0x7fabf00d13f0 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 >> v1:172.21.15.73:6789/0 conn(0x7fabf00d13f0 legacy=0x7fabf00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd8003b40 0x7fabd8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabd8004d10 0x7fabd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00d1830 con 0x7fabd8003b40 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800ba40 con 0x7fabd8004d10 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd800bbb0 con 0x7fabf015cc40 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd8003b40 0x7fabd8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabef7fe640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabf487c640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabd8004d10 0x7fabd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 -- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 msgr2=0x7fabd80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabf015cc40 0x7fabd80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 -- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabd8004d10 msgr2=0x7fabd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabd8004d10 0x7fabd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.493+0000 7fabeffff640 1 -- 172.21.15.73:0/1377858650 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8003530 con 0x7fabd8003b40 2023-12-19T16:16:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabeffff640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd8003b40 0x7fabd8003f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009ae0 tx=0x7fabe001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116df2ea4d168ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00a6430 con 0x7fabd8003b40 2023-12-19T16:16:08.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe00a6590 con 0x7fabd8003b40 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabeeffd640 1 -- 172.21.15.73:0/1377858650 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe00a6940 con 0x7fabd8003b40 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- 172.21.15.73:0/1377858650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd8003b40 msgr2=0x7fabd8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 --2- 172.21.15.73:0/1377858650 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd8003b40 0x7fabd8003f40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009ae0 tx=0x7fabe001ca50 comp rx=0 tx=0).stop 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf487c640 1 -- 172.21.15.73:0/1377858650 reap_dead start 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- 172.21.15.73:0/1377858650 shutdown_connections 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- 172.21.15.73:0/1377858650 >> 172.21.15.73:0/1377858650 conn(0x7fabf009bbf0 msgr2=0x7fabf00d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- 172.21.15.73:0/1377858650 shutdown_connections 2023-12-19T16:16:08.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- 172.21.15.73:0/1377858650 wait complete. 2023-12-19T16:16:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 Processor -- start 2023-12-19T16:16:08.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.497+0000 7fabf507d640 1 -- start start 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabd8003b40 0x7fabf0151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 0x7fabf00b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf00b82f0 con 0x7fabf00b7930 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0157470 con 0x7fabf0158780 2023-12-19T16:16:08.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01576e0 con 0x7fabd8003b40 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60692/0 (socket says 172.21.15.73:60692) 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 -- 172.21.15.73:0/1968413165 learned_addr learned my addr 172.21.15.73:0/1968413165 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabeffff640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabd8003b40 0x7fabf0151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabef7fe640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 0x7fabf00b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 -- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabd8003b40 msgr2=0x7fabf0151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabd8003b40 0x7fabf0151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 -- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 msgr2=0x7fabf00b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 0x7fabf00b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 -- 172.21.15.73:0/1968413165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf01579c0 con 0x7fabf00b7930 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabef7fe640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 0x7fabf00b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf487c640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066650 tx=0x7fabe800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8003980 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe8003ae0 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf0157ca0 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8003e90 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0158260 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf004e000 con 0x7fabf00b7930 2023-12-19T16:16:08.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.501+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fabe80050d0 con 0x7fabf00b7930 2023-12-19T16:16:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.505+0000 7fabecff9640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 0x7fabdc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.505+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabe8082e00 con 0x7fabf00b7930 2023-12-19T16:16:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.505+0000 7fabeffff640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 0x7fabdc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:08.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.505+0000 7fabeffff640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 0x7fabdc067f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ad000 tx=0x7fabe00b2040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:08.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.509+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fabe8050850 con 0x7fabf00b7930 2023-12-19T16:16:08.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.657+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fabf00b51b0 con 0x7fabf00b7930 2023-12-19T16:16:08.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabecff9640 1 -- 172.21.15.73:0/1968413165 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabe8053e70 con 0x7fabf00b7930 2023-12-19T16:16:08.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 msgr2=0x7fabdc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 0x7fabdc067f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ad000 tx=0x7fabe00b2040 comp rx=0 tx=0).stop 2023-12-19T16:16:08.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 msgr2=0x7fabf00b7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fabf0066650 tx=0x7fabe800eb20 comp rx=0 tx=0).stop 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 shutdown_connections 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fabdc065a90 0x7fabdc067f50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabf00b7930 0x7fabf00b7db0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabf0158780 0x7fabf00b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 --2- 172.21.15.73:0/1968413165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabd8003b40 0x7fabf0151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 >> 172.21.15.73:0/1968413165 conn(0x7fabf009bbf0 msgr2=0x7fabf00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 shutdown_connections 2023-12-19T16:16:08.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:08.665+0000 7fabf507d640 1 -- 172.21.15.73:0/1968413165 wait complete. 2023-12-19T16:16:08.688 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:16:08.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:16:08.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:16:08.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:16:08.842 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:08.842 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:08.851 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:08.851 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:08.903 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:08.903 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:08.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:09.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 Processor -- start 2023-12-19T16:16:09.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 -- start start 2023-12-19T16:16:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 0x7fcac00cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac015ad00 con 0x7fcac00cda70 2023-12-19T16:16:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac015e110 con 0x7fcac00b40b0 2023-12-19T16:16:09.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcac4811640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00cdf00 con 0x7fcac0159830 2023-12-19T16:16:09.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:52302/0 (socket says 172.21.15.73:52302) 2023-12-19T16:16:09.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcab5d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 0x7fcac00cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 -- 172.21.15.73:0/1733497693 learned_addr learned my addr 172.21.15.73:0/1733497693 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:09.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 -- 172.21.15.73:0/1733497693 >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 msgr2=0x7fcac00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 --2- 172.21.15.73:0/1733497693 >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 0x7fcac00cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 -- 172.21.15.73:0/1733497693 >> v1:172.21.15.162:6789/0 conn(0x7fcac00cda70 legacy=0x7fcac00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcabe59c640 1 -- 172.21.15.73:0/1733497693 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00ce2d0 con 0x7fcac0159830 2023-12-19T16:16:09.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.133+0000 7fcab5d9b640 1 --2- 172.21.15.73:0/1733497693 >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 0x7fcac00cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:09.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcabe59c640 1 --2- 172.21.15.73:0/1733497693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009870 tx=0x7fcaa801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d363f30cc0475215 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcabdd9b640 1 -- 172.21.15.73:0/1733497693 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80ab680 con 0x7fcac0159830 2023-12-19T16:16:09.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcabdd9b640 1 -- 172.21.15.73:0/1733497693 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80ab7e0 con 0x7fcac0159830 2023-12-19T16:16:09.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcabdd9b640 1 -- 172.21.15.73:0/1733497693 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80abb70 con 0x7fcac0159830 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 -- 172.21.15.73:0/1733497693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 msgr2=0x7fcac015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 --2- 172.21.15.73:0/1733497693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009870 tx=0x7fcaa801c480 comp rx=0 tx=0).stop 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 -- 172.21.15.73:0/1733497693 shutdown_connections 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 --2- 172.21.15.73:0/1733497693 >> v2:172.21.15.162:3300/0 conn(0x7fcac00b40b0 0x7fcac00cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 --2- 172.21.15.73:0/1733497693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015a7c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.137+0000 7fcac4811640 1 -- 172.21.15.73:0/1733497693 >> 172.21.15.73:0/1733497693 conn(0x7fcac00b0270 msgr2=0x7fcac00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- 172.21.15.73:0/1733497693 shutdown_connections 2023-12-19T16:16:09.143 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- 172.21.15.73:0/1733497693 wait complete. 2023-12-19T16:16:09.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 Processor -- start 2023-12-19T16:16:09.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- start start 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac00cda70 0x7fcac015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ae430 con 0x7fcac00b40b0 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ae710 con 0x7fcac00cda70 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcac4811640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac00ae9f0 con 0x7fcac0159830 2023-12-19T16:16:09.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60696/0 (socket says 172.21.15.73:60696) 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 -- 172.21.15.73:0/1142360909 learned_addr learned my addr 172.21.15.73:0/1142360909 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 -- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 msgr2=0x7fcac015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 -- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac00cda70 msgr2=0x7fcac015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac00cda70 0x7fcac015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.141+0000 7fcabe59c640 1 -- 172.21.15.73:0/1142360909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0009420 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcabe59c640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80ad040 tx=0x7fcaa8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b5810 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa80b59b0 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa80094d0 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80b5d60 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac00aefb0 con 0x7fcac00b40b0 2023-12-19T16:16:09.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac0074050 con 0x7fcac00b40b0 2023-12-19T16:16:09.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcaa80bf410 con 0x7fcac00b40b0 2023-12-19T16:16:09.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 0x7fcaa0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa811dff0 con 0x7fcac00b40b0 2023-12-19T16:16:09.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.145+0000 7fcab5d9b640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 0x7fcaa0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.149+0000 7fcab5d9b640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 0x7fcaa0067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcab0006e90 tx=0x7fcab0006de0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.153 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.149+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcaa80eb890 con 0x7fcac00b40b0 2023-12-19T16:16:09.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.301+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac00cbfc0 con 0x7fcac00b40b0 2023-12-19T16:16:09.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.301+0000 7fcab77fe640 1 -- 172.21.15.73:0/1142360909 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fcaa80eeeb0 con 0x7fcac00b40b0 2023-12-19T16:16:09.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:09.306 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 msgr2=0x7fcaa0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 0x7fcaa0067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcab0006e90 tx=0x7fcab0006de0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 msgr2=0x7fcac00c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80ad040 tx=0x7fcaa8019220 comp rx=0 tx=0).stop 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 shutdown_connections 2023-12-19T16:16:09.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcac0159830 0x7fcac015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac00cda70 0x7fcac015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcaa0065a60 0x7fcaa0067f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 --2- 172.21.15.73:0/1142360909 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac00b40b0 0x7fcac00c3b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 >> 172.21.15.73:0/1142360909 conn(0x7fcac00b0270 msgr2=0x7fcac0163ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 shutdown_connections 2023-12-19T16:16:09.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.305+0000 7fcac4811640 1 -- 172.21.15.73:0/1142360909 wait complete. 2023-12-19T16:16:09.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:09.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:09.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 Processor -- start 2023-12-19T16:16:09.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 -- start start 2023-12-19T16:16:09.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27740b0660 0x7f27740cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27740cce80 con 0x7f27741598c0 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27740b0ae0 con 0x7f27740b0660 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f277a8e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27740cc270 con 0x7f277406d410 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f2778e82640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27740b0660 0x7f27740cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f27737fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f2773fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f27741598c0 0x7f277406c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:47406/0 (socket says 172.21.15.73:47406) 2023-12-19T16:16:09.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f2778e82640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27740b0660 0x7f27740cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:35364/0 (socket says 172.21.15.73:35364) 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.465+0000 7f2773fff640 1 -- 172.21.15.73:0/2068292505 learned_addr learned my addr 172.21.15.73:0/2068292505 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2778e82640 1 -- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 msgr2=0x7f27740b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2778e82640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2778e82640 1 -- 172.21.15.73:0/2068292505 >> v1:172.21.15.162:6789/0 conn(0x7f27741598c0 legacy=0x7f277406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2778e82640 1 -- 172.21.15.73:0/2068292505 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740cc550 con 0x7f27740b0660 2023-12-19T16:16:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f27737fe640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2778e82640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27740b0660 0x7f27740cd310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f276c009d90 tx=0x7f276c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=506ef160059a52b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2772ffd640 1 -- 172.21.15.73:0/2068292505 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0a59e0 con 0x7f27740b0660 2023-12-19T16:16:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2772ffd640 1 -- 172.21.15.73:0/2068292505 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c0a5b40 con 0x7f27740b0660 2023-12-19T16:16:09.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.469+0000 7f2772ffd640 1 -- 172.21.15.73:0/2068292505 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0ad440 con 0x7f27740b0660 2023-12-19T16:16:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27740b0660 msgr2=0x7f27740cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27740b0660 0x7f27740cd310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f276c009d90 tx=0x7f276c01c920 comp rx=0 tx=0).stop 2023-12-19T16:16:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- 172.21.15.73:0/2068292505 shutdown_connections 2023-12-19T16:16:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- 172.21.15.73:0/2068292505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27740b0660 0x7f27740cd310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- 172.21.15.73:0/2068292505 >> 172.21.15.73:0/2068292505 conn(0x7f277406a570 msgr2=0x7f27740ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- 172.21.15.73:0/2068292505 shutdown_connections 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- 172.21.15.73:0/2068292505 wait complete. 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 Processor -- start 2023-12-19T16:16:09.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- start start 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 0x7f277414a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27740ab980 con 0x7f27740b0660 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27740abbf0 con 0x7f27741598c0 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f277a8e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27740abed0 con 0x7f277406d410 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60710/0 (socket says 172.21.15.73:60710) 2023-12-19T16:16:09.478 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 -- 172.21.15.73:0/3131886936 learned_addr learned my addr 172.21.15.73:0/3131886936 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f2778e82640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 0x7f277414a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f2773fff640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 -- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 msgr2=0x7f27740c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 -- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 msgr2=0x7f277414a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 0x7f277414a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f27737fe640 1 -- 172.21.15.73:0/3131886936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768009420 con 0x7f27740b0660 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.473+0000 7f2778e82640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 0x7f277414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f27737fe640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f276800ebb0 tx=0x7f276800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800eeb0 con 0x7f27740b0660 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276800cc30 con 0x7f27740b0660 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768013470 con 0x7f27740b0660 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c009a70 con 0x7f27740b0660 2023-12-19T16:16:09.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27741f5c90 con 0x7f27740b0660 2023-12-19T16:16:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277404e070 con 0x7f27740b0660 2023-12-19T16:16:09.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27680135d0 con 0x7f27740b0660 2023-12-19T16:16:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 0x7f2760067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27680833d0 con 0x7f27740b0660 2023-12-19T16:16:09.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.477+0000 7f2773fff640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 0x7f2760067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.481+0000 7f2773fff640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 0x7f2760067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2764005890 tx=0x7f2764009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.481+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2768050e40 con 0x7f27740b0660 2023-12-19T16:16:09.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27740aeb80 con 0x7f27740b0660 2023-12-19T16:16:09.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f2770ff9640 1 -- 172.21.15.73:0/3131886936 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2768054460 con 0x7f27740b0660 2023-12-19T16:16:09.636 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:09.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 msgr2=0x7f2760067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 0x7f2760067f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2764005890 tx=0x7f2764009040 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 msgr2=0x7f277414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f276800ebb0 tx=0x7f276800c520 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 shutdown_connections 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27741598c0 0x7f277414a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2760065a60 0x7f2760067f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27740b0660 0x7f277414edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 --2- 172.21.15.73:0/3131886936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f277406d410 0x7f27740c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 >> 172.21.15.73:0/3131886936 conn(0x7f277406a570 msgr2=0x7f27740ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 shutdown_connections 2023-12-19T16:16:09.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.633+0000 7f277a8e5640 1 -- 172.21.15.73:0/3131886936 wait complete. 2023-12-19T16:16:09.657 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 Processor -- start 2023-12-19T16:16:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 -- start start 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 0x7f45a815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80cd5f0 0x7f45a8164a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a806b180 con 0x7f45a8069d20 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a806a570 con 0x7f45a80cd5f0 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45acdc0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a806a850 con 0x7f45a8155060 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.793+0000 7f45a6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80cd5f0 0x7f45a8164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45a80cd5f0 0x7f45a8164a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60718/0 (socket says 172.21.15.73:60718) 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 -- 172.21.15.73:0/361323965 learned_addr learned my addr 172.21.15.73:0/361323965 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a659c640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 0x7f45a815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 -- 172.21.15.73:0/361323965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 msgr2=0x7f45a815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 0x7f45a815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 -- 172.21.15.73:0/361323965 >> v1:172.21.15.73:6789/0 conn(0x7f45a8069d20 legacy=0x7f45a80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 -- 172.21.15.73:0/361323965 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a806ab30 con 0x7f45a80cd5f0 2023-12-19T16:16:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a659c640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 0x7f45a815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a559a640 1 -- 172.21.15.73:0/361323965 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743878933 0 0) 0x7f45a806b180 con 0x7f45a8069d20 2023-12-19T16:16:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a6d9d640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80cd5f0 0x7f45a8164a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009e50 tx=0x7f45a001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914514bb57965141 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a559a640 1 -- 172.21.15.73:0/361323965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00a5740 con 0x7f45a80cd5f0 2023-12-19T16:16:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a559a640 1 -- 172.21.15.73:0/361323965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a00a58a0 con 0x7f45a80cd5f0 2023-12-19T16:16:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.797+0000 7f45a559a640 1 -- 172.21.15.73:0/361323965 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00a5c30 con 0x7f45a80cd5f0 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- 172.21.15.73:0/361323965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80cd5f0 msgr2=0x7f45a8164a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80cd5f0 0x7f45a8164a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009e50 tx=0x7f45a001c8c0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- 172.21.15.73:0/361323965 shutdown_connections 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a80cd5f0 0x7f45a8164a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- 172.21.15.73:0/361323965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8155060 0x7f45a815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- 172.21.15.73:0/361323965 >> 172.21.15.73:0/361323965 conn(0x7f45a80b0ad0 msgr2=0x7f45a80b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- 172.21.15.73:0/361323965 shutdown_connections 2023-12-19T16:16:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- 172.21.15.73:0/361323965 wait complete. 2023-12-19T16:16:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 Processor -- start 2023-12-19T16:16:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- start start 2023-12-19T16:16:09.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 0x7f45a80ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 0x7f45a814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80ca040 con 0x7f45a8155060 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80cb450 con 0x7f45a80cd5f0 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45acdc0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80ca250 con 0x7f45a8069d20 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60728/0 (socket says 172.21.15.73:60728) 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a6d9d640 1 -- 172.21.15.73:0/2555857749 learned_addr learned my addr 172.21.15.73:0/2555857749 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a659c640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 0x7f45a80ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a5d9b640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 0x7f45a814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.801+0000 7f45a6d9d640 1 -- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 msgr2=0x7f45a80ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a6d9d640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 0x7f45a80ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a6d9d640 1 -- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 msgr2=0x7f45a814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a6d9d640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 0x7f45a814e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a6d9d640 1 -- 172.21.15.73:0/2555857749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009b30 con 0x7f45a8155060 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a659c640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 0x7f45a80ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a5d9b640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 0x7f45a814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:09.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a6d9d640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f45a00af040 tx=0x7f45a0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00b8670 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a00b87f0 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00b8ba0 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a80ca530 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a80c2e90 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a806a140 con 0x7f45a8155060 2023-12-19T16:16:09.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45a00b8d00 con 0x7f45a8155060 2023-12-19T16:16:09.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 0x7f4588067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:09.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45a011e350 con 0x7f45a8155060 2023-12-19T16:16:09.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.805+0000 7f45a659c640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 0x7f4588067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:09.811 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.809+0000 7f45a659c640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 0x7f4588067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f45a81f8180 tx=0x7f4598008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:09.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.809+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45a806a140 con 0x7f45a8155060 2023-12-19T16:16:09.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.957+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45a806a140 con 0x7f45a8155060 2023-12-19T16:16:09.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f4596ffd640 1 -- 172.21.15.73:0/2555857749 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45a806a140 con 0x7f45a8155060 2023-12-19T16:16:09.963 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 msgr2=0x7f4588067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 0x7f4588067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f45a81f8180 tx=0x7f4598008040 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 msgr2=0x7f45a80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f45a00af040 tx=0x7f45a0019660 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 shutdown_connections 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4588065a60 0x7f4588067f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45a8155060 0x7f45a80caf10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45a80cd5f0 0x7f45a814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 --2- 172.21.15.73:0/2555857749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45a8069d20 0x7f45a80ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 >> 172.21.15.73:0/2555857749 conn(0x7f45a80b0ad0 msgr2=0x7f45a80afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 shutdown_connections 2023-12-19T16:16:09.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:09.961+0000 7f45acdc0640 1 -- 172.21.15.73:0/2555857749 wait complete. 2023-12-19T16:16:09.984 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 Processor -- start 2023-12-19T16:16:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 -- start start 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe3780ca4b0 0x7fe3780cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780c9760 con 0x7fe378159230 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780cc870 con 0x7fe3780cd350 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37f02d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780cd7e0 con 0x7fe3780ca4b0 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe378159230 0x7fe3780cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44708/0 (socket says 172.21.15.73:44708) 2023-12-19T16:16:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 -- 172.21.15.73:0/40740861 learned_addr learned my addr 172.21.15.73:0/40740861 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454777830 0 0) 0x7fe3780c9760 con 0x7fe378159230 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe368003450 con 0x7fe378159230 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe377fff640 1 --2- 172.21.15.73:0/40740861 >> v2:172.21.15.162:3300/0 conn(0x7fe3780ca4b0 0x7fe3780cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073261013 0 0) 0x7fe368003450 con 0x7fe378159230 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 >> v2:172.21.15.162:3300/0 conn(0x7fe3780ca4b0 msgr2=0x7fe3780cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 --2- 172.21.15.73:0/40740861 >> v2:172.21.15.162:3300/0 conn(0x7fe3780ca4b0 0x7fe3780cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 >> v1:172.21.15.162:6789/0 conn(0x7fe3780cd350 legacy=0x7fe37806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780c99d0 con 0x7fe378159230 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fe36c001680 con 0x7fe378159230 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 >> v1:172.21.15.73:6789/0 conn(0x7fe378159230 legacy=0x7fe3780cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 0x7fe368003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3680088b0 0x7fe36800ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe36800b540 0x7fe36800da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780cd7e0 con 0x7fe368003a70 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36800e2e0 con 0x7fe36800b540 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36800e4a0 con 0x7fe3680088b0 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 0x7fe368003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe377fff640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3680088b0 0x7fe36800ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37d5ca640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe36800b540 0x7fe36800da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 -- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3680088b0 msgr2=0x7fe36800ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3680088b0 0x7fe36800ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 -- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe36800b540 msgr2=0x7fe36800da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe36800b540 0x7fe36800da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37cdc9640 1 -- 172.21.15.73:0/40740861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368003450 con 0x7fe368003a70 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.125+0000 7fe37d5ca640 1 -- 172.21.15.73:0/40740861 reap_dead start 2023-12-19T16:16:10.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 0x7fe368003e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c240 tx=0x7fe36c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67359d84c51c07e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c005ae0 con 0x7fe368003a70 2023-12-19T16:16:10.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c005c40 con 0x7fe368003a70 2023-12-19T16:16:10.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe3777fe640 1 -- 172.21.15.73:0/40740861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0a5a10 con 0x7fe368003a70 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 -- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 msgr2=0x7fe368003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 0x7fe368003e90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c240 tx=0x7fe36c01cc10 comp rx=0 tx=0).stop 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 -- 172.21.15.73:0/40740861 shutdown_connections 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 --2- 172.21.15.73:0/40740861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe368003a70 0x7fe368003e90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 -- 172.21.15.73:0/40740861 >> 172.21.15.73:0/40740861 conn(0x7fe37806a570 msgr2=0x7fe3780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.129+0000 7fe37f02d640 1 -- 172.21.15.73:0/40740861 shutdown_connections 2023-12-19T16:16:10.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 -- 172.21.15.73:0/40740861 wait complete. 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 Processor -- start 2023-12-19T16:16:10.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 -- start start 2023-12-19T16:16:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe368003a70 0x7fe3781e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780aea20 0x7fe37815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780aeea0 con 0x7fe37815a1a0 2023-12-19T16:16:10.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781e6b80 con 0x7fe368003a70 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37f02d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3781e68a0 con 0x7fe3780aea20 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60752/0 (socket says 172.21.15.73:60752) 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 -- 172.21.15.73:0/1865682547 learned_addr learned my addr 172.21.15.73:0/1865682547 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe368003a70 0x7fe3781e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe37d5ca640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780aea20 0x7fe37815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 -- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780aea20 msgr2=0x7fe37815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780aea20 0x7fe37815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 -- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe368003a70 msgr2=0x7fe3781e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe368003a70 0x7fe3781e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 -- 172.21.15.73:0/1865682547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3781596c0 con 0x7fe37815a1a0 2023-12-19T16:16:10.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.133+0000 7fe377fff640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe36400f530 tx=0x7fe36400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364004020 con 0x7fe37815a1a0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364004180 con 0x7fe37815a1a0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3781599a0 con 0x7fe37815a1a0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364004510 con 0x7fe37815a1a0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3781e6550 con 0x7fe37815a1a0 2023-12-19T16:16:10.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37804e070 con 0x7fe37815a1a0 2023-12-19T16:16:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe364014670 con 0x7fe37815a1a0 2023-12-19T16:16:10.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 0x7fe35c067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe364083500 con 0x7fe37815a1a0 2023-12-19T16:16:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 0x7fe35c067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.137+0000 7fe37cdc9640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 0x7fe35c067fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ab000 tx=0x7fe36c0a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.141+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe364050ea0 con 0x7fe37815a1a0 2023-12-19T16:16:10.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.293+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe37806c670 con 0x7fe37815a1a0 2023-12-19T16:16:10.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.293+0000 7fe3757fa640 1 -- 172.21.15.73:0/1865682547 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3640544c0 con 0x7fe37815a1a0 2023-12-19T16:16:10.297 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:10.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 msgr2=0x7fe35c067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 0x7fe35c067fa0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe36c0ab000 tx=0x7fe36c0a7070 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 msgr2=0x7fe3780ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe36400f530 tx=0x7fe36400f9f0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 shutdown_connections 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe3780aea20 0x7fe37815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe35c065ae0 0x7fe35c067fa0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe37815a1a0 0x7fe3780ae4e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 --2- 172.21.15.73:0/1865682547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe368003a70 0x7fe3781e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 >> 172.21.15.73:0/1865682547 conn(0x7fe37806a570 msgr2=0x7fe3780af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 shutdown_connections 2023-12-19T16:16:10.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.297+0000 7fe37f02d640 1 -- 172.21.15.73:0/1865682547 wait complete. 2023-12-19T16:16:10.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.452+0000 7f6f830d1640 1 Processor -- start 2023-12-19T16:16:10.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.452+0000 7f6f830d1640 1 -- start start 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f830d1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f830d1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f7c0b26a0 0x7f6f7c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f830d1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c0c9940 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f830d1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c06d720 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f830d1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c15e3a0 con 0x7f6f7c0b26a0 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60756/0 (socket says 172.21.15.73:60756) 2023-12-19T16:16:10.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 -- 172.21.15.73:0/3814262670 learned_addr learned my addr 172.21.15.73:0/3814262670 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f8166e640 1 --2- 172.21.15.73:0/3814262670 >> v2:172.21.15.162:3300/0 conn(0x7f6f7c0b26a0 0x7f6f7c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 -- 172.21.15.73:0/3814262670 >> v2:172.21.15.162:3300/0 conn(0x7f6f7c0b26a0 msgr2=0x7f6f7c0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 --2- 172.21.15.73:0/3814262670 >> v2:172.21.15.162:3300/0 conn(0x7f6f7c0b26a0 0x7f6f7c0c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 -- 172.21.15.73:0/3814262670 >> v1:172.21.15.162:6789/0 conn(0x7f6f7c0c8fa0 legacy=0x7f6f7c070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.456+0000 7f6f80e6d640 1 -- 172.21.15.73:0/3814262670 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c06c3a0 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f80e6d640 1 --2- 172.21.15.73:0/3814262670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c06e550 tx=0x7f6f7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69434a4a5c794d41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f737fe640 1 -- 172.21.15.73:0/3814262670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ab5f0 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f737fe640 1 -- 172.21.15.73:0/3814262670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f780ab750 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f737fe640 1 -- 172.21.15.73:0/3814262670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f780abae0 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- 172.21.15.73:0/3814262670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c15dfc0 msgr2=0x7f6f7c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 --2- 172.21.15.73:0/3814262670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c06e550 tx=0x7f6f7801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- 172.21.15.73:0/3814262670 shutdown_connections 2023-12-19T16:16:10.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 --2- 172.21.15.73:0/3814262670 >> v2:172.21.15.162:3300/0 conn(0x7f6f7c0b26a0 0x7f6f7c0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.464 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 --2- 172.21.15.73:0/3814262670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c0cbac0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- 172.21.15.73:0/3814262670 >> 172.21.15.73:0/3814262670 conn(0x7f6f7c0b0270 msgr2=0x7f6f7c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- 172.21.15.73:0/3814262670 shutdown_connections 2023-12-19T16:16:10.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- 172.21.15.73:0/3814262670 wait complete. 2023-12-19T16:16:10.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 Processor -- start 2023-12-19T16:16:10.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.460+0000 7f6f830d1640 1 -- start start 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f7c0b26a0 0x7f6f7c148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c136550 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c136830 con 0x7f6f7c15dfc0 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c136b10 con 0x7f6f7c0b26a0 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60764/0 (socket says 172.21.15.73:60764) 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 -- 172.21.15.73:0/2010020354 learned_addr learned my addr 172.21.15.73:0/2010020354 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f8166e640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f80e6d640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f7c0b26a0 0x7f6f7c148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 -- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f7c0b26a0 msgr2=0x7f6f7c148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f7c0b26a0 0x7f6f7c148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 -- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c15dfc0 msgr2=0x7f6f7c14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c14a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 -- 172.21.15.73:0/2010020354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f780094d0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f73fff640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c450 tx=0x7f6f6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0052d0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c005450 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c012870 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c136df0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c136170 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c074050 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.464+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f6c0129d0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.468+0000 7f6f717fa640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 0x7f6f68067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:10.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.468+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c082bc0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.468+0000 7f6f80e6d640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 0x7f6f68067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:10.472 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.468+0000 7f6f80e6d640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 0x7f6f68067f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6f780af000 tx=0x7f6f780b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:10.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.472+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f6c050590 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f7c1372a0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f717fa640 1 -- 172.21.15.73:0/2010020354 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f6c053bb0 con 0x7f6f7c0c8fa0 2023-12-19T16:16:10.639 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-19T16:16:10.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 msgr2=0x7f6f68067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 0x7f6f68067f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6f780af000 tx=0x7f6f780b6040 comp rx=0 tx=0).stop 2023-12-19T16:16:10.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 msgr2=0x7f6f7c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:10.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c450 tx=0x7f6f6c00c910 comp rx=0 tx=0).stop 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 shutdown_connections 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f7c15dfc0 0x7f6f7c14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f68065a90 0x7f6f68067f50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f7c0c8fa0 0x7f6f7c152ed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 --2- 172.21.15.73:0/2010020354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f7c0b26a0 0x7f6f7c148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 >> 172.21.15.73:0/2010020354 conn(0x7f6f7c0b0270 msgr2=0x7f6f7c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 shutdown_connections 2023-12-19T16:16:10.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:10.636+0000 7f6f830d1640 1 -- 172.21.15.73:0/2010020354 wait complete. 2023-12-19T16:16:10.660 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T16:16:10.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:10.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T16:16:10.697 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:16:10.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:10.698 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:16:10.751 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:10.751 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:10.762 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:10.762 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:10.815 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:10.815 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:10.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:11.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 Processor -- start 2023-12-19T16:16:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 -- start start 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f904815a9a0 0x7f90480b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90480b2a10 0x7f90480ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9048070990 con 0x7f90480cee70 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904815ad80 con 0x7f90480b2a10 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f904cab6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480cf300 con 0x7f904815a9a0 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9046ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90480b2a10 0x7f90480ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9047fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f90480cee70 0x7f90480b1380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44718/0 (socket says 172.21.15.73:44718) 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9047fff640 1 -- 172.21.15.73:0/3604641994 learned_addr learned my addr 172.21.15.73:0/3604641994 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:11.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f90477fe640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f904815a9a0 0x7f90480b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9046ffd640 1 -- 172.21.15.73:0/3604641994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f904815a9a0 msgr2=0x7f90480b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9046ffd640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f904815a9a0 0x7f90480b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9046ffd640 1 -- 172.21.15.73:0/3604641994 >> v1:172.21.15.73:6789/0 conn(0x7f90480cee70 legacy=0x7f90480b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f9046ffd640 1 -- 172.21.15.73:0/3604641994 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904806de20 con 0x7f90480b2a10 2023-12-19T16:16:11.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.000+0000 7f90467fc640 1 -- 172.21.15.73:0/3604641994 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414073191 0 0) 0x7f9048070990 con 0x7f90480cee70 2023-12-19T16:16:11.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f9046ffd640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90480b2a10 0x7f90480ce930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f903c0097f0 tx=0x7f903c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716236c0886a11b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f90467fc640 1 -- 172.21.15.73:0/3604641994 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ab600 con 0x7f90480b2a10 2023-12-19T16:16:11.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f90467fc640 1 -- 172.21.15.73:0/3604641994 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c0a7050 con 0x7f90480b2a10 2023-12-19T16:16:11.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f90467fc640 1 -- 172.21.15.73:0/3604641994 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0ab980 con 0x7f90480b2a10 2023-12-19T16:16:11.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 -- 172.21.15.73:0/3604641994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90480b2a10 msgr2=0x7f90480ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90480b2a10 0x7f90480ce930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f903c0097f0 tx=0x7f903c01c480 comp rx=0 tx=0).stop 2023-12-19T16:16:11.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 -- 172.21.15.73:0/3604641994 shutdown_connections 2023-12-19T16:16:11.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90480b2a10 0x7f90480ce930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 --2- 172.21.15.73:0/3604641994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f904815a9a0 0x7f90480b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 -- 172.21.15.73:0/3604641994 >> 172.21.15.73:0/3604641994 conn(0x7f904806a120 msgr2=0x7f904806a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 -- 172.21.15.73:0/3604641994 shutdown_connections 2023-12-19T16:16:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.004+0000 7f904cab6640 1 -- 172.21.15.73:0/3604641994 wait complete. 2023-12-19T16:16:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 Processor -- start 2023-12-19T16:16:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- start start 2023-12-19T16:16:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90480b2a10 0x7f90480ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 0x7f90480ab6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480abd70 con 0x7f904815a9a0 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480ac050 con 0x7f90480cee70 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480ac330 con 0x7f90480b2a10 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60772/0 (socket says 172.21.15.73:60772) 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 -- 172.21.15.73:0/3017152999 learned_addr learned my addr 172.21.15.73:0/3017152999 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 -- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90480b2a10 msgr2=0x7f90480ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90480b2a10 0x7f90480ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 -- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 msgr2=0x7f90480ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9046ffd640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 0x7f90480ab6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 0x7f90480ab6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 -- 172.21.15.73:0/3017152999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c009420 con 0x7f904815a9a0 2023-12-19T16:16:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9046ffd640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 0x7f90480ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f9047fff640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9040001570 tx=0x7f904000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000cea0 con 0x7f904815a9a0 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904000a5e0 con 0x7f904815a9a0 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480ac610 con 0x7f904815a9a0 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000a990 con 0x7f904815a9a0 2023-12-19T16:16:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.008+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90480ace10 con 0x7f904815a9a0 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904804e000 con 0x7f904815a9a0 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f904000aaf0 con 0x7f904815a9a0 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f902ffff640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 0x7f9034067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90400828b0 con 0x7f904815a9a0 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f90477fe640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 0x7f9034067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.012+0000 7f90477fe640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 0x7f9034067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f903800b850 tx=0x7f9038008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.016+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9040050300 con 0x7f904815a9a0 2023-12-19T16:16:11.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90480acac0 con 0x7f904815a9a0 2023-12-19T16:16:11.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f902ffff640 1 -- 172.21.15.73:0/3017152999 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f9040018090 con 0x7f904815a9a0 2023-12-19T16:16:11.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:11.173 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:11.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 msgr2=0x7f9034067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 0x7f9034067f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f903800b850 tx=0x7f9038008040 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 msgr2=0x7f9048155630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9040001570 tx=0x7f904000cc50 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 shutdown_connections 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9034065a60 0x7f9034067f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f904815a9a0 0x7f9048155630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90480cee70 0x7f90480ab6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 --2- 172.21.15.73:0/3017152999 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90480b2a10 0x7f90480ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.168+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 >> 172.21.15.73:0/3017152999 conn(0x7f904806a120 msgr2=0x7f90480b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.172+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 shutdown_connections 2023-12-19T16:16:11.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.172+0000 7f904cab6640 1 -- 172.21.15.73:0/3017152999 wait complete. 2023-12-19T16:16:11.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:11.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:11.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.332+0000 7f23e6233640 1 Processor -- start 2023-12-19T16:16:11.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.332+0000 7f23e6233640 1 -- start start 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e6233640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e6233640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23e00d13f0 0x7f23e00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e6233640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e006af80 con 0x7f23e00cdb00 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e6233640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e006b540 con 0x7f23e00d13f0 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e6233640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00d1830 con 0x7f23e015cc40 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e4a30640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f23e00d13f0 0x7f23e00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:52406/0 (socket says 172.21.15.73:52406) 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 -- 172.21.15.73:0/2049098391 learned_addr learned my addr 172.21.15.73:0/2049098391 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:11.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5a32640 1 --1- 172.21.15.73:0/2049098391 >> v1:172.21.15.162:6789/0 conn(0x7f23e00cdb00 0x7f23e00cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:47426/0 (socket says 172.21.15.73:47426) 2023-12-19T16:16:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 -- 172.21.15.73:0/2049098391 >> v2:172.21.15.162:3300/0 conn(0x7f23e00d13f0 msgr2=0x7f23e00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 --2- 172.21.15.73:0/2049098391 >> v2:172.21.15.162:3300/0 conn(0x7f23e00d13f0 0x7f23e00cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 -- 172.21.15.73:0/2049098391 >> v1:172.21.15.162:6789/0 conn(0x7f23e00cdb00 legacy=0x7f23e00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.336+0000 7f23e5231640 1 -- 172.21.15.73:0/2049098391 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00ce330 con 0x7f23e015cc40 2023-12-19T16:16:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e5231640 1 --2- 172.21.15.73:0/2049098391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009870 tx=0x7f23dc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e3a2cd7a1c4f61a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23d7fff640 1 -- 172.21.15.73:0/2049098391 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0aa670 con 0x7f23e015cc40 2023-12-19T16:16:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23d7fff640 1 -- 172.21.15.73:0/2049098391 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0aa7d0 con 0x7f23e015cc40 2023-12-19T16:16:11.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23d7fff640 1 -- 172.21.15.73:0/2049098391 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0aab60 con 0x7f23e015cc40 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- 172.21.15.73:0/2049098391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 msgr2=0x7f23e00d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 --2- 172.21.15.73:0/2049098391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009870 tx=0x7f23dc01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- 172.21.15.73:0/2049098391 shutdown_connections 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 --2- 172.21.15.73:0/2049098391 >> v2:172.21.15.162:3300/0 conn(0x7f23e00d13f0 0x7f23e00cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 --2- 172.21.15.73:0/2049098391 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00d0eb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- 172.21.15.73:0/2049098391 >> 172.21.15.73:0/2049098391 conn(0x7f23e009bbf0 msgr2=0x7f23e00d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- 172.21.15.73:0/2049098391 shutdown_connections 2023-12-19T16:16:11.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- 172.21.15.73:0/2049098391 wait complete. 2023-12-19T16:16:11.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 Processor -- start 2023-12-19T16:16:11.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.340+0000 7f23e6233640 1 -- start start 2023-12-19T16:16:11.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23e00cdb00 0x7f23e0154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e014ba40 con 0x7f23e00d13f0 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0155500 con 0x7f23e00cdb00 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e014ab70 con 0x7f23e015cc40 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60782/0 (socket says 172.21.15.73:60782) 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 -- 172.21.15.73:0/1918253692 learned_addr learned my addr 172.21.15.73:0/1918253692 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e5231640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23e00cdb00 0x7f23e0154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e5a32640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 -- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 msgr2=0x7f23e00b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 -- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23e00cdb00 msgr2=0x7f23e0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23e00cdb00 0x7f23e0154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 -- 172.21.15.73:0/1918253692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0094d0 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e4a30640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23d000e870 tx=0x7f23d000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0009510 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000eec0 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d000cb40 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e014be60 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e014b0a0 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e014bb80 con 0x7f23e00d13f0 2023-12-19T16:16:11.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.344+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f23d000cca0 con 0x7f23e00d13f0 2023-12-19T16:16:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.348+0000 7f23d5ffb640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 0x7f23c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.348+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23d0083110 con 0x7f23e00d13f0 2023-12-19T16:16:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.348+0000 7f23e5231640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 0x7f23c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.348+0000 7f23e5231640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 0x7f23c4067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ae000 tx=0x7f23dc0b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.352+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f23e014bb80 con 0x7f23e00d13f0 2023-12-19T16:16:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.500+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23e014bb80 con 0x7f23e00d13f0 2023-12-19T16:16:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.500+0000 7f23d5ffb640 1 -- 172.21.15.73:0/1918253692 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23e014bb80 con 0x7f23e00d13f0 2023-12-19T16:16:11.506 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 msgr2=0x7f23c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 0x7f23c4067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0ae000 tx=0x7f23dc0b5040 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 msgr2=0x7f23e00b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23d000e870 tx=0x7f23d000ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 shutdown_connections 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23e015cc40 0x7f23e00b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f23c4065a60 0x7f23c4067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e00d13f0 0x7f23e00b0660 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 --2- 172.21.15.73:0/1918253692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23e00cdb00 0x7f23e0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 >> 172.21.15.73:0/1918253692 conn(0x7f23e009bbf0 msgr2=0x7f23e00b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 shutdown_connections 2023-12-19T16:16:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.504+0000 7f23e6233640 1 -- 172.21.15.73:0/1918253692 wait complete. 2023-12-19T16:16:11.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:11.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 Processor -- start 2023-12-19T16:16:11.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 -- start start 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b00b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f47b00b0660 0x7f47b00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00cce80 con 0x7f47b01598c0 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00b0ae0 con 0x7f47b00b0660 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b6d18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00cc270 con 0x7f47b006d410 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b4ab4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47b01598c0 0x7f47b006c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44732/0 (socket says 172.21.15.73:44732) 2023-12-19T16:16:11.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b4ab4640 1 -- 172.21.15.73:0/1707652423 learned_addr learned my addr 172.21.15.73:0/1707652423 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1707652423 >> v2:172.21.15.162:3300/0 conn(0x7f47b00b0660 0x7f47b00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47a7fff640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b00b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47a77fe640 1 -- 172.21.15.73:0/1707652423 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122026607 0 0) 0x7f47b00cce80 con 0x7f47b01598c0 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47a77fe640 1 -- 172.21.15.73:0/1707652423 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4798003530 con 0x7f47b01598c0 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b52b5640 1 -- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 msgr2=0x7f47b00b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:11.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b00b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b52b5640 1 -- 172.21.15.73:0/1707652423 >> v1:172.21.15.73:6789/0 conn(0x7f47b01598c0 legacy=0x7f47b006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.664+0000 7f47b52b5640 1 -- 172.21.15.73:0/1707652423 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00cc550 con 0x7f47b00b0660 2023-12-19T16:16:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00cd310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0befc545256f06a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47a77fe640 1 -- 172.21.15.73:0/1707652423 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80a59e0 con 0x7f47b00b0660 2023-12-19T16:16:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47a77fe640 1 -- 172.21.15.73:0/1707652423 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a80a5b40 con 0x7f47b00b0660 2023-12-19T16:16:11.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47a77fe640 1 -- 172.21.15.73:0/1707652423 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80ad440 con 0x7f47b00b0660 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 -- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 msgr2=0x7f47b00cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00cd310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a801c920 comp rx=0 tx=0).stop 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 -- 172.21.15.73:0/1707652423 shutdown_connections 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00cd310 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1707652423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b00b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 -- 172.21.15.73:0/1707652423 >> 172.21.15.73:0/1707652423 conn(0x7f47b006a570 msgr2=0x7f47b00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 -- 172.21.15.73:0/1707652423 shutdown_connections 2023-12-19T16:16:11.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.668+0000 7f47b6d18640 1 -- 172.21.15.73:0/1707652423 wait complete. 2023-12-19T16:16:11.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 Processor -- start 2023-12-19T16:16:11.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- start start 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0150be0 con 0x7f47b01598c0 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c60f0 con 0x7f47b00b0660 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0150e30 con 0x7f47b006d410 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60792/0 (socket says 172.21.15.73:60792) 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 -- 172.21.15.73:0/1550463754 learned_addr learned my addr 172.21.15.73:0/1550463754 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47a7fff640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b4ab4640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 -- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 msgr2=0x7f47b014e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b014e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 -- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 msgr2=0x7f47b00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 -- 172.21.15.73:0/1550463754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009a70 con 0x7f47b01598c0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b4ab4640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b52b5640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47a801afd0 tx=0x7f47a80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80adce0 con 0x7f47b01598c0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a80ade40 con 0x7f47b01598c0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80b9670 con 0x7f47b01598c0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b0151110 con 0x7f47b01598c0 2023-12-19T16:16:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.672+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b01516d0 con 0x7f47b01598c0 2023-12-19T16:16:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b004e070 con 0x7f47b01598c0 2023-12-19T16:16:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f47a80b97d0 con 0x7f47b01598c0 2023-12-19T16:16:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47a57fa640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 0x7f479c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47a811e870 con 0x7f47b01598c0 2023-12-19T16:16:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47b4ab4640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 0x7f479c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.676+0000 7f47b4ab4640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 0x7f479c067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0011f0 tx=0x7f47ac009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.680+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f47a80ec220 con 0x7f47b01598c0 2023-12-19T16:16:11.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47b00c4330 con 0x7f47b01598c0 2023-12-19T16:16:11.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47a57fa640 1 -- 172.21.15.73:0/1550463754 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47a8009450 con 0x7f47b01598c0 2023-12-19T16:16:11.837 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 msgr2=0x7f479c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 0x7f479c067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0011f0 tx=0x7f47ac009040 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 msgr2=0x7f47b014bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47a801afd0 tx=0x7f47a80196c0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 shutdown_connections 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f479c065a60 0x7f479c067f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47b01598c0 0x7f47b014bc80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47b00b0660 0x7f47b00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 --2- 172.21.15.73:0/1550463754 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47b006d410 0x7f47b014e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 >> 172.21.15.73:0/1550463754 conn(0x7f47b006a570 msgr2=0x7f47b00c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 shutdown_connections 2023-12-19T16:16:11.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.832+0000 7f47b6d18640 1 -- 172.21.15.73:0/1550463754 wait complete. 2023-12-19T16:16:11.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:11.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.992+0000 7fe5c49cd640 1 Processor -- start 2023-12-19T16:16:11.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.992+0000 7fe5c49cd640 1 -- start start 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5c49cd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5c015aaf0 0x7fe5c015e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5c49cd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe5c00cbaa0 0x7fe5c00ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5c49cd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c015aed0 con 0x7fe5c015eb40 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5c49cd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c015f580 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5c49cd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c015efc0 con 0x7fe5c015aaf0 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5be59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe5c015eb40 0x7fe5c00cb390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44736/0 (socket says 172.21.15.73:44736) 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5be59c640 1 -- 172.21.15.73:0/3331888829 learned_addr learned my addr 172.21.15.73:0/3331888829 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:12.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bf59e640 1 --2- 172.21.15.73:0/3331888829 >> v2:172.21.15.73:3300/0 conn(0x7fe5c00cbaa0 0x7fe5c00ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bed9d640 1 --2- 172.21.15.73:0/3331888829 >> v2:172.21.15.162:3300/0 conn(0x7fe5c015aaf0 0x7fe5c015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bdd9b640 1 -- 172.21.15.73:0/3331888829 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880033267 0 0) 0x7fe5c015aed0 con 0x7fe5c015eb40 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bdd9b640 1 -- 172.21.15.73:0/3331888829 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a8003530 con 0x7fe5c015eb40 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bf59e640 1 -- 172.21.15.73:0/3331888829 >> v2:172.21.15.162:3300/0 conn(0x7fe5c015aaf0 msgr2=0x7fe5c015e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bf59e640 1 --2- 172.21.15.73:0/3331888829 >> v2:172.21.15.162:3300/0 conn(0x7fe5c015aaf0 0x7fe5c015e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bf59e640 1 -- 172.21.15.73:0/3331888829 >> v1:172.21.15.73:6789/0 conn(0x7fe5c015eb40 legacy=0x7fe5c00cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:11.996+0000 7fe5bf59e640 1 -- 172.21.15.73:0/3331888829 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c015f2a0 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5bf59e640 1 --2- 172.21.15.73:0/3331888829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c00cbaa0 0x7fe5c00ccd20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b1070 tx=0x7fe5b801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a020a5fcfea75b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5bdd9b640 1 -- 172.21.15.73:0/3331888829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80a59a0 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5bdd9b640 1 -- 172.21.15.73:0/3331888829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80a5b00 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5bdd9b640 1 -- 172.21.15.73:0/3331888829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b80a5e90 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- 172.21.15.73:0/3331888829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c00cbaa0 msgr2=0x7fe5c00ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/3331888829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c00cbaa0 0x7fe5c00ccd20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b1070 tx=0x7fe5b801c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- 172.21.15.73:0/3331888829 shutdown_connections 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/3331888829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c00cbaa0 0x7fe5c00ccd20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/3331888829 >> v2:172.21.15.162:3300/0 conn(0x7fe5c015aaf0 0x7fe5c015e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- 172.21.15.73:0/3331888829 >> 172.21.15.73:0/3331888829 conn(0x7fe5c006a120 msgr2=0x7fe5c006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- 172.21.15.73:0/3331888829 shutdown_connections 2023-12-19T16:16:12.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- 172.21.15.73:0/3331888829 wait complete. 2023-12-19T16:16:12.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 Processor -- start 2023-12-19T16:16:12.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.000+0000 7fe5c49cd640 1 -- start start 2023-12-19T16:16:12.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5c00cbaa0 0x7fe5c00c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5c015eb40 0x7fe5c00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c015fa50 con 0x7fe5c015aaf0 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c5970 con 0x7fe5c015eb40 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c00c5c50 con 0x7fe5c00cbaa0 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60814/0 (socket says 172.21.15.73:60814) 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 -- 172.21.15.73:0/4053935889 learned_addr learned my addr 172.21.15.73:0/4053935889 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5bed9d640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5c00cbaa0 0x7fe5c00c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5bf59e640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5c015eb40 0x7fe5c00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 -- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5c00cbaa0 msgr2=0x7fe5c00c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5c00cbaa0 0x7fe5c00c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 -- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5c015eb40 msgr2=0x7fe5c00ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5c015eb40 0x7fe5c00ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 -- 172.21.15.73:0/4053935889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8009a70 con 0x7fe5c015aaf0 2023-12-19T16:16:12.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5be59c640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400c400 tx=0x7fe5b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4005cf0 con 0x7fe5c015aaf0 2023-12-19T16:16:12.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4005e50 con 0x7fe5c015aaf0 2023-12-19T16:16:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c00c5f30 con 0x7fe5c015aaf0 2023-12-19T16:16:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40072d0 con 0x7fe5c015aaf0 2023-12-19T16:16:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c00c64f0 con 0x7fe5c015aaf0 2023-12-19T16:16:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c00c66e0 con 0x7fe5c015aaf0 2023-12-19T16:16:12.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.004+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe5b4007430 con 0x7fe5c015aaf0 2023-12-19T16:16:12.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.008+0000 7fe5a77fe640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 0x7fe5ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.008+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5b4082390 con 0x7fe5c015aaf0 2023-12-19T16:16:12.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.008+0000 7fe5bed9d640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 0x7fe5ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.012 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.008+0000 7fe5bed9d640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 0x7fe5ac067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b1900 tx=0x7fe5b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.012+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe5b404fe30 con 0x7fe5c015aaf0 2023-12-19T16:16:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.160+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5c004e000 con 0x7fe5c015aaf0 2023-12-19T16:16:12.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.160+0000 7fe5a77fe640 1 -- 172.21.15.73:0/4053935889 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5b4053450 con 0x7fe5c015aaf0 2023-12-19T16:16:12.166 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:12.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 msgr2=0x7fe5ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 0x7fe5ac067f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00b1900 tx=0x7fe5b0008040 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 msgr2=0x7fe5c00c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400c400 tx=0x7fe5b400c8c0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 shutdown_connections 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5c015eb40 0x7fe5c00ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe5ac065a60 0x7fe5ac067f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe5c015aaf0 0x7fe5c00c6a10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 --2- 172.21.15.73:0/4053935889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5c00cbaa0 0x7fe5c00c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 >> 172.21.15.73:0/4053935889 conn(0x7fe5c006a120 msgr2=0x7fe5c0159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 shutdown_connections 2023-12-19T16:16:12.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.164+0000 7fe5c49cd640 1 -- 172.21.15.73:0/4053935889 wait complete. 2023-12-19T16:16:12.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.320+0000 7fed1dd39640 1 Processor -- start 2023-12-19T16:16:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed1dd39640 1 -- start start 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed1dd39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed18165430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed1dd39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180ae840 con 0x7fed1815ae70 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed1dd39640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180b16e0 con 0x7fed180afb40 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed1dd39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1815bfc0 con 0x7fed1815b960 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed177fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fed1815ae70 0x7fed180af430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44740/0 (socket says 172.21.15.73:44740) 2023-12-19T16:16:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed177fe640 1 -- 172.21.15.73:0/4130195072 learned_addr learned my addr 172.21.15.73:0/4130195072 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed17fff640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed18165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706955239 0 0) 0x7fed180ae840 con 0x7fed1815ae70 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed00003530 con 0x7fed1815ae70 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 248174550 0 0) 0x7fed00003530 con 0x7fed1815ae70 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 msgr2=0x7fed18165430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed18165430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 >> v1:172.21.15.162:6789/0 conn(0x7fed180afb40 legacy=0x7fed1815b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1815c2a0 con 0x7fed1815ae70 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fed08001680 con 0x7fed1815ae70 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 >> v1:172.21.15.73:6789/0 conn(0x7fed1815ae70 legacy=0x7fed180af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed00003ef0 0x7fed000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed00004d10 0x7fed00005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1815bfc0 con 0x7fed00003ef0 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0000b9f0 con 0x7fed00004d10 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0000bbb0 con 0x7fed1815b960 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed00003ef0 0x7fed000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed177fe640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed17fff640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed00004d10 0x7fed00005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.331 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 -- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 msgr2=0x7fed000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed1815b960 0x7fed000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 -- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed00004d10 msgr2=0x7fed00005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed00004d10 0x7fed00005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.324+0000 7fed16ffd640 1 -- 172.21.15.73:0/4130195072 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed00003530 con 0x7fed00003ef0 2023-12-19T16:16:12.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed16ffd640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed00003ef0 0x7fed000047d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed1806ac90 tx=0x7fed0c01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cc67e15c4238ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0a8750 con 0x7fed00003ef0 2023-12-19T16:16:12.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c0a88b0 con 0x7fed00003ef0 2023-12-19T16:16:12.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed167fc640 1 -- 172.21.15.73:0/4130195072 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0a8ca0 con 0x7fed00003ef0 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 -- 172.21.15.73:0/4130195072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed00003ef0 msgr2=0x7fed000047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 --2- 172.21.15.73:0/4130195072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed00003ef0 0x7fed000047d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fed1806ac90 tx=0x7fed0c01eb30 comp rx=0 tx=0).stop 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed17fff640 1 -- 172.21.15.73:0/4130195072 reap_dead start 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 -- 172.21.15.73:0/4130195072 shutdown_connections 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 -- 172.21.15.73:0/4130195072 >> 172.21.15.73:0/4130195072 conn(0x7fed1806c090 msgr2=0x7fed1806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 -- 172.21.15.73:0/4130195072 shutdown_connections 2023-12-19T16:16:12.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.328+0000 7fed1dd39640 1 -- 172.21.15.73:0/4130195072 wait complete. 2023-12-19T16:16:12.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 Processor -- start 2023-12-19T16:16:12.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 -- start start 2023-12-19T16:16:12.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed00003ef0 0x7fed18144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1814e4e0 0x7fed181f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181f3ca0 con 0x7fed181f3820 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed181476a0 con 0x7fed1814e4e0 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed1dd39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed18147980 con 0x7fed00003ef0 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60826/0 (socket says 172.21.15.73:60826) 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed177fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed00003ef0 0x7fed18144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed16ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1814e4e0 0x7fed181f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 -- 172.21.15.73:0/2280747638 learned_addr learned my addr 172.21.15.73:0/2280747638 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 -- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed00003ef0 msgr2=0x7fed18144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed00003ef0 0x7fed18144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 -- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1814e4e0 msgr2=0x7fed181f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1814e4e0 0x7fed181f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 -- 172.21.15.73:0/2280747638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18147c60 con 0x7fed181f3820 2023-12-19T16:16:12.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.332+0000 7fed17fff640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fed180c8bf0 tx=0x7fed1000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000e040 con 0x7fed181f3820 2023-12-19T16:16:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed18147f40 con 0x7fed181f3820 2023-12-19T16:16:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000f040 con 0x7fed181f3820 2023-12-19T16:16:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10015430 con 0x7fed181f3820 2023-12-19T16:16:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed181f40d0 con 0x7fed181f3820 2023-12-19T16:16:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed18147ac0 con 0x7fed181f3820 2023-12-19T16:16:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed10015590 con 0x7fed181f3820 2023-12-19T16:16:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.336+0000 7fecfffff640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 0x7fed04067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.340+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed10083830 con 0x7fed181f3820 2023-12-19T16:16:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.340+0000 7fed177fe640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 0x7fed04067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.340+0000 7fed177fe640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 0x7fed04067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed08001060 tx=0x7fed08000ff0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.344+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed18147ac0 con 0x7fed181f3820 2023-12-19T16:16:12.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fed18149fd0 con 0x7fed181f3820 2023-12-19T16:16:12.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fecfffff640 1 -- 172.21.15.73:0/2280747638 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fed18149fd0 con 0x7fed181f3820 2023-12-19T16:16:12.508 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 msgr2=0x7fed04067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 0x7fed04067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fed08001060 tx=0x7fed08000ff0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 msgr2=0x7fed181efd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fed180c8bf0 tx=0x7fed1000f580 comp rx=0 tx=0).stop 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 shutdown_connections 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed04065a90 0x7fed04067f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed181f3820 0x7fed181efd60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed1814e4e0 0x7fed181f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 --2- 172.21.15.73:0/2280747638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed00003ef0 0x7fed18144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 >> 172.21.15.73:0/2280747638 conn(0x7fed1806c090 msgr2=0x7fed180b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 shutdown_connections 2023-12-19T16:16:12.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.504+0000 7fed1dd39640 1 -- 172.21.15.73:0/2280747638 wait complete. 2023-12-19T16:16:12.529 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T16:16:12.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:12.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-19T16:16:12.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:16:12.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:12.569 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T16:16:12.630 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:12.631 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:12.640 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:12.640 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:12.691 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:12.691 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:12.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:12.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 Processor -- start 2023-12-19T16:16:12.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 -- start start 2023-12-19T16:16:12.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff6980cdc40 0x7ff69815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6980b40b0 0x7ff6980ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69815ad00 con 0x7ff698159830 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69815e110 con 0x7ff6980b40b0 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69ffa5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6980ce2d0 con 0x7ff6980cdc40 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6980b40b0 0x7ff6980ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6980b40b0 0x7ff6980ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60828/0 (socket says 172.21.15.73:60828) 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 -- 172.21.15.73:0/2066731801 learned_addr learned my addr 172.21.15.73:0/2066731801 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69dd41640 1 --1- 172.21.15.73:0/2066731801 >> v1:172.21.15.73:6789/0 conn(0x7ff698159830 0x7ff6980cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44754/0 (socket says 172.21.15.73:44754) 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69d540640 1 --2- 172.21.15.73:0/2066731801 >> v2:172.21.15.162:3300/0 conn(0x7ff6980cdc40 0x7ff69815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 -- 172.21.15.73:0/2066731801 >> v2:172.21.15.162:3300/0 conn(0x7ff6980cdc40 msgr2=0x7ff69815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 --2- 172.21.15.73:0/2066731801 >> v2:172.21.15.162:3300/0 conn(0x7ff6980cdc40 0x7ff69815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 -- 172.21.15.73:0/2066731801 >> v1:172.21.15.73:6789/0 conn(0x7ff698159830 legacy=0x7ff6980cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.920+0000 7ff69e542640 1 -- 172.21.15.73:0/2066731801 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69815d490 con 0x7ff6980b40b0 2023-12-19T16:16:12.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69e542640 1 --2- 172.21.15.73:0/2066731801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980b40b0 0x7ff6980ca080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6980c9a80 tx=0x7ff69001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7794001a4cd75a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69cd3f640 1 -- 172.21.15.73:0/2066731801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900a57d0 con 0x7ff6980b40b0 2023-12-19T16:16:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69cd3f640 1 -- 172.21.15.73:0/2066731801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6900a5930 con 0x7ff6980b40b0 2023-12-19T16:16:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69cd3f640 1 -- 172.21.15.73:0/2066731801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900a5cc0 con 0x7ff6980b40b0 2023-12-19T16:16:12.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 -- 172.21.15.73:0/2066731801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980b40b0 msgr2=0x7ff6980ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/2066731801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980b40b0 0x7ff6980ca080 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6980c9a80 tx=0x7ff69001c910 comp rx=0 tx=0).stop 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 -- 172.21.15.73:0/2066731801 shutdown_connections 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/2066731801 >> v2:172.21.15.162:3300/0 conn(0x7ff6980cdc40 0x7ff69815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/2066731801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980b40b0 0x7ff6980ca080 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 -- 172.21.15.73:0/2066731801 >> 172.21.15.73:0/2066731801 conn(0x7ff6980b0270 msgr2=0x7ff6980b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 -- 172.21.15.73:0/2066731801 shutdown_connections 2023-12-19T16:16:12.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.924+0000 7ff69ffa5640 1 -- 172.21.15.73:0/2066731801 wait complete. 2023-12-19T16:16:12.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 Processor -- start 2023-12-19T16:16:12.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- start start 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6980b40b0 0x7ff6980c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 0x7ff6981588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980c39f0 con 0x7ff6980cdc40 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980cda40 con 0x7ff6980b40b0 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980c2410 con 0x7ff698159830 2023-12-19T16:16:12.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60844/0 (socket says 172.21.15.73:60844) 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 -- 172.21.15.73:0/3976483376 learned_addr learned my addr 172.21.15.73:0/3976483376 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69dd41640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6980b40b0 0x7ff6980c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69e542640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 0x7ff6981588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 -- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 msgr2=0x7ff6981588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 0x7ff6981588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 -- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6980b40b0 msgr2=0x7ff6980c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6980b40b0 0x7ff6980c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:12.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 -- 172.21.15.73:0/3976483376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690009b30 con 0x7ff6980cdc40 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69e542640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 0x7ff6981588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69d540640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff68800d800 tx=0x7ff68800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800b6c0 con 0x7ff6980cdc40 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800b820 con 0x7ff6980cdc40 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68800bb90 con 0x7ff6980cdc40 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6980c26f0 con 0x7ff6980cdc40 2023-12-19T16:16:12.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6980c2cb0 con 0x7ff6980cdc40 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.928+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff698074050 con 0x7ff6980cdc40 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.932+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff68800bcf0 con 0x7ff6980cdc40 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.932+0000 7ff68e7fc640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.932+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff688083690 con 0x7ff6980cdc40 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.932+0000 7ff69dd41640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:12.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.932+0000 7ff69dd41640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 0x7ff67c067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff694000f70 tx=0x7ff694007e50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:12.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:12.936+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff688050fb0 con 0x7ff6980cdc40 2023-12-19T16:16:13.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.088+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff69815dd00 con 0x7ff6980cdc40 2023-12-19T16:16:13.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff68e7fc640 1 -- 172.21.15.73:0/3976483376 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7ff6880545d0 con 0x7ff6980cdc40 2023-12-19T16:16:13.095 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:13.096 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 msgr2=0x7ff67c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 0x7ff67c067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff694000f70 tx=0x7ff694007e50 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 msgr2=0x7ff6980ac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff68800d800 tx=0x7ff68800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 shutdown_connections 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff698159830 0x7ff6981588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6980cdc40 0x7ff6980ac300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 --2- 172.21.15.73:0/3976483376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6980b40b0 0x7ff6980c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 >> 172.21.15.73:0/3976483376 conn(0x7ff6980b0270 msgr2=0x7ff698070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 shutdown_connections 2023-12-19T16:16:13.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.092+0000 7ff69ffa5640 1 -- 172.21.15.73:0/3976483376 wait complete. 2023-12-19T16:16:13.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:13.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:13.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 Processor -- start 2023-12-19T16:16:13.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 -- start start 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc478159230 0x7fc4780ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc4780cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4780cc6a0 0x7fc4780cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780ca9f0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780c9760 con 0x7fc478159230 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47ce66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780c99d0 con 0x7fc4780b0190 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4780cc6a0 0x7fc4780cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4780cc6a0 0x7fc4780cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60846/0 (socket says 172.21.15.73:60846) 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 -- 172.21.15.73:0/4225899417 learned_addr learned my addr 172.21.15.73:0/4225899417 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc46dd9b640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc4780cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc47659c640 1 --2- 172.21.15.73:0/4225899417 >> v2:172.21.15.162:3300/0 conn(0x7fc478159230 0x7fc4780ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 -- 172.21.15.73:0/4225899417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 msgr2=0x7fc4780cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc4780cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 -- 172.21.15.73:0/4225899417 >> v2:172.21.15.162:3300/0 conn(0x7fc478159230 msgr2=0x7fc4780ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 --2- 172.21.15.73:0/4225899417 >> v2:172.21.15.162:3300/0 conn(0x7fc478159230 0x7fc4780ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.256+0000 7fc476d9d640 1 -- 172.21.15.73:0/4225899417 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780c9cb0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc476d9d640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780cce10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc47806e3b0 tx=0x7fc47001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c60cf8cbe3391b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc475d9b640 1 -- 172.21.15.73:0/4225899417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a5840 con 0x7fc4780cc6a0 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc475d9b640 1 -- 172.21.15.73:0/4225899417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700a59a0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc475d9b640 1 -- 172.21.15.73:0/4225899417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a5d30 con 0x7fc4780cc6a0 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 -- 172.21.15.73:0/4225899417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 msgr2=0x7fc4780cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780cce10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc47806e3b0 tx=0x7fc47001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 -- 172.21.15.73:0/4225899417 shutdown_connections 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780cce10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 --2- 172.21.15.73:0/4225899417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc4780cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 --2- 172.21.15.73:0/4225899417 >> v2:172.21.15.162:3300/0 conn(0x7fc478159230 0x7fc4780ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 -- 172.21.15.73:0/4225899417 >> 172.21.15.73:0/4225899417 conn(0x7fc47806a570 msgr2=0x7fc4780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 -- 172.21.15.73:0/4225899417 shutdown_connections 2023-12-19T16:16:13.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 -- 172.21.15.73:0/4225899417 wait complete. 2023-12-19T16:16:13.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.260+0000 7fc47ce66640 1 Processor -- start 2023-12-19T16:16:13.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- start start 2023-12-19T16:16:13.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc47814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc478159230 0x7fc4780acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780c6170 con 0x7fc4780cc6a0 2023-12-19T16:16:13.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780adaf0 con 0x7fc478159230 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4781f9280 con 0x7fc4780b0190 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60848/0 (socket says 172.21.15.73:60848) 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 -- 172.21.15.73:0/2115868259 learned_addr learned my addr 172.21.15.73:0/2115868259 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47659c640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc47814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc476d9d640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc478159230 0x7fc4780acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 -- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 msgr2=0x7fc47814ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc47814ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 -- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc478159230 msgr2=0x7fc4780acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc478159230 0x7fc4780acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 -- 172.21.15.73:0/2115868259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009b30 con 0x7fc4780cc6a0 2023-12-19T16:16:13.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46dd9b640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc46800d800 tx=0x7fc46800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680096a0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468009800 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4780ad530 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468009990 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4780c63a0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.264+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47804e070 con 0x7fc4780cc6a0 2023-12-19T16:16:13.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.268+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc468009af0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.268+0000 7fc46f7fe640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 0x7fc458067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.268+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc468083620 con 0x7fc4780cc6a0 2023-12-19T16:16:13.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.268+0000 7fc47659c640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 0x7fc458067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.268+0000 7fc47659c640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 0x7fc458067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4780c49c0 tx=0x7fc460008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.272+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc468050fd0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.420+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc47815d3e0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.420+0000 7fc46f7fe640 1 -- 172.21.15.73:0/2115868259 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc46800b3a0 con 0x7fc4780cc6a0 2023-12-19T16:16:13.427 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 msgr2=0x7fc458067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 0x7fc458067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4780c49c0 tx=0x7fc460008040 comp rx=0 tx=0).stop 2023-12-19T16:16:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 msgr2=0x7fc4780ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc46800d800 tx=0x7fc46800dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 shutdown_connections 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc478159230 0x7fc4780acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc458065a60 0x7fc458067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4780cc6a0 0x7fc4780ac9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 --2- 172.21.15.73:0/2115868259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4780b0190 0x7fc47814ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 >> 172.21.15.73:0/2115868259 conn(0x7fc47806a570 msgr2=0x7fc4780ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 shutdown_connections 2023-12-19T16:16:13.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.424+0000 7fc47ce66640 1 -- 172.21.15.73:0/2115868259 wait complete. 2023-12-19T16:16:13.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 Processor -- start 2023-12-19T16:16:13.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 -- start start 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8bec159230 0x7f8bec0ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec0cd520 0x7f8bec06bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0ca9f0 con 0x7f8bec0cc160 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0c9760 con 0x7f8bec159230 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf3f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0c99d0 con 0x7f8bec0cd520 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8bec159230 0x7f8bec0ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8bec159230 0x7f8bec0ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60852/0 (socket says 172.21.15.73:60852) 2023-12-19T16:16:13.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2806036628 learned_addr learned my addr 172.21.15.73:0/2806036628 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf24ef640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec0cd520 0x7f8bec06bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2806036628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec0cd520 msgr2=0x7f8bec06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec0cd520 0x7f8bec06bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2806036628 >> v1:172.21.15.162:6789/0 conn(0x7f8bec0cc160 legacy=0x7f8bec0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.584+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2806036628 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0c9cb0 con 0x7f8bec159230 2023-12-19T16:16:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf1cee640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec159230 0x7f8bec0ca4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009870 tx=0x7f8be801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893fa9dbc054c446 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf0cec640 1 -- 172.21.15.73:0/2806036628 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ac600 con 0x7f8bec159230 2023-12-19T16:16:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf0cec640 1 -- 172.21.15.73:0/2806036628 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80a8050 con 0x7f8bec159230 2023-12-19T16:16:13.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf0cec640 1 -- 172.21.15.73:0/2806036628 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ac980 con 0x7f8bec159230 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2806036628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec159230 msgr2=0x7f8bec0ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec159230 0x7f8bec0ca4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009870 tx=0x7f8be801c510 comp rx=0 tx=0).stop 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2806036628 shutdown_connections 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec0cd520 0x7f8bec06bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2806036628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec159230 0x7f8bec0ca4b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2806036628 >> 172.21.15.73:0/2806036628 conn(0x7f8bec06a570 msgr2=0x7f8bec0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2806036628 shutdown_connections 2023-12-19T16:16:13.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.588+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2806036628 wait complete. 2023-12-19T16:16:13.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 Processor -- start 2023-12-19T16:16:13.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- start start 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 0x7f8bec0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 0x7f8bec0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0c5660 con 0x7f8bec0cc160 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec146a90 con 0x7f8bec0cd520 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0c58b0 con 0x7f8bec146d50 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60866/0 (socket says 172.21.15.73:60866) 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2253239482 learned_addr learned my addr 172.21.15.73:0/2253239482 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf14ed640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 0x7f8bec0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf24ef640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 0x7f8bec0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 msgr2=0x7f8bec0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 0x7f8bec0c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 msgr2=0x7f8bec0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 0x7f8bec0ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 -- 172.21.15.73:0/2253239482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80094d0 con 0x7f8bec0cc160 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf14ed640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 0x7f8bec0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf24ef640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 0x7f8bec0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf1cee640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8be801abc0 tx=0x7f8be801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80b7620 con 0x7f8bec0cc160 2023-12-19T16:16:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80ace90 con 0x7f8bec0cc160 2023-12-19T16:16:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80b79e0 con 0x7f8bec0cc160 2023-12-19T16:16:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec0c5b90 con 0x7f8bec0cc160 2023-12-19T16:16:13.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.592+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0c6150 con 0x7f8bec0cc160 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec04e070 con 0x7f8bec0cc160 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8be80b3040 con 0x7f8bec0cc160 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8be27fc640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 0x7f8bd0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8be811d560 con 0x7f8bec0cc160 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8bf14ed640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 0x7f8bd0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.596+0000 7f8bf14ed640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 0x7f8bd0067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bec1f67f0 tx=0x7f8bdc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.600+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8be80eaf90 con 0x7f8bec0cc160 2023-12-19T16:16:13.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.748+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bec15c410 con 0x7f8bec0cc160 2023-12-19T16:16:13.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.748+0000 7f8be27fc640 1 -- 172.21.15.73:0/2253239482 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8be80ee5b0 con 0x7f8bec0cc160 2023-12-19T16:16:13.754 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:13.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 msgr2=0x7f8bd0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 0x7f8bd0067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bec1f67f0 tx=0x7f8bdc009040 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 msgr2=0x7f8bec146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8be801abc0 tx=0x7f8be801ad50 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 shutdown_connections 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bec146d50 0x7f8bec0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bec0cd520 0x7f8bec0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bd0065a60 0x7f8bd0067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 --2- 172.21.15.73:0/2253239482 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bec0cc160 0x7f8bec146550 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 >> 172.21.15.73:0/2253239482 conn(0x7f8bec06a570 msgr2=0x7f8bec1634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 shutdown_connections 2023-12-19T16:16:13.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.752+0000 7f8bf3f52640 1 -- 172.21.15.73:0/2253239482 wait complete. 2023-12-19T16:16:13.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:13.913 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.908+0000 7f4a5b212640 1 Processor -- start 2023-12-19T16:16:13.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.908+0000 7f4a5b212640 1 -- start start 2023-12-19T16:16:13.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.908+0000 7f4a5b212640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a5406d410 0x7f4a540b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.908+0000 7f4a5b212640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 0x7f4a540cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.908+0000 7f4a5b212640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540cce80 con 0x7f4a541598c0 2023-12-19T16:16:13.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a5b212640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a540b0b10 con 0x7f4a5406d410 2023-12-19T16:16:13.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a5b212640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540cc270 con 0x7f4a540b0660 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a5406d410 0x7f4a540b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a5406d410 0x7f4a540b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60876/0 (socket says 172.21.15.73:60876) 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 -- 172.21.15.73:0/2977013978 learned_addr learned my addr 172.21.15.73:0/2977013978 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a597af640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 0x7f4a540cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 -- 172.21.15.73:0/2977013978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 msgr2=0x7f4a540cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 0x7f4a540cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 -- 172.21.15.73:0/2977013978 >> v1:172.21.15.162:6789/0 conn(0x7f4a541598c0 legacy=0x7f4a5406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 -- 172.21.15.73:0/2977013978 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540cc550 con 0x7f4a5406d410 2023-12-19T16:16:13.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a597af640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 0x7f4a540cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:13.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a53fff640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540b0120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009870 tx=0x7f4a4001e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d14f449614c388 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a537fe640 1 -- 172.21.15.73:0/2977013978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400a86f0 con 0x7f4a5406d410 2023-12-19T16:16:13.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a537fe640 1 -- 172.21.15.73:0/2977013978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a400a8850 con 0x7f4a5406d410 2023-12-19T16:16:13.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.912+0000 7f4a537fe640 1 -- 172.21.15.73:0/2977013978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400a8be0 con 0x7f4a5406d410 2023-12-19T16:16:13.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- 172.21.15.73:0/2977013978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 msgr2=0x7f4a540b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540b0120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4a40009870 tx=0x7f4a4001e720 comp rx=0 tx=0).stop 2023-12-19T16:16:13.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- 172.21.15.73:0/2977013978 shutdown_connections 2023-12-19T16:16:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a540b0660 0x7f4a540cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- 172.21.15.73:0/2977013978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540b0120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- 172.21.15.73:0/2977013978 >> 172.21.15.73:0/2977013978 conn(0x7f4a5406a570 msgr2=0x7f4a540ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- 172.21.15.73:0/2977013978 shutdown_connections 2023-12-19T16:16:13.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- 172.21.15.73:0/2977013978 wait complete. 2023-12-19T16:16:13.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 Processor -- start 2023-12-19T16:16:13.921 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- start start 2023-12-19T16:16:13.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a540b0660 0x7f4a54156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a541598c0 0x7f4a54157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c7e80 con 0x7f4a5406d410 2023-12-19T16:16:13.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c5c40 con 0x7f4a540b0660 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a5b212640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540c5f20 con 0x7f4a541598c0 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a58fae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a58fae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60884/0 (socket says 172.21.15.73:60884) 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a58fae640 1 -- 172.21.15.73:0/1288208651 learned_addr learned my addr 172.21.15.73:0/1288208651 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a597af640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a541598c0 0x7f4a54157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.916+0000 7f4a53fff640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a540b0660 0x7f4a54156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 -- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a541598c0 msgr2=0x7f4a54157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a541598c0 0x7f4a54157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 -- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a540b0660 msgr2=0x7f4a54156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a540b0660 0x7f4a54156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 -- 172.21.15.73:0/1288208651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400094d0 con 0x7f4a5406d410 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a58fae640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c500 tx=0x7f4a4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48005220 con 0x7f4a5406d410 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48005380 con 0x7f4a5406d410 2023-12-19T16:16:13.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540c6200 con 0x7f4a5406d410 2023-12-19T16:16:13.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48007270 con 0x7f4a5406d410 2023-12-19T16:16:13.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a541565c0 con 0x7f4a5406d410 2023-12-19T16:16:13.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a540cbc40 con 0x7f4a5406d410 2023-12-19T16:16:13.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a480073d0 con 0x7f4a5406d410 2023-12-19T16:16:13.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.920+0000 7f4a517fa640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:13.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.924+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a480824d0 con 0x7f4a5406d410 2023-12-19T16:16:13.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.924+0000 7f4a53fff640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:13.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.924+0000 7f4a53fff640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 0x7f4a38067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a400b1000 tx=0x7f4a40008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:13.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:13.924+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4a4804ff30 con 0x7f4a5406d410 2023-12-19T16:16:14.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a5404e070 con 0x7f4a5406d410 2023-12-19T16:16:14.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a517fa640 1 -- 172.21.15.73:0/1288208651 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a48053550 con 0x7f4a5406d410 2023-12-19T16:16:14.080 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:14.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 msgr2=0x7f4a38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 0x7f4a38067f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4a400b1000 tx=0x7f4a40008040 comp rx=0 tx=0).stop 2023-12-19T16:16:14.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 msgr2=0x7f4a540c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c500 tx=0x7f4a4800c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 shutdown_connections 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a541598c0 0x7f4a54157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a540b0660 0x7f4a54156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a38065a60 0x7f4a38067f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 --2- 172.21.15.73:0/1288208651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a5406d410 0x7f4a540c5660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 >> 172.21.15.73:0/1288208651 conn(0x7f4a5406a570 msgr2=0x7f4a540af840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 shutdown_connections 2023-12-19T16:16:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.076+0000 7f4a5b212640 1 -- 172.21.15.73:0/1288208651 wait complete. 2023-12-19T16:16:14.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:14.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 Processor -- start 2023-12-19T16:16:14.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 -- start start 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4e80cdc40 0x7fb4e80ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e815ad00 con 0x7fb4e80b40b0 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e815e110 con 0x7fb4e80cdc40 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ee5ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80ce2d0 con 0x7fb4e8159830 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e77fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb4e80b40b0 0x7fb4e80cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:47472/0 (socket says 172.21.15.73:47472) 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e77fe640 1 -- 172.21.15.73:0/4215161472 learned_addr learned my addr 172.21.15.73:0/4215161472 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/4215161472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4ecb6b640 1 --2- 172.21.15.73:0/4215161472 >> v2:172.21.15.162:3300/0 conn(0x7fb4e80cdc40 0x7fb4e80ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e7fff640 1 -- 172.21.15.73:0/4215161472 >> v2:172.21.15.162:3300/0 conn(0x7fb4e80cdc40 msgr2=0x7fb4e80ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:14.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e6ffd640 1 -- 172.21.15.73:0/4215161472 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257399271 0 0) 0x7fb4e815ad00 con 0x7fb4e80b40b0 2023-12-19T16:16:14.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/4215161472 >> v2:172.21.15.162:3300/0 conn(0x7fb4e80cdc40 0x7fb4e80ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e7fff640 1 -- 172.21.15.73:0/4215161472 >> v1:172.21.15.162:6789/0 conn(0x7fb4e80b40b0 legacy=0x7fb4e80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.236+0000 7fb4e7fff640 1 -- 172.21.15.73:0/4215161472 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e815d490 con 0x7fb4e8159830 2023-12-19T16:16:14.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/4215161472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e815a7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097c0 tx=0x7fb4d801e5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b59b7a691260b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4e6ffd640 1 -- 172.21.15.73:0/4215161472 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80b2600 con 0x7fb4e8159830 2023-12-19T16:16:14.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4e6ffd640 1 -- 172.21.15.73:0/4215161472 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d80b2760 con 0x7fb4e8159830 2023-12-19T16:16:14.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4e6ffd640 1 -- 172.21.15.73:0/4215161472 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80b2af0 con 0x7fb4e8159830 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/4215161472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 msgr2=0x7fb4e815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/4215161472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e815a7c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097c0 tx=0x7fb4d801e5d0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/4215161472 shutdown_connections 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/4215161472 >> v2:172.21.15.162:3300/0 conn(0x7fb4e80cdc40 0x7fb4e80ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/4215161472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e815a7c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/4215161472 >> 172.21.15.73:0/4215161472 conn(0x7fb4e80b0270 msgr2=0x7fb4e80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/4215161472 shutdown_connections 2023-12-19T16:16:14.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.240+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/4215161472 wait complete. 2023-12-19T16:16:14.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 Processor -- start 2023-12-19T16:16:14.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- start start 2023-12-19T16:16:14.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e80b40b0 0x7fb4e80b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e80b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8152770 con 0x7fb4e80cdc40 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8152400 con 0x7fb4e80b40b0 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8158d60 con 0x7fb4e8159830 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60900/0 (socket says 172.21.15.73:60900) 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 -- 172.21.15.73:0/1906610214 learned_addr learned my addr 172.21.15.73:0/1906610214 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:14.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e80b40b0 0x7fb4e80b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ecb6b640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e80b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 -- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 msgr2=0x7fb4e80b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e80b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 -- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e80b40b0 msgr2=0x7fb4e80b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e80b40b0 0x7fb4e80b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 -- 172.21.15.73:0/1906610214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8009420 con 0x7fb4e80cdc40 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e77fe640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0011f0 tx=0x7fb4dc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0074e0 con 0x7fb4e80cdc40 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc007640 con 0x7fb4e80cdc40 2023-12-19T16:16:14.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8159040 con 0x7fb4e80cdc40 2023-12-19T16:16:14.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc004a10 con 0x7fb4e80cdc40 2023-12-19T16:16:14.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.244+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e8159320 con 0x7fb4e80cdc40 2023-12-19T16:16:14.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e81528b0 con 0x7fb4e80cdc40 2023-12-19T16:16:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4dc004b70 con 0x7fb4e80cdc40 2023-12-19T16:16:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4e4ff9640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 0x7fb4d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4dc082610 con 0x7fb4e80cdc40 2023-12-19T16:16:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 0x7fb4d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.248+0000 7fb4e7fff640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 0x7fb4d4067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80b1000 tx=0x7fb4d80b4040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.252+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb4e81528b0 con 0x7fb4e80cdc40 2023-12-19T16:16:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.416+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4e81528b0 con 0x7fb4e80cdc40 2023-12-19T16:16:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.416+0000 7fb4e4ff9640 1 -- 172.21.15.73:0/1906610214 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4e81528b0 con 0x7fb4e80cdc40 2023-12-19T16:16:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-19T16:16:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 msgr2=0x7fb4d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 0x7fb4d4067f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80b1000 tx=0x7fb4d80b4040 comp rx=0 tx=0).stop 2023-12-19T16:16:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 msgr2=0x7fb4e8156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0011f0 tx=0x7fb4dc00c9b0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 shutdown_connections 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4e8159830 0x7fb4e80b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb4d4065a60 0x7fb4d4067f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4e80cdc40 0x7fb4e8156d40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 --2- 172.21.15.73:0/1906610214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e80b40b0 0x7fb4e80b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 >> 172.21.15.73:0/1906610214 conn(0x7fb4e80b0270 msgr2=0x7fb4e806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 shutdown_connections 2023-12-19T16:16:14.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.420+0000 7fb4ee5ce640 1 -- 172.21.15.73:0/1906610214 wait complete. 2023-12-19T16:16:14.444 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-19T16:16:14.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:14.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-19T16:16:14.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:16:14.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:14.468 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T16:16:14.525 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:14.525 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:14.535 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:14.536 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:14.591 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:16:14.591 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:14.643 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:14.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 Processor -- start 2023-12-19T16:16:14.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 -- start start 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f2006ddf0 0x7f6f200cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f200cbe90 0x7f6f200cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2015cc80 0x7f6f20070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200cccb0 con 0x7f6f200cbe90 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200ca6f0 con 0x7f6f2006ddf0 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f27ed1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20159530 con 0x7f6f2015cc80 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f2546c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f200cbe90 0x7f6f200cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f2546c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f200cbe90 0x7f6f200cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60908/0 (socket says 172.21.15.73:60908) 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.776+0000 7f6f2546c640 1 -- 172.21.15.73:0/3777250476 learned_addr learned my addr 172.21.15.73:0/3777250476 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f25c6d640 1 --2- 172.21.15.73:0/3777250476 >> v2:172.21.15.162:3300/0 conn(0x7f6f2006ddf0 0x7f6f200cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2646e640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2015cc80 0x7f6f20070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 -- 172.21.15.73:0/3777250476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2015cc80 msgr2=0x7f6f20070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:14.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2015cc80 0x7f6f20070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 -- 172.21.15.73:0/3777250476 >> v2:172.21.15.162:3300/0 conn(0x7f6f2006ddf0 msgr2=0x7f6f200cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:14.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 --2- 172.21.15.73:0/3777250476 >> v2:172.21.15.162:3300/0 conn(0x7f6f2006ddf0 0x7f6f200cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 -- 172.21.15.73:0/3777250476 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200c9ae0 con 0x7f6f200cbe90 2023-12-19T16:16:14.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f2546c640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f200cd3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006fe20 tx=0x7f6f1001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492d11b2b716c6c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f24c6b640 1 -- 172.21.15.73:0/3777250476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100a7bb0 con 0x7f6f200cbe90 2023-12-19T16:16:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f24c6b640 1 -- 172.21.15.73:0/3777250476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100a7d10 con 0x7f6f200cbe90 2023-12-19T16:16:14.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f24c6b640 1 -- 172.21.15.73:0/3777250476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100af660 con 0x7f6f200cbe90 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f27ed1640 1 -- 172.21.15.73:0/3777250476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 msgr2=0x7f6f200cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.780+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f200cd3b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006fe20 tx=0x7f6f1001eba0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- 172.21.15.73:0/3777250476 shutdown_connections 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2015cc80 0x7f6f20070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/3777250476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f200cd3b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/3777250476 >> v2:172.21.15.162:3300/0 conn(0x7f6f2006ddf0 0x7f6f200cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- 172.21.15.73:0/3777250476 >> 172.21.15.73:0/3777250476 conn(0x7f6f200b0270 msgr2=0x7f6f200b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- 172.21.15.73:0/3777250476 shutdown_connections 2023-12-19T16:16:14.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- 172.21.15.73:0/3777250476 wait complete. 2023-12-19T16:16:14.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 Processor -- start 2023-12-19T16:16:14.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- start start 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 0x7f6f20154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 0x7f6f200b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20154740 con 0x7f6f200cbe90 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20154a20 con 0x7f6f2015cc80 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f27ed1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20154d00 con 0x7f6f2006ddf0 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60924/0 (socket says 172.21.15.73:60924) 2023-12-19T16:16:14.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 -- 172.21.15.73:0/1374572859 learned_addr learned my addr 172.21.15.73:0/1374572859 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f25c6d640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 0x7f6f20154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2646e640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 0x7f6f200b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 -- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 msgr2=0x7f6f20154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 0x7f6f20154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 -- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 msgr2=0x7f6f200b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 0x7f6f200b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 -- 172.21.15.73:0/1374572859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1000b770 con 0x7f6f200cbe90 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f25c6d640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 0x7f6f20154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2646e640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 0x7f6f200b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.784+0000 7f6f2546c640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001d250 tx=0x7f6f1001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100a7bb0 con 0x7f6f200cbe90 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100ba440 con 0x7f6f200cbe90 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f20154fe0 con 0x7f6f200cbe90 2023-12-19T16:16:14.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100ba7d0 con 0x7f6f200cbe90 2023-12-19T16:16:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201512c0 con 0x7f6f200cbe90 2023-12-19T16:16:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20155500 con 0x7f6f200cbe90 2023-12-19T16:16:14.793 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f100b93e0 con 0x7f6f200cbe90 2023-12-19T16:16:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 0x7f6f04067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f1011dba0 con 0x7f6f200cbe90 2023-12-19T16:16:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f25c6d640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 0x7f6f04067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:14.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.788+0000 7f6f25c6d640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 0x7f6f04067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004660 tx=0x7f6f1c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:14.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.792+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f20155500 con 0x7f6f200cbe90 2023-12-19T16:16:14.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f20155500 con 0x7f6f200cbe90 2023-12-19T16:16:14.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f167fc640 1 -- 172.21.15.73:0/1374572859 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f6f1011aec0 con 0x7f6f200cbe90 2023-12-19T16:16:14.949 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:14.949 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 msgr2=0x7f6f04067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 0x7f6f04067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004660 tx=0x7f6f1c008040 comp rx=0 tx=0).stop 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 msgr2=0x7f6f20150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001d250 tx=0x7f6f1001b940 comp rx=0 tx=0).stop 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 shutdown_connections 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f2015cc80 0x7f6f200b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6f04065a60 0x7f6f04067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200cbe90 0x7f6f20150d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.944+0000 7f6f27ed1640 1 --2- 172.21.15.73:0/1374572859 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f2006ddf0 0x7f6f20154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.948+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 >> 172.21.15.73:0/1374572859 conn(0x7f6f200b0270 msgr2=0x7f6f200ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.948+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 shutdown_connections 2023-12-19T16:16:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:14.948+0000 7f6f27ed1640 1 -- 172.21.15.73:0/1374572859 wait complete. 2023-12-19T16:16:14.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:14.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.104+0000 7fac30552640 1 Processor -- start 2023-12-19T16:16:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.104+0000 7fac30552640 1 -- start start 2023-12-19T16:16:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac30552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fac281598c0 0x7fac2806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac30552640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac2806d410 0x7fac280b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac30552640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac280cce80 con 0x7fac280b0660 2023-12-19T16:16:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac30552640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac280b0af0 con 0x7fac2806d410 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac30552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2806cad0 con 0x7fac281598c0 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac2806d410 0x7fac280b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac2806d410 0x7fac280b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59802/0 (socket says 172.21.15.73:59802) 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 -- 172.21.15.73:0/3419135655 learned_addr learned my addr 172.21.15.73:0/3419135655 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2e2ee640 1 --2- 172.21.15.73:0/3419135655 >> v2:172.21.15.162:3300/0 conn(0x7fac281598c0 0x7fac2806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 -- 172.21.15.73:0/3419135655 >> v2:172.21.15.162:3300/0 conn(0x7fac281598c0 msgr2=0x7fac2806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 --2- 172.21.15.73:0/3419135655 >> v2:172.21.15.162:3300/0 conn(0x7fac281598c0 0x7fac2806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 -- 172.21.15.73:0/3419135655 >> v1:172.21.15.162:6789/0 conn(0x7fac280b0660 legacy=0x7fac280c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.108+0000 7fac2daed640 1 -- 172.21.15.73:0/3419135655 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280cc270 con 0x7fac2806d410 2023-12-19T16:16:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac2daed640 1 --2- 172.21.15.73:0/3419135655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac280b0120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac280cf690 tx=0x7fac1801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8936be62b0bf38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac2d2ec640 1 -- 172.21.15.73:0/3419135655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180aa660 con 0x7fac2806d410 2023-12-19T16:16:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac2d2ec640 1 -- 172.21.15.73:0/3419135655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180aa7c0 con 0x7fac2806d410 2023-12-19T16:16:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac2d2ec640 1 -- 172.21.15.73:0/3419135655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180aab50 con 0x7fac2806d410 2023-12-19T16:16:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- 172.21.15.73:0/3419135655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 msgr2=0x7fac280b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 --2- 172.21.15.73:0/3419135655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac280b0120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fac280cf690 tx=0x7fac1801c500 comp rx=0 tx=0).stop 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- 172.21.15.73:0/3419135655 shutdown_connections 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 --2- 172.21.15.73:0/3419135655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac280b0120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 --2- 172.21.15.73:0/3419135655 >> v2:172.21.15.162:3300/0 conn(0x7fac281598c0 0x7fac2806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- 172.21.15.73:0/3419135655 >> 172.21.15.73:0/3419135655 conn(0x7fac2806a570 msgr2=0x7fac280ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- 172.21.15.73:0/3419135655 shutdown_connections 2023-12-19T16:16:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- 172.21.15.73:0/3419135655 wait complete. 2023-12-19T16:16:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 Processor -- start 2023-12-19T16:16:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.112+0000 7fac30552640 1 -- start start 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac280b0660 0x7fac281576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 0x7fac28157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28158840 con 0x7fac2806d410 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28158280 con 0x7fac281598c0 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac28158560 con 0x7fac280b0660 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59806/0 (socket says 172.21.15.73:59806) 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 -- 172.21.15.73:0/2987918781 learned_addr learned my addr 172.21.15.73:0/2987918781 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 -- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac280b0660 msgr2=0x7fac281576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2daed640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac280b0660 0x7fac281576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2eaef640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 0x7fac28157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac280b0660 0x7fac281576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 -- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 msgr2=0x7fac28157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 0x7fac28157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 -- 172.21.15.73:0/2987918781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180094d0 con 0x7fac2806d410 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2eaef640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 0x7fac28157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac2e2ee640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fac2400d800 tx=0x7fac2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400b6c0 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2400b820 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2400bb90 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac280b2220 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac280c16e0 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac280b2080 con 0x7fac2806d410 2023-12-19T16:16:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.116+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac2400bcf0 con 0x7fac2806d410 2023-12-19T16:16:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.120+0000 7fac1effd640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.120+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac24083720 con 0x7fac2806d410 2023-12-19T16:16:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.120+0000 7fac2daed640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.120+0000 7fac2daed640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 0x7fac0c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac180ae000 tx=0x7fac18008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.124+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac280b2080 con 0x7fac2806d410 2023-12-19T16:16:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac280b2080 con 0x7fac2806d410 2023-12-19T16:16:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac1effd640 1 -- 172.21.15.73:0/2987918781 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac280b2080 con 0x7fac2806d410 2023-12-19T16:16:15.276 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:15.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 msgr2=0x7fac0c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 0x7fac0c067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fac180ae000 tx=0x7fac18008040 comp rx=0 tx=0).stop 2023-12-19T16:16:15.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 msgr2=0x7fac28154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fac2400d800 tx=0x7fac2400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 shutdown_connections 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac281598c0 0x7fac28157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac280b0660 0x7fac281576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fac0c065a60 0x7fac0c067f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 --2- 172.21.15.73:0/2987918781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac2806d410 0x7fac28154f30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 >> 172.21.15.73:0/2987918781 conn(0x7fac2806a570 msgr2=0x7fac2806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 shutdown_connections 2023-12-19T16:16:15.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.272+0000 7fac30552640 1 -- 172.21.15.73:0/2987918781 wait complete. 2023-12-19T16:16:15.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:15.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 Processor -- start 2023-12-19T16:16:15.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 -- start start 2023-12-19T16:16:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 0x7f11d00ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 0x7f11d00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d00ca9f0 con 0x7f11d00cc6a0 2023-12-19T16:16:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00c9760 con 0x7f11d00b0190 2023-12-19T16:16:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11d5d7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c99d0 con 0x7f11d0159230 2023-12-19T16:16:15.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11cf7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 0x7f11d00ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.436+0000 7f11cffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f11d00cc6a0 0x7f11d00cce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:51424/0 (socket says 172.21.15.73:51424) 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cffff640 1 -- 172.21.15.73:0/3973447327 learned_addr learned my addr 172.21.15.73:0/3973447327 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11c7fff640 1 --2- 172.21.15.73:0/3973447327 >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 0x7f11d00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11ceffd640 1 -- 172.21.15.73:0/3973447327 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996068173 0 0) 0x7f11c80014a0 con 0x7f11d00cc6a0 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11ceffd640 1 -- 172.21.15.73:0/3973447327 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11bc003530 con 0x7f11d00cc6a0 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cf7fe640 1 -- 172.21.15.73:0/3973447327 >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 msgr2=0x7f11d00cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cf7fe640 1 --2- 172.21.15.73:0/3973447327 >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 0x7f11d00cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cf7fe640 1 -- 172.21.15.73:0/3973447327 >> v1:172.21.15.162:6789/0 conn(0x7f11d00cc6a0 legacy=0x7f11d00cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cf7fe640 1 -- 172.21.15.73:0/3973447327 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00c9cb0 con 0x7f11d0159230 2023-12-19T16:16:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11c7fff640 1 --2- 172.21.15.73:0/3973447327 >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 0x7f11d00cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:15.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11cf7fe640 1 --2- 172.21.15.73:0/3973447327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 0x7f11d00ca4b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11c00097c0 tx=0x7f11c001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7876e171a7bc44c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11ceffd640 1 -- 172.21.15.73:0/3973447327 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00ab670 con 0x7f11d0159230 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11ceffd640 1 -- 172.21.15.73:0/3973447327 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00ab7d0 con 0x7f11d0159230 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.440+0000 7f11ceffd640 1 -- 172.21.15.73:0/3973447327 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00abb60 con 0x7f11d0159230 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- 172.21.15.73:0/3973447327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 msgr2=0x7f11d00ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/3973447327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 0x7f11d00ca4b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11c00097c0 tx=0x7f11c001c450 comp rx=0 tx=0).stop 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- 172.21.15.73:0/3973447327 shutdown_connections 2023-12-19T16:16:15.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/3973447327 >> v2:172.21.15.162:3300/0 conn(0x7f11d00b0190 0x7f11d00cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/3973447327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d0159230 0x7f11d00ca4b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- 172.21.15.73:0/3973447327 >> 172.21.15.73:0/3973447327 conn(0x7f11d006a570 msgr2=0x7f11d00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- 172.21.15.73:0/3973447327 shutdown_connections 2023-12-19T16:16:15.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- 172.21.15.73:0/3973447327 wait complete. 2023-12-19T16:16:15.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 Processor -- start 2023-12-19T16:16:15.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- start start 2023-12-19T16:16:15.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00b0190 0x7f11d01fc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 0x7f11d01fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 0x7f11d00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b31f0 con 0x7f11d0159230 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b25e0 con 0x7f11d00cc6a0 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11d5d7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b28c0 con 0x7f11d00b0190 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11cffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 0x7f11d00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 0x7f11d01fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11c7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 0x7f11d01fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:36626/0 (socket says 172.21.15.73:36626) 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11c7fff640 1 -- 172.21.15.73:0/1898981978 learned_addr learned my addr 172.21.15.73:0/1898981978 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.444+0000 7f11cf7fe640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00b0190 0x7f11d01fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 -- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00b0190 msgr2=0x7f11d01fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00b0190 0x7f11d01fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 -- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 msgr2=0x7f11d01fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 0x7f11d01fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 -- 172.21.15.73:0/1898981978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8009420 con 0x7f11d0159230 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cffff640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 0x7f11d00b18b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11c800caa0 tx=0x7f11c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800ac00 con 0x7f11d0159230 2023-12-19T16:16:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800ad60 con 0x7f11d0159230 2023-12-19T16:16:15.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c0009420 con 0x7f11d0159230 2023-12-19T16:16:15.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8012600 con 0x7f11d0159230 2023-12-19T16:16:15.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00b2e80 con 0x7f11d0159230 2023-12-19T16:16:15.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00b33a0 con 0x7f11d0159230 2023-12-19T16:16:15.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11c8007070 con 0x7f11d0159230 2023-12-19T16:16:15.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11c8082b10 con 0x7f11d0159230 2023-12-19T16:16:15.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.448+0000 7f11cf7fe640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.452+0000 7f11cf7fe640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11c00af000 tx=0x7f11c00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.452+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11d00b33a0 con 0x7f11d0159230 2023-12-19T16:16:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11d00ca9f0 con 0x7f11d0159230 2023-12-19T16:16:15.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11ccff9640 1 -- 172.21.15.73:0/1898981978 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11c8017020 con 0x7f11d0159230 2023-12-19T16:16:15.608 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 msgr2=0x7f11b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11c00af000 tx=0x7f11c00a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 msgr2=0x7f11d00b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 0x7f11d00b18b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f11c800caa0 tx=0x7f11c800cf60 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 shutdown_connections 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159230 0x7f11d00b18b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d00cc6a0 0x7f11d01fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 --2- 172.21.15.73:0/1898981978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00b0190 0x7f11d01fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 >> 172.21.15.73:0/1898981978 conn(0x7f11d006a570 msgr2=0x7f11d015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 shutdown_connections 2023-12-19T16:16:15.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.604+0000 7f11d5d7b640 1 -- 172.21.15.73:0/1898981978 wait complete. 2023-12-19T16:16:15.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 Processor -- start 2023-12-19T16:16:15.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 -- start start 2023-12-19T16:16:15.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00681598c0 0x7f006806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00680b0830 0x7f00680cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00680cce80 con 0x7f006806d410 2023-12-19T16:16:15.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006806cad0 con 0x7f00680b0830 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f006dc95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680cc270 con 0x7f00681598c0 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f0067fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00680b0830 0x7f00680cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f0067fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00680b0830 0x7f00680cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59818/0 (socket says 172.21.15.73:59818) 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f0067fff640 1 -- 172.21.15.73:0/2836614326 learned_addr learned my addr 172.21.15.73:0/2836614326 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.764+0000 7f00677fe640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00681598c0 0x7f006806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f0067fff640 1 -- 172.21.15.73:0/2836614326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00681598c0 msgr2=0x7f006806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f0067fff640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00681598c0 0x7f006806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f0067fff640 1 -- 172.21.15.73:0/2836614326 >> v1:172.21.15.162:6789/0 conn(0x7f006806d410 legacy=0x7f00680b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f0067fff640 1 -- 172.21.15.73:0/2836614326 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680cc550 con 0x7f00680b0830 2023-12-19T16:16:15.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f0067fff640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680cd310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f006000d150 tx=0x7f006001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6827d3f67f5ce6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f00667fc640 1 -- 172.21.15.73:0/2836614326 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000b2d0 con 0x7f00680b0830 2023-12-19T16:16:15.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f00667fc640 1 -- 172.21.15.73:0/2836614326 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006000b430 con 0x7f00680b0830 2023-12-19T16:16:15.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f00667fc640 1 -- 172.21.15.73:0/2836614326 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600a7cd0 con 0x7f00680b0830 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 -- 172.21.15.73:0/2836614326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 msgr2=0x7f00680cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680cd310 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f006000d150 tx=0x7f006001ebe0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 -- 172.21.15.73:0/2836614326 shutdown_connections 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680cd310 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 --2- 172.21.15.73:0/2836614326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00681598c0 0x7f006806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 -- 172.21.15.73:0/2836614326 >> 172.21.15.73:0/2836614326 conn(0x7f006806a570 msgr2=0x7f00680ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.768+0000 7f006dc95640 1 -- 172.21.15.73:0/2836614326 shutdown_connections 2023-12-19T16:16:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 -- 172.21.15.73:0/2836614326 wait complete. 2023-12-19T16:16:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 Processor -- start 2023-12-19T16:16:15.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 -- start start 2023-12-19T16:16:15.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 0x7f00680c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00681598c0 0x7f00680ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006813dd00 con 0x7f00680b0830 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006813dfe0 con 0x7f00681598c0 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f006dc95640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006813e2c0 con 0x7f006806d410 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59834/0 (socket says 172.21.15.73:59834) 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 -- 172.21.15.73:0/1493434103 learned_addr learned my addr 172.21.15.73:0/1493434103 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0067fff640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00681598c0 0x7f00680ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f00677fe640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 0x7f00680c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 -- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 msgr2=0x7f00680c0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 0x7f00680c0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 -- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00681598c0 msgr2=0x7f00680ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00681598c0 0x7f00680ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 -- 172.21.15.73:0/1493434103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006000bd40 con 0x7f00680b0830 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f00677fe640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 0x7f00680c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f0066ffd640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c500 tx=0x7f005c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.772+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c005220 con 0x7f00680b0830 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c005380 con 0x7f00680b0830 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006813e5a0 con 0x7f00680b0830 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c007270 con 0x7f00680b0830 2023-12-19T16:16:15.781 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680c1060 con 0x7f00680b0830 2023-12-19T16:16:15.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00680c4b30 con 0x7f00680b0830 2023-12-19T16:16:15.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f005c0073d0 con 0x7f00680b0830 2023-12-19T16:16:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f004ffff640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 0x7f0054067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f005c082a70 con 0x7f00680b0830 2023-12-19T16:16:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f00677fe640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 0x7f0054067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.776+0000 7f00677fe640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 0x7f0054067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00680af830 tx=0x7f0058008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:15.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.780+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f005c0503a0 con 0x7f00680b0830 2023-12-19T16:16:15.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.928+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f006804e070 con 0x7f00680b0830 2023-12-19T16:16:15.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.928+0000 7f004ffff640 1 -- 172.21.15.73:0/1493434103 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f005c0539c0 con 0x7f00680b0830 2023-12-19T16:16:15.934 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 msgr2=0x7f0054067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 0x7f0054067f20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f00680af830 tx=0x7f0058008040 comp rx=0 tx=0).stop 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 msgr2=0x7f00680a74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f005c00c500 tx=0x7f005c00c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 shutdown_connections 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00681598c0 0x7f00680ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0054065a60 0x7f0054067f20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00680b0830 0x7f00680a74d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 --2- 172.21.15.73:0/1493434103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f006806d410 0x7f00680c0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 >> 172.21.15.73:0/1493434103 conn(0x7f006806a570 msgr2=0x7f00680aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 shutdown_connections 2023-12-19T16:16:15.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:15.932+0000 7f006dc95640 1 -- 172.21.15.73:0/1493434103 wait complete. 2023-12-19T16:16:15.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:16:16.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 Processor -- start 2023-12-19T16:16:16.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 -- start start 2023-12-19T16:16:16.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40cdc40 0x7fdde415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdde40b40b0 0x7fdde40ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde415ad00 con 0x7fdde4159830 2023-12-19T16:16:16.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde415e110 con 0x7fdde40b40b0 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fddea02d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40ce2d0 con 0x7fdde40cdc40 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdde40b40b0 0x7fdde40ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdde40b40b0 0x7fdde40ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59840/0 (socket says 172.21.15.73:59840) 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 -- 172.21.15.73:0/465884579 learned_addr learned my addr 172.21.15.73:0/465884579 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde2ffd640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40cdc40 0x7fdde415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 -- 172.21.15.73:0/465884579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40cdc40 msgr2=0x7fdde415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40cdc40 0x7fdde415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 -- 172.21.15.73:0/465884579 >> v1:172.21.15.162:6789/0 conn(0x7fdde4159830 legacy=0x7fdde40cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.088+0000 7fdde3fff640 1 -- 172.21.15.73:0/465884579 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde415d490 con 0x7fdde40b40b0 2023-12-19T16:16:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fdde3fff640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde40b40b0 0x7fdde40ca080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e50 tx=0x7fdddc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9043364098330faa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fdde27fc640 1 -- 172.21.15.73:0/465884579 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0a5810 con 0x7fdde40b40b0 2023-12-19T16:16:16.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fdde27fc640 1 -- 172.21.15.73:0/465884579 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc0a5970 con 0x7fdde40b40b0 2023-12-19T16:16:16.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fdde27fc640 1 -- 172.21.15.73:0/465884579 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0a5d00 con 0x7fdde40b40b0 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 -- 172.21.15.73:0/465884579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde40b40b0 msgr2=0x7fdde40ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde40b40b0 0x7fdde40ca080 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009e50 tx=0x7fdddc01c950 comp rx=0 tx=0).stop 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 -- 172.21.15.73:0/465884579 shutdown_connections 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde40b40b0 0x7fdde40ca080 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 --2- 172.21.15.73:0/465884579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40cdc40 0x7fdde415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 -- 172.21.15.73:0/465884579 >> 172.21.15.73:0/465884579 conn(0x7fdde40b0270 msgr2=0x7fdde40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 -- 172.21.15.73:0/465884579 shutdown_connections 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.092+0000 7fddea02d640 1 -- 172.21.15.73:0/465884579 wait complete. 2023-12-19T16:16:16.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 Processor -- start 2023-12-19T16:16:16.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- start start 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40b40b0 0x7fdde415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdde40cdc40 0x7fdde40b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b3210 con 0x7fdde4159830 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde40b2f30 con 0x7fdde40cdc40 2023-12-19T16:16:16.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde41632b0 con 0x7fdde40b40b0 2023-12-19T16:16:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59852/0 (socket says 172.21.15.73:59852) 2023-12-19T16:16:16.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 -- 172.21.15.73:0/1673081186 learned_addr learned my addr 172.21.15.73:0/1673081186 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:16.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde37fe640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40b40b0 0x7fdde415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde2ffd640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdde40cdc40 0x7fdde40b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 -- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40b40b0 msgr2=0x7fdde415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40b40b0 0x7fdde415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 -- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdde40cdc40 msgr2=0x7fdde40b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdde40cdc40 0x7fdde40b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 -- 172.21.15.73:0/1673081186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009b30 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fdde3fff640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdddc01a580 tx=0x7fdddc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0b8670 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdddc0b87d0 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde4163590 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0b8b80 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.096+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde4164460 con 0x7fdde4159830 2023-12-19T16:16:16.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde4074050 con 0x7fdde4159830 2023-12-19T16:16:16.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdddc0b8ce0 con 0x7fdde4159830 2023-12-19T16:16:16.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fddcbfff640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 0x7fddd0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdddc11e810 con 0x7fdde4159830 2023-12-19T16:16:16.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fdde37fe640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 0x7fddd0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.100+0000 7fdde37fe640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 0x7fddd0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdde40c5270 tx=0x7fddd4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.104+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdddc0ec3a0 con 0x7fdde4159830 2023-12-19T16:16:16.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.264+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdde40cbfc0 con 0x7fdde4159830 2023-12-19T16:16:16.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.264+0000 7fddcbfff640 1 -- 172.21.15.73:0/1673081186 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdddc0ef9c0 con 0x7fdde4159830 2023-12-19T16:16:16.270 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2023-12-19T16:16:16.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 msgr2=0x7fddd0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 0x7fddd0067f20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdde40c5270 tx=0x7fddd4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 msgr2=0x7fdde40b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdddc01a580 tx=0x7fdddc0196f0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 shutdown_connections 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fddd0065a60 0x7fddd0067f20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdde4159830 0x7fdde40b28b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdde40cdc40 0x7fdde40b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 --2- 172.21.15.73:0/1673081186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdde40b40b0 0x7fdde415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 >> 172.21.15.73:0/1673081186 conn(0x7fdde40b0270 msgr2=0x7fdde40c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 shutdown_connections 2023-12-19T16:16:16.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.268+0000 7fddea02d640 1 -- 172.21.15.73:0/1673081186 wait complete. 2023-12-19T16:16:16.291 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-19T16:16:16.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:16.291 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-19T16:16:16.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:16:16.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:16.318 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T16:16:16.369 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T16:16:16.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 Processor -- start 2023-12-19T16:16:16.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 -- start start 2023-12-19T16:16:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2bb8159830 0x7f2bb815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb815ad00 con 0x7f2bb80cdc40 2023-12-19T16:16:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80ce2d0 con 0x7f2bb80b40b0 2023-12-19T16:16:16.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bc0012640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb815e110 con 0x7f2bb8159830 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbddae640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2bb8159830 0x7f2bb815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbe5af640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2bb80cdc40 0x7f2bb80ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56154/0 (socket says 172.21.15.73:56154) 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbe5af640 1 -- 172.21.15.73:0/3012821603 learned_addr learned my addr 172.21.15.73:0/3012821603 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbddae640 1 -- 172.21.15.73:0/3012821603 >> v1:172.21.15.162:6789/0 conn(0x7f2bb80b40b0 legacy=0x7f2bb80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbddae640 1 -- 172.21.15.73:0/3012821603 >> v1:172.21.15.73:6789/0 conn(0x7f2bb80cdc40 legacy=0x7f2bb80ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbddae640 1 -- 172.21.15.73:0/3012821603 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb815d490 con 0x7f2bb8159830 2023-12-19T16:16:16.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.504+0000 7f2bbcdac640 1 -- 172.21.15.73:0/3012821603 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149433286 0 0) 0x7f2bb815ad00 con 0x7f2bb80cdc40 2023-12-19T16:16:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bbddae640 1 --2- 172.21.15.73:0/3012821603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8159830 0x7f2bb815a7c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40097c0 tx=0x7f2bb401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dcf76a707b6ab9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bbcdac640 1 -- 172.21.15.73:0/3012821603 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40ad680 con 0x7f2bb8159830 2023-12-19T16:16:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bbcdac640 1 -- 172.21.15.73:0/3012821603 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb40ad7e0 con 0x7f2bb8159830 2023-12-19T16:16:16.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bbcdac640 1 -- 172.21.15.73:0/3012821603 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40adb70 con 0x7f2bb8159830 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 -- 172.21.15.73:0/3012821603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8159830 msgr2=0x7f2bb815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 --2- 172.21.15.73:0/3012821603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8159830 0x7f2bb815a7c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40097c0 tx=0x7f2bb401c380 comp rx=0 tx=0).stop 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 -- 172.21.15.73:0/3012821603 shutdown_connections 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 --2- 172.21.15.73:0/3012821603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8159830 0x7f2bb815a7c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 -- 172.21.15.73:0/3012821603 >> 172.21.15.73:0/3012821603 conn(0x7f2bb80b0270 msgr2=0x7f2bb80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 -- 172.21.15.73:0/3012821603 shutdown_connections 2023-12-19T16:16:16.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.508+0000 7f2bc0012640 1 -- 172.21.15.73:0/3012821603 wait complete. 2023-12-19T16:16:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 Processor -- start 2023-12-19T16:16:16.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- start start 2023-12-19T16:16:16.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bb80cdc40 0x7f2bb814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 0x7f2bb80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb814f300 con 0x7f2bb80b40b0 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80ae0e0 con 0x7f2bb8159830 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80ae330 con 0x7f2bb80cdc40 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59866/0 (socket says 172.21.15.73:59866) 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 -- 172.21.15.73:0/1539513105 learned_addr learned my addr 172.21.15.73:0/1539513105 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:16.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbe5af640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 0x7f2bb80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbd5ad640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bb80cdc40 0x7f2bb814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 -- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bb80cdc40 msgr2=0x7f2bb814ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bb80cdc40 0x7f2bb814ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 -- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 msgr2=0x7f2bb80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 0x7f2bb80cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 -- 172.21.15.73:0/1539513105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4009420 con 0x7f2bb80b40b0 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbe5af640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 0x7f2bb80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bbddae640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4019fb0 tx=0x7f2bb4019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40ade20 con 0x7f2bb80b40b0 2023-12-19T16:16:16.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb4004030 con 0x7f2bb80b40b0 2023-12-19T16:16:16.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40043c0 con 0x7f2bb80b40b0 2023-12-19T16:16:16.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb80ae610 con 0x7f2bb80b40b0 2023-12-19T16:16:16.521 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.512+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80aebd0 con 0x7f2bb80b40b0 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb80aedc0 con 0x7f2bb80b40b0 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2bb40b4040 con 0x7f2bb80b40b0 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bae7fc640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 0x7f2b9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bb411d530 con 0x7f2bb80b40b0 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bbd5ad640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 0x7f2b9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.516+0000 7f2bbd5ad640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 0x7f2b9c067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bb81f8b90 tx=0x7f2ba8007e40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.520+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2bb40eb020 con 0x7f2bb80b40b0 2023-12-19T16:16:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bb8074050 con 0x7f2bb80b40b0 2023-12-19T16:16:16.704 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bae7fc640 1 -- 172.21.15.73:0/1539513105 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f2bb40ee640 con 0x7f2bb80b40b0 2023-12-19T16:16:16.705 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:16.705 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:16.705 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:16:16.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 msgr2=0x7f2b9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 0x7f2b9c067f20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bb81f8b90 tx=0x7f2ba8007e40 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 msgr2=0x7f2bb814e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4019fb0 tx=0x7f2bb4019120 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 shutdown_connections 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bb8159830 0x7f2bb80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2bb80cdc40 0x7f2bb814ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2b9c065a60 0x7f2b9c067f20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 --2- 172.21.15.73:0/1539513105 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb80b40b0 0x7f2bb814e4a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 >> 172.21.15.73:0/1539513105 conn(0x7f2bb80b0270 msgr2=0x7f2bb806d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 shutdown_connections 2023-12-19T16:16:16.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.700+0000 7f2bc0012640 1 -- 172.21.15.73:0/1539513105 wait complete. 2023-12-19T16:16:16.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.856+0000 7fcae31a2640 1 Processor -- start 2023-12-19T16:16:16.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.856+0000 7fcae31a2640 1 -- start start 2023-12-19T16:16:16.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae31a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcadc160610 0x7fcadc160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae31a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc06cea0 con 0x7fcadc06ca30 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae31a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0d0cf0 con 0x7fcadc15ca80 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae31a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc160fa0 con 0x7fcadc160610 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae29a1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcadc160610 0x7fcadc160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae199f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcadc06ca30 0x7fcadc15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56166/0 (socket says 172.21.15.73:56166) 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae29a1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcadc160610 0x7fcadc160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59872/0 (socket says 172.21.15.73:59872) 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae199f640 1 -- 172.21.15.73:0/1033557411 learned_addr learned my addr 172.21.15.73:0/1033557411 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae29a1640 1 -- 172.21.15.73:0/1033557411 >> v1:172.21.15.162:6789/0 conn(0x7fcadc15ca80 legacy=0x7fcadc0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae29a1640 1 -- 172.21.15.73:0/1033557411 >> v1:172.21.15.73:6789/0 conn(0x7fcadc06ca30 legacy=0x7fcadc15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae29a1640 1 -- 172.21.15.73:0/1033557411 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0d0fd0 con 0x7fcadc160610 2023-12-19T16:16:16.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.860+0000 7fcae119e640 1 -- 172.21.15.73:0/1033557411 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839306829 0 0) 0x7fcacc001120 con 0x7fcadc06ca30 2023-12-19T16:16:16.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae29a1640 1 --2- 172.21.15.73:0/1033557411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc160610 0x7fcadc160a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009d90 tx=0x7fcad401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab09678c40b74f19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae119e640 1 -- 172.21.15.73:0/1033557411 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40a5830 con 0x7fcadc160610 2023-12-19T16:16:16.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae119e640 1 -- 172.21.15.73:0/1033557411 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad40a5990 con 0x7fcadc160610 2023-12-19T16:16:16.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae119e640 1 -- 172.21.15.73:0/1033557411 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40a5d20 con 0x7fcadc160610 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- 172.21.15.73:0/1033557411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc160610 msgr2=0x7fcadc160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 --2- 172.21.15.73:0/1033557411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc160610 0x7fcadc160a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcad4009d90 tx=0x7fcad401c880 comp rx=0 tx=0).stop 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- 172.21.15.73:0/1033557411 shutdown_connections 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 --2- 172.21.15.73:0/1033557411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc160610 0x7fcadc160a60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- 172.21.15.73:0/1033557411 >> 172.21.15.73:0/1033557411 conn(0x7fcadc0658e0 msgr2=0x7fcadc065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- 172.21.15.73:0/1033557411 shutdown_connections 2023-12-19T16:16:16.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- 172.21.15.73:0/1033557411 wait complete. 2023-12-19T16:16:16.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 Processor -- start 2023-12-19T16:16:16.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.864+0000 7fcae31a2640 1 -- start start 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 0x7fcadc152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc160610 0x7fcadc0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc1539c0 con 0x7fcadc06ca30 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc153ca0 con 0x7fcadc160610 2023-12-19T16:16:16.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc153f80 con 0x7fcadc15ca80 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59874/0 (socket says 172.21.15.73:59874) 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 -- 172.21.15.73:0/4272775552 learned_addr learned my addr 172.21.15.73:0/4272775552 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae199f640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 0x7fcadc152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae29a1640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc160610 0x7fcadc0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 -- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 msgr2=0x7fcadc152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 0x7fcadc152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 -- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc160610 msgr2=0x7fcadc0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc160610 0x7fcadc0b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 -- 172.21.15.73:0/4272775552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4009a70 con 0x7fcadc06ca30 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae199f640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 0x7fcadc152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:16.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae21a0640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c450 tx=0x7fcad800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8012830 con 0x7fcadc06ca30 2023-12-19T16:16:16.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80129b0 con 0x7fcadc06ca30 2023-12-19T16:16:16.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc154260 con 0x7fcadc06ca30 2023-12-19T16:16:16.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8012d60 con 0x7fcadc06ca30 2023-12-19T16:16:16.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc158e60 con 0x7fcadc06ca30 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc04e000 con 0x7fcadc06ca30 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.868+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcad801c460 con 0x7fcadc06ca30 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.872+0000 7fcad2ffd640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 0x7fcac0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.872+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcad8082f50 con 0x7fcadc06ca30 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.872+0000 7fcae199f640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 0x7fcac0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:16.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.872+0000 7fcae199f640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 0x7fcac0067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0c4190 tx=0x7fcacc007a60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:16.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:16.876+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcad8050900 con 0x7fcadc06ca30 2023-12-19T16:16:17.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.024+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcadc0b6650 con 0x7fcadc06ca30 2023-12-19T16:16:17.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.024+0000 7fcad2ffd640 1 -- 172.21.15.73:0/4272775552 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fcad8053f20 con 0x7fcadc06ca30 2023-12-19T16:16:17.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:17.030 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 msgr2=0x7fcac0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 0x7fcac0067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0c4190 tx=0x7fcacc007a60 comp rx=0 tx=0).stop 2023-12-19T16:16:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 msgr2=0x7fcadc158920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c450 tx=0x7fcad800c910 comp rx=0 tx=0).stop 2023-12-19T16:16:17.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 shutdown_connections 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcadc160610 0x7fcadc0b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcadc15ca80 0x7fcadc152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcac0065a60 0x7fcac0067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 --2- 172.21.15.73:0/4272775552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcadc06ca30 0x7fcadc158920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 >> 172.21.15.73:0/4272775552 conn(0x7fcadc0658e0 msgr2=0x7fcadc15d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 shutdown_connections 2023-12-19T16:16:17.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.028+0000 7fcae31a2640 1 -- 172.21.15.73:0/4272775552 wait complete. 2023-12-19T16:16:17.051 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:15:38.776033+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:15:39.511943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:17.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:17.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 Processor -- start 2023-12-19T16:16:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 -- start start 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 0x7f8db00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db00cce80 con 0x7f8db01598c0 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db00b0ae0 con 0x7f8db00b0660 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db66e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00cc270 con 0x7f8db006d410 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:56080/0 (socket says 172.21.15.73:56080) 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db4c82640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 0x7f8db00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3006294951 learned_addr learned my addr 172.21.15.73:0/3006294951 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3006294951 >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 msgr2=0x7f8db00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3006294951 >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 0x7f8db00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3006294951 >> v1:172.21.15.162:6789/0 conn(0x7f8db01598c0 legacy=0x7f8db006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3006294951 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00cc550 con 0x7f8db006d410 2023-12-19T16:16:17.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.188+0000 7f8db4c82640 1 --2- 172.21.15.73:0/3006294951 >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 0x7f8db00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:17.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3006294951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8da400bb10 tx=0x7f8da401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a2f0f8ac6bdb82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8daeffd640 1 -- 172.21.15.73:0/3006294951 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40a7cb0 con 0x7f8db006d410 2023-12-19T16:16:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8daeffd640 1 -- 172.21.15.73:0/3006294951 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40a7e10 con 0x7f8db006d410 2023-12-19T16:16:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8daeffd640 1 -- 172.21.15.73:0/3006294951 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40af660 con 0x7f8db006d410 2023-12-19T16:16:17.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 -- 172.21.15.73:0/3006294951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 msgr2=0x7f8db00b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3006294951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8da400bb10 tx=0x7f8da401ebe0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 -- 172.21.15.73:0/3006294951 shutdown_connections 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3006294951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db00b0120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3006294951 >> v2:172.21.15.162:3300/0 conn(0x7f8db00b0660 0x7f8db00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 -- 172.21.15.73:0/3006294951 >> 172.21.15.73:0/3006294951 conn(0x7f8db006a570 msgr2=0x7f8db00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 -- 172.21.15.73:0/3006294951 shutdown_connections 2023-12-19T16:16:17.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.192+0000 7f8db66e5640 1 -- 172.21.15.73:0/3006294951 wait complete. 2023-12-19T16:16:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 Processor -- start 2023-12-19T16:16:17.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- start start 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db01437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 0x7f8db01fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0156200 con 0x7f8db01598c0 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0155f20 con 0x7f8db00b0660 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db00aec60 con 0x7f8db006d410 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db4c82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db4c82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59876/0 (socket says 172.21.15.73:59876) 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db01437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db4c82640 1 -- 172.21.15.73:0/3810536602 learned_addr learned my addr 172.21.15.73:0/3810536602 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 0x7f8db01fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 msgr2=0x7f8db01437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db01437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 msgr2=0x7f8db01fce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 -- 172.21.15.73:0/3810536602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009a70 con 0x7f8db00b0660 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db4c82640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8daf7fe640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 0x7f8db01fc8d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8da40ae000 tx=0x7f8da401b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40ba660 con 0x7f8db00b0660 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40ba7e0 con 0x7f8db00b0660 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40bab90 con 0x7f8db00b0660 2023-12-19T16:16:17.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da400b770 con 0x7f8db00b0660 2023-12-19T16:16:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.196+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db00af220 con 0x7f8db00b0660 2023-12-19T16:16:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db00aea70 con 0x7f8db00b0660 2023-12-19T16:16:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8da40c33f0 con 0x7f8db00b0660 2023-12-19T16:16:17.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8dacff9640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 0x7f8d9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8da411dff0 con 0x7f8db00b0660 2023-12-19T16:16:17.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8daffff640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 0x7f8d9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.200+0000 7f8daffff640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 0x7f8d9c067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8da0007fd0 tx=0x7f8da0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.208 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.204+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8da40ebb30 con 0x7f8db00b0660 2023-12-19T16:16:17.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.352+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8db00af410 con 0x7f8db00b0660 2023-12-19T16:16:17.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.360+0000 7f8dacff9640 1 -- 172.21.15.73:0/3810536602 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8da40bf0a0 con 0x7f8db00b0660 2023-12-19T16:16:17.365 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 msgr2=0x7f8d9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 0x7f8d9c067f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8da0007fd0 tx=0x7f8da0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 msgr2=0x7f8db01fc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 0x7f8db01fc8d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8da40ae000 tx=0x7f8da401b980 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 shutdown_connections 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8d9c065a60 0x7f8d9c067f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8db01598c0 0x7f8db01fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db00b0660 0x7f8db01fc8d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 --2- 172.21.15.73:0/3810536602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db006d410 0x7f8db01437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 >> 172.21.15.73:0/3810536602 conn(0x7f8db006a570 msgr2=0x7f8db00ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 shutdown_connections 2023-12-19T16:16:17.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.364+0000 7f8db66e5640 1 -- 172.21.15.73:0/3810536602 wait complete. 2023-12-19T16:16:17.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:16:17.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 Processor -- start 2023-12-19T16:16:17.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 -- start start 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b2c1598c0 0x7f5b2c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 0x7f5b2c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0b0ac0 con 0x7f5b2c0b0660 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c0cce80 con 0x7f5b2c1598c0 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b31af9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c06cad0 con 0x7f5b2c06d410 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5b2c0b0660 0x7f5b2c0c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56180/0 (socket says 172.21.15.73:56180) 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2bfff640 1 -- 172.21.15.73:0/2744194795 learned_addr learned my addr 172.21.15.73:0/2744194795 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:17.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2affd640 1 --2- 172.21.15.73:0/2744194795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 0x7f5b2c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2b7fe640 1 --2- 172.21.15.73:0/2744194795 >> v2:172.21.15.162:3300/0 conn(0x7f5b2c1598c0 0x7f5b2c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2a7fc640 1 -- 172.21.15.73:0/2744194795 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475605416 0 0) 0x7f5b2c0b0ac0 con 0x7f5b2c0b0660 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2a7fc640 1 -- 172.21.15.73:0/2744194795 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b14003530 con 0x7f5b2c0b0660 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2affd640 1 -- 172.21.15.73:0/2744194795 >> v2:172.21.15.162:3300/0 conn(0x7f5b2c1598c0 msgr2=0x7f5b2c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2affd640 1 --2- 172.21.15.73:0/2744194795 >> v2:172.21.15.162:3300/0 conn(0x7f5b2c1598c0 0x7f5b2c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2affd640 1 -- 172.21.15.73:0/2744194795 >> v1:172.21.15.73:6789/0 conn(0x7f5b2c0b0660 legacy=0x7f5b2c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.524+0000 7f5b2affd640 1 -- 172.21.15.73:0/2744194795 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0cc270 con 0x7f5b2c06d410 2023-12-19T16:16:17.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b2affd640 1 --2- 172.21.15.73:0/2744194795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 0x7f5b2c0b0120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097c0 tx=0x7f5b2001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faecd2a9b845b6aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b2a7fc640 1 -- 172.21.15.73:0/2744194795 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200ab680 con 0x7f5b2c06d410 2023-12-19T16:16:17.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b2a7fc640 1 -- 172.21.15.73:0/2744194795 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b200ab7e0 con 0x7f5b2c06d410 2023-12-19T16:16:17.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b2a7fc640 1 -- 172.21.15.73:0/2744194795 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200abb70 con 0x7f5b2c06d410 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 -- 172.21.15.73:0/2744194795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 msgr2=0x7f5b2c0b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 --2- 172.21.15.73:0/2744194795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 0x7f5b2c0b0120 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5b200097c0 tx=0x7f5b2001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 -- 172.21.15.73:0/2744194795 shutdown_connections 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 --2- 172.21.15.73:0/2744194795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c06d410 0x7f5b2c0b0120 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 --2- 172.21.15.73:0/2744194795 >> v2:172.21.15.162:3300/0 conn(0x7f5b2c1598c0 0x7f5b2c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 -- 172.21.15.73:0/2744194795 >> 172.21.15.73:0/2744194795 conn(0x7f5b2c06a570 msgr2=0x7f5b2c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 -- 172.21.15.73:0/2744194795 shutdown_connections 2023-12-19T16:16:17.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.528+0000 7f5b31af9640 1 -- 172.21.15.73:0/2744194795 wait complete. 2023-12-19T16:16:17.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 Processor -- start 2023-12-19T16:16:17.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- start start 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 0x7f5b2c0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c0b0660 0x7f5b2c1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c8320 con 0x7f5b2c1598c0 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c7d10 con 0x7f5b2c06d410 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0b4220 con 0x7f5b2c0b0660 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59884/0 (socket says 172.21.15.73:59884) 2023-12-19T16:16:17.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 -- 172.21.15.73:0/1521011611 learned_addr learned my addr 172.21.15.73:0/1521011611 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2b7fe640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 0x7f5b2c0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2affd640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c0b0660 0x7f5b2c1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 -- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c0b0660 msgr2=0x7f5b2c1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c0b0660 0x7f5b2c1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 -- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 msgr2=0x7f5b2c0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 0x7f5b2c0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 -- 172.21.15.73:0/1521011611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20009420 con 0x7f5b2c1598c0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2b7fe640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 0x7f5b2c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b2bfff640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400cb40 tx=0x7f5b2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2400aca0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2400ae00 con 0x7f5b2c1598c0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24012620 con 0x7f5b2c1598c0 2023-12-19T16:16:17.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0c7fb0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c154bc0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.532+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c0c84d0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.536+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b24007070 con 0x7f5b2c1598c0 2023-12-19T16:16:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.536+0000 7f5b13fff640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 0x7f5b18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.536+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b24083130 con 0x7f5b2c1598c0 2023-12-19T16:16:17.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.536+0000 7f5b2b7fe640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 0x7f5b18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.536+0000 7f5b2b7fe640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 0x7f5b18067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009eb0 tx=0x7f5b1c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.544 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.540+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b2c0c84d0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b2c0c84d0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b13fff640 1 -- 172.21.15.73:0/1521011611 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b2c0c84d0 con 0x7f5b2c1598c0 2023-12-19T16:16:17.692 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 msgr2=0x7f5b18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 0x7f5b18067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009eb0 tx=0x7f5b1c009190 comp rx=0 tx=0).stop 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 msgr2=0x7f5b2c1f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b2400cb40 tx=0x7f5b2400a060 comp rx=0 tx=0).stop 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 shutdown_connections 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b18065a60 0x7f5b18067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b2c1598c0 0x7f5b2c1f8b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b2c0b0660 0x7f5b2c1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 --2- 172.21.15.73:0/1521011611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b2c06d410 0x7f5b2c0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 >> 172.21.15.73:0/1521011611 conn(0x7f5b2c06a570 msgr2=0x7f5b2c0aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 shutdown_connections 2023-12-19T16:16:17.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.688+0000 7f5b31af9640 1 -- 172.21.15.73:0/1521011611 wait complete. 2023-12-19T16:16:17.713 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:16:17.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.848+0000 7f11bea2d640 1 Processor -- start 2023-12-19T16:16:17.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.848+0000 7f11bea2d640 1 -- start start 2023-12-19T16:16:17.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bea2d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11b8158270 0x7f11b815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bea2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bea2d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b806ffb0 con 0x7f11b815e4d0 2023-12-19T16:16:17.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bea2d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b815b730 con 0x7f11b8158270 2023-12-19T16:16:17.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bea2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815ba10 con 0x7f11b8158650 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11b8158270 0x7f11b815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:56120/0 (socket says 172.21.15.73:56120) 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 -- 172.21.15.73:0/287677655 learned_addr learned my addr 172.21.15.73:0/287677655 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11bcfca640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f11b815e4d0 0x7f11b806bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:51470/0 (socket says 172.21.15.73:51470) 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 -- 172.21.15.73:0/287677655 >> v2:172.21.15.162:3300/0 conn(0x7f11b8158270 msgr2=0x7f11b815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 --2- 172.21.15.73:0/287677655 >> v2:172.21.15.162:3300/0 conn(0x7f11b8158270 0x7f11b815aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 -- 172.21.15.73:0/287677655 >> v1:172.21.15.162:6789/0 conn(0x7f11b815e4d0 legacy=0x7f11b806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.852+0000 7f11b77fe640 1 -- 172.21.15.73:0/287677655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b815bcf0 con 0x7f11b8158650 2023-12-19T16:16:17.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11b77fe640 1 --2- 172.21.15.73:0/287677655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009870 tx=0x7f11ac01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4258b0ab100bdd15 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11b6ffd640 1 -- 172.21.15.73:0/287677655 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0ab620 con 0x7f11b8158650 2023-12-19T16:16:17.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11b6ffd640 1 -- 172.21.15.73:0/287677655 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac0ab780 con 0x7f11b8158650 2023-12-19T16:16:17.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11b6ffd640 1 -- 172.21.15.73:0/287677655 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac0abb10 con 0x7f11b8158650 2023-12-19T16:16:17.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 -- 172.21.15.73:0/287677655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 msgr2=0x7f11b8070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 --2- 172.21.15.73:0/287677655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009870 tx=0x7f11ac01c510 comp rx=0 tx=0).stop 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 -- 172.21.15.73:0/287677655 shutdown_connections 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 --2- 172.21.15.73:0/287677655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b8070790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 --2- 172.21.15.73:0/287677655 >> v2:172.21.15.162:3300/0 conn(0x7f11b8158270 0x7f11b815aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 -- 172.21.15.73:0/287677655 >> 172.21.15.73:0/287677655 conn(0x7f11b806a570 msgr2=0x7f11b80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 -- 172.21.15.73:0/287677655 shutdown_connections 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 -- 172.21.15.73:0/287677655 wait complete. 2023-12-19T16:16:17.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.856+0000 7f11bea2d640 1 Processor -- start 2023-12-19T16:16:17.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- start start 2023-12-19T16:16:17.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b8158270 0x7f11b8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b80c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80c8c90 con 0x7f11b815e4d0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80b2400 con 0x7f11b8158270 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b81541b0 con 0x7f11b8158650 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59898/0 (socket says 172.21.15.73:59898) 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 -- 172.21.15.73:0/942705145 learned_addr learned my addr 172.21.15.73:0/942705145 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11b77fe640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b80c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11b7fff640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b8158270 0x7f11b8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 -- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 msgr2=0x7f11b80c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b80c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 -- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b8158270 msgr2=0x7f11b8153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b8158270 0x7f11b8153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 -- 172.21.15.73:0/942705145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0094d0 con 0x7f11b815e4d0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bcfca640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c6f0 tx=0x7f11b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0005db0 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000a640 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80b1e60 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b000a9b0 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b80c8920 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.860+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b80c8e00 con 0x7f11b815e4d0 2023-12-19T16:16:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.864+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11b000ab10 con 0x7f11b815e4d0 2023-12-19T16:16:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.864+0000 7f11b4ff9640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 0x7f11a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.864+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11b0082830 con 0x7f11b815e4d0 2023-12-19T16:16:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.864+0000 7f11b7fff640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 0x7f11a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.864+0000 7f11b7fff640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 0x7f11a4067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009a50 tx=0x7f11a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:17.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:17.868+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11b0050290 con 0x7f11b815e4d0 2023-12-19T16:16:18.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.016+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11b804e070 con 0x7f11b815e4d0 2023-12-19T16:16:18.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.016+0000 7f11b4ff9640 1 -- 172.21.15.73:0/942705145 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11b00170a0 con 0x7f11b815e4d0 2023-12-19T16:16:18.022 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 msgr2=0x7f11a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 0x7f11a4067f20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009a50 tx=0x7f11a8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 msgr2=0x7f11b8155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f11b000c6f0 tx=0x7f11b000cbb0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 shutdown_connections 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11a4065a60 0x7f11a4067f20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11b815e4d0 0x7f11b8155570 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11b8158650 0x7f11b80c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 --2- 172.21.15.73:0/942705145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b8158270 0x7f11b8153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 >> 172.21.15.73:0/942705145 conn(0x7f11b806a570 msgr2=0x7f11b806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 shutdown_connections 2023-12-19T16:16:18.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.020+0000 7f11bea2d640 1 -- 172.21.15.73:0/942705145 wait complete. 2023-12-19T16:16:18.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 Processor -- start 2023-12-19T16:16:18.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 -- start start 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e400cc310 0x7f8e4006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 0x7f8e400abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400cc8f0 con 0x7f8e400cba40 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4006d070 con 0x7f8e400cc310 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e467bc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400ccbd0 con 0x7f8e4006cbe0 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e400cc310 0x7f8e4006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e400cc310 0x7f8e4006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59906/0 (socket says 172.21.15.73:59906) 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e400cba40 0x7f8e401612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56192/0 (socket says 172.21.15.73:56192) 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 -- 172.21.15.73:0/4223653582 learned_addr learned my addr 172.21.15.73:0/4223653582 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:18.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e44d59640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 0x7f8e400abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 -- 172.21.15.73:0/4223653582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 msgr2=0x7f8e400abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 0x7f8e400abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 -- 172.21.15.73:0/4223653582 >> v1:172.21.15.73:6789/0 conn(0x7f8e400cba40 legacy=0x7f8e401612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3f7fe640 1 -- 172.21.15.73:0/4223653582 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400cceb0 con 0x7f8e400cc310 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e44d59640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 0x7f8e400abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:18.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.176+0000 7f8e3effd640 1 -- 172.21.15.73:0/4223653582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520314105 0 0) 0x7f8e400cc8f0 con 0x7f8e400cba40 2023-12-19T16:16:18.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e400cc310 0x7f8e4006c6a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009870 tx=0x7f8e3401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2730a8393a5ac75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e3effd640 1 -- 172.21.15.73:0/4223653582 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340a8a30 con 0x7f8e400cc310 2023-12-19T16:16:18.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e3effd640 1 -- 172.21.15.73:0/4223653582 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e340a8b90 con 0x7f8e400cc310 2023-12-19T16:16:18.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e3effd640 1 -- 172.21.15.73:0/4223653582 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e340b0440 con 0x7f8e400cc310 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 -- 172.21.15.73:0/4223653582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e400cc310 msgr2=0x7f8e4006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e400cc310 0x7f8e4006c6a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009870 tx=0x7f8e3401ed30 comp rx=0 tx=0).stop 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 -- 172.21.15.73:0/4223653582 shutdown_connections 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e4006cbe0 0x7f8e400abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 --2- 172.21.15.73:0/4223653582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e400cc310 0x7f8e4006c6a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 -- 172.21.15.73:0/4223653582 >> 172.21.15.73:0/4223653582 conn(0x7f8e400b0270 msgr2=0x7f8e400b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 -- 172.21.15.73:0/4223653582 shutdown_connections 2023-12-19T16:16:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.180+0000 7f8e467bc640 1 -- 172.21.15.73:0/4223653582 wait complete. 2023-12-19T16:16:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 Processor -- start 2023-12-19T16:16:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- start start 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 0x7f8e400b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 0x7f8e400703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c69b0 con 0x7f8e4006cbe0 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c6c90 con 0x7f8e400cba40 2023-12-19T16:16:18.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400c6f70 con 0x7f8e400cc310 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59912/0 (socket says 172.21.15.73:59912) 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 -- 172.21.15.73:0/2297488017 learned_addr learned my addr 172.21.15.73:0/2297488017 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 0x7f8e400b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e44d59640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 0x7f8e400703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 -- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 msgr2=0x7f8e400703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 0x7f8e400703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 -- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 msgr2=0x7f8e400b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 0x7f8e400b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 -- 172.21.15.73:0/2297488017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340094d0 con 0x7f8e4006cbe0 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 0x7f8e400b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e44d59640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 0x7f8e400703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3ffff640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e300011f0 tx=0x7f8e3000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300074e0 con 0x7f8e4006cbe0 2023-12-19T16:16:18.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30007640 con 0x7f8e4006cbe0 2023-12-19T16:16:18.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30004a10 con 0x7f8e4006cbe0 2023-12-19T16:16:18.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400c7250 con 0x7f8e4006cbe0 2023-12-19T16:16:18.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.184+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e401f2b40 con 0x7f8e4006cbe0 2023-12-19T16:16:18.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e40074050 con 0x7f8e4006cbe0 2023-12-19T16:16:18.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e30004b70 con 0x7f8e4006cbe0 2023-12-19T16:16:18.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e3cff9640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 0x7f8e2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e300824a0 con 0x7f8e4006cbe0 2023-12-19T16:16:18.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 0x7f8e2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.188+0000 7f8e3f7fe640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 0x7f8e2c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8e340b2000 tx=0x7f8e340aa070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.192+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e3004fe60 con 0x7f8e4006cbe0 2023-12-19T16:16:18.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e400cbf10 con 0x7f8e4006cbe0 2023-12-19T16:16:18.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e3cff9640 1 -- 172.21.15.73:0/2297488017 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f8e30018090 con 0x7f8e4006cbe0 2023-12-19T16:16:18.381 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:18.381 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:18.381 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 msgr2=0x7f8e2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 0x7f8e2c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8e340b2000 tx=0x7f8e340aa070 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 msgr2=0x7f8e401f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e300011f0 tx=0x7f8e3000c9b0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 shutdown_connections 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8e400cc310 0x7f8e400703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e400cba40 0x7f8e400b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8e2c065a60 0x7f8e2c067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 --2- 172.21.15.73:0/2297488017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e4006cbe0 0x7f8e401f2600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 >> 172.21.15.73:0/2297488017 conn(0x7f8e400b0270 msgr2=0x7f8e400ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 shutdown_connections 2023-12-19T16:16:18.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.376+0000 7f8e467bc640 1 -- 172.21.15.73:0/2297488017 wait complete. 2023-12-19T16:16:18.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 Processor -- start 2023-12-19T16:16:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 -- start start 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 0x7f21880d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880d3540 con 0x7f2188160270 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880cdf10 con 0x7f21880d15e0 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218e5a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880d0ca0 con 0x7f21880d0820 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218d5a0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2188160270 0x7f21880d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56208/0 (socket says 172.21.15.73:56208) 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218d5a0640 1 -- 172.21.15.73:0/2950949578 learned_addr learned my addr 172.21.15.73:0/2950949578 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218dda1640 1 --2- 172.21.15.73:0/2950949578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 0x7f21880d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893355691 0 0) 0x7f21880d3540 con 0x7f2188160270 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003530 con 0x7f2188160270 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707735235 0 0) 0x7f21880cdf10 con 0x7f21880d15e0 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21880d3540 con 0x7f21880d15e0 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218dda1640 1 -- 172.21.15.73:0/2950949578 >> v1:172.21.15.162:6789/0 conn(0x7f21880d15e0 legacy=0x7f218806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057725066 0 0) 0x7f2174003530 con 0x7f2188160270 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218dda1640 1 -- 172.21.15.73:0/2950949578 >> v1:172.21.15.73:6789/0 conn(0x7f2188160270 legacy=0x7f21880d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.536+0000 7f218dda1640 1 -- 172.21.15.73:0/2950949578 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218806b040 con 0x7f21880d0820 2023-12-19T16:16:18.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218dda1640 1 --2- 172.21.15.73:0/2950949578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 0x7f21880d3000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2180009dc0 tx=0x7f218001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744163b510ee30d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184001680 con 0x7f21880d0820 2023-12-19T16:16:18.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800a55c0 con 0x7f21880d0820 2023-12-19T16:16:18.546 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f217ffff640 1 -- 172.21.15.73:0/2950949578 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800a5930 con 0x7f21880d0820 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 -- 172.21.15.73:0/2950949578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 msgr2=0x7f21880d3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 --2- 172.21.15.73:0/2950949578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 0x7f21880d3000 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2180009dc0 tx=0x7f218001c890 comp rx=0 tx=0).stop 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 -- 172.21.15.73:0/2950949578 shutdown_connections 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 --2- 172.21.15.73:0/2950949578 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21880d0820 0x7f21880d3000 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 -- 172.21.15.73:0/2950949578 >> 172.21.15.73:0/2950949578 conn(0x7f218809bc10 msgr2=0x7f21880d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 -- 172.21.15.73:0/2950949578 shutdown_connections 2023-12-19T16:16:18.547 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.540+0000 7f218e5a2640 1 -- 172.21.15.73:0/2950949578 wait complete. 2023-12-19T16:16:18.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 Processor -- start 2023-12-19T16:16:18.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 -- start start 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21880d0820 0x7f21880c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 0x7f21880af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880cc290 con 0x7f21880d15e0 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21880cc570 con 0x7f21880d0820 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218e5a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21880cc850 con 0x7f2188160270 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59920/0 (socket says 172.21.15.73:59920) 2023-12-19T16:16:18.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 -- 172.21.15.73:0/3433232513 learned_addr learned my addr 172.21.15.73:0/3433232513 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218dda1640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 0x7f21880af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218d5a0640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21880d0820 0x7f21880c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 -- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 msgr2=0x7f21880af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 0x7f21880af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 -- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21880d0820 msgr2=0x7f21880c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21880d0820 0x7f21880c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 -- 172.21.15.73:0/3433232513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180009a70 con 0x7f21880d15e0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218dda1640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 0x7f21880af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f218cd9f640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f217800c490 tx=0x7f217800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21780052d0 con 0x7f21880d15e0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2178005430 con 0x7f21880d15e0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.544+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2178012870 con 0x7f21880d15e0 2023-12-19T16:16:18.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21880ccb30 con 0x7f21880d15e0 2023-12-19T16:16:18.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21880cbdd0 con 0x7f21880d15e0 2023-12-19T16:16:18.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21880cbff0 con 0x7f21880d15e0 2023-12-19T16:16:18.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f21780129d0 con 0x7f21880d15e0 2023-12-19T16:16:18.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f217dffb640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 0x7f216c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2178082d20 con 0x7f21880d15e0 2023-12-19T16:16:18.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.548+0000 7f218d5a0640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 0x7f216c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.552+0000 7f218d5a0640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 0x7f216c067f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2184000f70 tx=0x7f2184009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.552+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f21780506d0 con 0x7f21880d15e0 2023-12-19T16:16:18.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.704+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f218804e000 con 0x7f21880d15e0 2023-12-19T16:16:18.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.704+0000 7f217dffb640 1 -- 172.21.15.73:0/3433232513 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f2178053cf0 con 0x7f21880d15e0 2023-12-19T16:16:18.709 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:18.709 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:18.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 msgr2=0x7f216c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 0x7f216c067f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2184000f70 tx=0x7f2184009040 comp rx=0 tx=0).stop 2023-12-19T16:16:18.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 msgr2=0x7f21880cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f217800c490 tx=0x7f217800c950 comp rx=0 tx=0).stop 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 shutdown_connections 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2188160270 0x7f21880af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f216c065a90 0x7f216c067f50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21880d15e0 0x7f21880cb890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 --2- 172.21.15.73:0/3433232513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21880d0820 0x7f21880c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 >> 172.21.15.73:0/3433232513 conn(0x7f218809bc10 msgr2=0x7f21880d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 shutdown_connections 2023-12-19T16:16:18.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.708+0000 7f218e5a2640 1 -- 172.21.15.73:0/3433232513 wait complete. 2023-12-19T16:16:18.730 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:16:18.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:18.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 Processor -- start 2023-12-19T16:16:18.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 -- start start 2023-12-19T16:16:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746006ddf0 0x7f74600cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74600cbe90 0x7f74600cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f746015cc80 0x7f7460070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600cccb0 con 0x7f746015cc80 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600ca6f0 con 0x7f74600cbe90 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f7466066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7460159530 con 0x7f746006ddf0 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f746015cc80 0x7f7460070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f746015cc80 0x7f7460070130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59922/0 (socket says 172.21.15.73:59922) 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 -- 172.21.15.73:0/1965367193 learned_addr learned my addr 172.21.15.73:0/1965367193 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745f7fe640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746006ddf0 0x7f74600cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745effd640 1 --2- 172.21.15.73:0/1965367193 >> v2:172.21.15.162:3300/0 conn(0x7f74600cbe90 0x7f74600cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 -- 172.21.15.73:0/1965367193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746006ddf0 msgr2=0x7f74600cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746006ddf0 0x7f74600cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 -- 172.21.15.73:0/1965367193 >> v2:172.21.15.162:3300/0 conn(0x7f74600cbe90 msgr2=0x7f74600cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 --2- 172.21.15.73:0/1965367193 >> v2:172.21.15.162:3300/0 conn(0x7f74600cbe90 0x7f74600cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.864+0000 7f745ffff640 1 -- 172.21.15.73:0/1965367193 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600c9ae0 con 0x7f746015cc80 2023-12-19T16:16:18.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f745ffff640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f746015cc80 0x7f7460070130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7458009d40 tx=0x7f745801da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9060c3e6c03a356a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f745e7fc640 1 -- 172.21.15.73:0/1965367193 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580a6890 con 0x7f746015cc80 2023-12-19T16:16:18.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f745e7fc640 1 -- 172.21.15.73:0/1965367193 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580a69f0 con 0x7f746015cc80 2023-12-19T16:16:18.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f745e7fc640 1 -- 172.21.15.73:0/1965367193 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74580a6d80 con 0x7f746015cc80 2023-12-19T16:16:18.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 -- 172.21.15.73:0/1965367193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f746015cc80 msgr2=0x7f7460070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f746015cc80 0x7f7460070130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7458009d40 tx=0x7f745801da90 comp rx=0 tx=0).stop 2023-12-19T16:16:18.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 -- 172.21.15.73:0/1965367193 shutdown_connections 2023-12-19T16:16:18.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f746015cc80 0x7f7460070130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 --2- 172.21.15.73:0/1965367193 >> v2:172.21.15.162:3300/0 conn(0x7f74600cbe90 0x7f74600cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 --2- 172.21.15.73:0/1965367193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746006ddf0 0x7f74600cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 -- 172.21.15.73:0/1965367193 >> 172.21.15.73:0/1965367193 conn(0x7f74600b0270 msgr2=0x7f74600b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 -- 172.21.15.73:0/1965367193 shutdown_connections 2023-12-19T16:16:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 -- 172.21.15.73:0/1965367193 wait complete. 2023-12-19T16:16:18.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.868+0000 7f7466066640 1 Processor -- start 2023-12-19T16:16:18.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- start start 2023-12-19T16:16:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 0x7f7460155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746015cc80 0x7f746006c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460153720 con 0x7f74600cbe90 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746015c440 con 0x7f746006ddf0 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b1d70 con 0x7f746015cc80 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59936/0 (socket says 172.21.15.73:59936) 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 -- 172.21.15.73:0/3409016981 learned_addr learned my addr 172.21.15.73:0/3409016981 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745ffff640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746015cc80 0x7f746006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745f7fe640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 0x7f7460155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 -- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746015cc80 msgr2=0x7f746006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746015cc80 0x7f746006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 -- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 msgr2=0x7f7460155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 0x7f7460155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 -- 172.21.15.73:0/3409016981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745800d040 con 0x7f74600cbe90 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745f7fe640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 0x7f7460155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:18.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f745effd640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745400d800 tx=0x7f745400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400b660 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400b7c0 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400bb30 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74600b2050 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600b2610 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.872+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74601538d0 con 0x7f74600cbe90 2023-12-19T16:16:18.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.876+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f745400bc90 con 0x7f74600cbe90 2023-12-19T16:16:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.876+0000 7f7447fff640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 0x7f744c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.876+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74540835a0 con 0x7f74600cbe90 2023-12-19T16:16:18.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.876+0000 7f745f7fe640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 0x7f744c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:18.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.876+0000 7f745f7fe640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 0x7f744c067f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7450004660 tx=0x7f7450008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:18.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:18.880+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74601538d0 con 0x7f74600cbe90 2023-12-19T16:16:19.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7460074050 con 0x7f74600cbe90 2023-12-19T16:16:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7447fff640 1 -- 172.21.15.73:0/3409016981 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f7454050f50 con 0x7f74600cbe90 2023-12-19T16:16:19.064 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:19.064 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:19.064 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 msgr2=0x7f744c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 0x7f744c067f50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7450004660 tx=0x7f7450008040 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 msgr2=0x7f746006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f745400d800 tx=0x7f745400dcc0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 shutdown_connections 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f746015cc80 0x7f746006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f744c065a90 0x7f744c067f50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74600cbe90 0x7f746006d220 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 --2- 172.21.15.73:0/3409016981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746006ddf0 0x7f7460155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 >> 172.21.15.73:0/3409016981 conn(0x7f74600b0270 msgr2=0x7f74600700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 shutdown_connections 2023-12-19T16:16:19.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.060+0000 7f7466066640 1 -- 172.21.15.73:0/3409016981 wait complete. 2023-12-19T16:16:19.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 Processor -- start 2023-12-19T16:16:19.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 -- start start 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ccae0 0x7f983415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f98340b3070 0x7f98340c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98340ce930 0x7f98340cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98340b34f0 con 0x7f98340ce930 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98340cf300 con 0x7f98340b3070 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f983a3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983406c080 con 0x7f98340ccae0 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98340ce930 0x7f98340cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98340ce930 0x7f98340cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59952/0 (socket says 172.21.15.73:59952) 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 -- 172.21.15.73:0/2042811222 learned_addr learned my addr 172.21.15.73:0/2042811222 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f98393a0640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ccae0 0x7f983415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9838b9f640 1 --2- 172.21.15.73:0/2042811222 >> v2:172.21.15.162:3300/0 conn(0x7f98340b3070 0x7f98340c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 -- 172.21.15.73:0/2042811222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ccae0 msgr2=0x7f983415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ccae0 0x7f983415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 -- 172.21.15.73:0/2042811222 >> v2:172.21.15.162:3300/0 conn(0x7f98340b3070 msgr2=0x7f98340c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 --2- 172.21.15.73:0/2042811222 >> v2:172.21.15.162:3300/0 conn(0x7f98340b3070 0x7f98340c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.220+0000 7f9839ba1640 1 -- 172.21.15.73:0/2042811222 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9834159cb0 con 0x7f98340ce930 2023-12-19T16:16:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f9839ba1640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340ce930 0x7f98340cedc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f983406fcb0 tx=0x7f982c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c919fba26d4a84f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f982bfff640 1 -- 172.21.15.73:0/2042811222 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0a5870 con 0x7f98340ce930 2023-12-19T16:16:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f982bfff640 1 -- 172.21.15.73:0/2042811222 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c0a59d0 con 0x7f98340ce930 2023-12-19T16:16:19.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f982bfff640 1 -- 172.21.15.73:0/2042811222 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0a5d60 con 0x7f98340ce930 2023-12-19T16:16:19.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 -- 172.21.15.73:0/2042811222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340ce930 msgr2=0x7f98340cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340ce930 0x7f98340cedc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f983406fcb0 tx=0x7f982c01c9d0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 -- 172.21.15.73:0/2042811222 shutdown_connections 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340ce930 0x7f98340cedc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 --2- 172.21.15.73:0/2042811222 >> v2:172.21.15.162:3300/0 conn(0x7f98340b3070 0x7f98340c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 --2- 172.21.15.73:0/2042811222 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ccae0 0x7f983415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 -- 172.21.15.73:0/2042811222 >> 172.21.15.73:0/2042811222 conn(0x7f983406a120 msgr2=0x7f983406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 -- 172.21.15.73:0/2042811222 shutdown_connections 2023-12-19T16:16:19.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.224+0000 7f983a3a2640 1 -- 172.21.15.73:0/2042811222 wait complete. 2023-12-19T16:16:19.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 Processor -- start 2023-12-19T16:16:19.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- start start 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98340ccae0 0x7f98341547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ce930 0x7f9834167970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340b26c0 con 0x7f98340b3070 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340b29a0 con 0x7f98340ccae0 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c1be0 con 0x7f98340ce930 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59966/0 (socket says 172.21.15.73:59966) 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 -- 172.21.15.73:0/582571536 learned_addr learned my addr 172.21.15.73:0/582571536 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f9838b9f640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98340ccae0 0x7f98341547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f9839ba1640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ce930 0x7f9834167970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 -- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ce930 msgr2=0x7f9834167970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ce930 0x7f9834167970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 -- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98340ccae0 msgr2=0x7f98341547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98340ccae0 0x7f98341547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 -- 172.21.15.73:0/582571536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c009b30 con 0x7f98340b3070 2023-12-19T16:16:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f98393a0640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f983000e930 tx=0x7f983000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830009690 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983000ca00 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983000cd70 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340c1ec0 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340b23d0 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.228+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983404e000 con 0x7f98340b3070 2023-12-19T16:16:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.232+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9830013470 con 0x7f98340b3070 2023-12-19T16:16:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.232+0000 7f9829ffb640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 0x7f9818067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.232+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9830083450 con 0x7f98340b3070 2023-12-19T16:16:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.232+0000 7f9838b9f640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 0x7f9818067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.232+0000 7f9838b9f640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 0x7f9818067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98340b1db0 tx=0x7f9824008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.236+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9830050e30 con 0x7f98340b3070 2023-12-19T16:16:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.416+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f983406dbc0 con 0x7f98340b3070 2023-12-19T16:16:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.416+0000 7f9829ffb640 1 -- 172.21.15.73:0/582571536 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4700 (secure 0 0 0) 0x7f9830054450 con 0x7f98340b3070 2023-12-19T16:16:19.422 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:19.422 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/766986146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":766986146},{"type":"v1","addr":"172.21.15.162:6835","nonce":766986146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1960037578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1960037578},{"type":"v1","addr":"172.21.15.73:6836","nonce":1960037578}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/523597645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":523597645},{"type":"v1","addr":"172.21.15.73:6837","nonce":523597645}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:15:40.526486+0000","modified":"2023-12-19T16:15:43.540418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/859679048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":859679048},{"type":"v1","addr":"172.21.15.162:6834","nonce":859679048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T16:16:19.423 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 8 2023-12-19T16:16:19.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 msgr2=0x7f9818067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 0x7f9818067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98340b1db0 tx=0x7f9824008040 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 msgr2=0x7f98340b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f983000e930 tx=0x7f983000edf0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 shutdown_connections 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98340ce930 0x7f9834167970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98340ccae0 0x7f98341547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9818065a60 0x7f9818067f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 --2- 172.21.15.73:0/582571536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98340b3070 0x7f98340b1e90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 >> 172.21.15.73:0/582571536 conn(0x7f983406a120 msgr2=0x7f9834070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 shutdown_connections 2023-12-19T16:16:19.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.420+0000 7f983a3a2640 1 -- 172.21.15.73:0/582571536 wait complete. 2023-12-19T16:16:19.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.576+0000 7f1608bce640 1 Processor -- start 2023-12-19T16:16:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.576+0000 7f1608bce640 1 -- start start 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1608bce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16040cc310 0x7f160406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1608bce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f160406cbe0 0x7f16040abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1608bce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040cc8f0 con 0x7f16040cba40 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1608bce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160406d070 con 0x7f160406cbe0 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1608bce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040ccbd0 con 0x7f16040cc310 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f160406cbe0 0x7f16040abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f160406cbe0 0x7f16040abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59978/0 (socket says 172.21.15.73:59978) 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 -- 172.21.15.73:0/3114499741 learned_addr learned my addr 172.21.15.73:0/3114499741 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f15f9d9b640 1 --2- 172.21.15.73:0/3114499741 >> v2:172.21.15.162:3300/0 conn(0x7f16040cc310 0x7f160406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 -- 172.21.15.73:0/3114499741 >> v2:172.21.15.162:3300/0 conn(0x7f16040cc310 msgr2=0x7f160406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 --2- 172.21.15.73:0/3114499741 >> v2:172.21.15.162:3300/0 conn(0x7f16040cc310 0x7f160406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 -- 172.21.15.73:0/3114499741 >> v1:172.21.15.162:6789/0 conn(0x7f16040cba40 legacy=0x7f16041612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.580+0000 7f1602d9d640 1 -- 172.21.15.73:0/3114499741 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040cceb0 con 0x7f160406cbe0 2023-12-19T16:16:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1602d9d640 1 --2- 172.21.15.73:0/3114499741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160406cbe0 0x7f16040abe00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f160406ac60 tx=0x7f15fc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60988fa3fdd33f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1601d9b640 1 -- 172.21.15.73:0/3114499741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0af400 con 0x7f160406cbe0 2023-12-19T16:16:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1601d9b640 1 -- 172.21.15.73:0/3114499741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc0ab050 con 0x7f160406cbe0 2023-12-19T16:16:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1601d9b640 1 -- 172.21.15.73:0/3114499741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0af780 con 0x7f160406cbe0 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- 172.21.15.73:0/3114499741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160406cbe0 msgr2=0x7f16040abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 --2- 172.21.15.73:0/3114499741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160406cbe0 0x7f16040abe00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f160406ac60 tx=0x7f15fc01f1c0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- 172.21.15.73:0/3114499741 shutdown_connections 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 --2- 172.21.15.73:0/3114499741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f160406cbe0 0x7f16040abe00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 --2- 172.21.15.73:0/3114499741 >> v2:172.21.15.162:3300/0 conn(0x7f16040cc310 0x7f160406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- 172.21.15.73:0/3114499741 >> 172.21.15.73:0/3114499741 conn(0x7f16040b0270 msgr2=0x7f16040b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- 172.21.15.73:0/3114499741 shutdown_connections 2023-12-19T16:16:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- 172.21.15.73:0/3114499741 wait complete. 2023-12-19T16:16:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 Processor -- start 2023-12-19T16:16:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.584+0000 7f1608bce640 1 -- start start 2023-12-19T16:16:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f160406cbe0 0x7f16040b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16040cc310 0x7f16041f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c6da0 con 0x7f16040cba40 2023-12-19T16:16:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c7020 con 0x7f160406cbe0 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16040c7300 con 0x7f16040cc310 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59984/0 (socket says 172.21.15.73:59984) 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 -- 172.21.15.73:0/2164312566 learned_addr learned my addr 172.21.15.73:0/2164312566 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f160259c640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f160406cbe0 0x7f16040b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1602d9d640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16040cc310 0x7f16041f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 -- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16040cc310 msgr2=0x7f16041f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16040cc310 0x7f16041f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 -- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f160406cbe0 msgr2=0x7f16040b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f160406cbe0 0x7f16040b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 -- 172.21.15.73:0/2164312566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc009b30 con 0x7f16040cba40 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15f9d9b640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f15f400d5f0 tx=0x7f15f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f40125f0 con 0x7f16040cba40 2023-12-19T16:16:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4012750 con 0x7f16040cba40 2023-12-19T16:16:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4012ae0 con 0x7f16040cba40 2023-12-19T16:16:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040c75e0 con 0x7f16040cba40 2023-12-19T16:16:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16040c7ba0 con 0x7f16040cba40 2023-12-19T16:16:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1604074050 con 0x7f16040cba40 2023-12-19T16:16:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.588+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f15f4012c40 con 0x7f16040cba40 2023-12-19T16:16:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.592+0000 7f15fb7fe640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 0x7f15e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.592+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15f40835a0 con 0x7f16040cba40 2023-12-19T16:16:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.592+0000 7f160259c640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 0x7f15e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.592+0000 7f160259c640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 0x7f15e4067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.596+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f15f4050f70 con 0x7f16040cba40 2023-12-19T16:16:19.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.744+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16040cbf10 con 0x7f16040cba40 2023-12-19T16:16:19.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f15fb7fe640 1 -- 172.21.15.73:0/2164312566 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f15f4054590 con 0x7f16040cba40 2023-12-19T16:16:19.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:19.752 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":23,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:15:41.529625+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:15:38.776033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T16:15:39.511943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 msgr2=0x7f15e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 0x7f15e4067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15ec007fd0 tx=0x7f15ec009040 comp rx=0 tx=0).stop 2023-12-19T16:16:19.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 msgr2=0x7f16040c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f15f400d5f0 tx=0x7f15f400dab0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 shutdown_connections 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16040cc310 0x7f16041f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f15e4065a60 0x7f15e4067f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16040cba40 0x7f16040c6860 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 --2- 172.21.15.73:0/2164312566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f160406cbe0 0x7f16040b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 >> 172.21.15.73:0/2164312566 conn(0x7f16040b0270 msgr2=0x7f160415fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 shutdown_connections 2023-12-19T16:16:19.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.748+0000 7f1608bce640 1 -- 172.21.15.73:0/2164312566 wait complete. 2023-12-19T16:16:19.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:16:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 Processor -- start 2023-12-19T16:16:19.912 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 -- start start 2023-12-19T16:16:19.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4d80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4d806d1a0 0x7fa4d80cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80ca6f0 con 0x7fa4d80cbe90 2023-12-19T16:16:19.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80cccb0 con 0x7fa4d806d1a0 2023-12-19T16:16:19.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4ddd52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8159530 con 0x7fa4d806ddf0 2023-12-19T16:16:19.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4cffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa4d80cbe90 0x7fa4d8070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56222/0 (socket says 172.21.15.73:56222) 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4cffff640 1 -- 172.21.15.73:0/3729843886 learned_addr learned my addr 172.21.15.73:0/3729843886 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d77fe640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4d80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d7fff640 1 --2- 172.21.15.73:0/3729843886 >> v2:172.21.15.162:3300/0 conn(0x7fa4d806d1a0 0x7fa4d80cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389554522 0 0) 0x7fa4d80ca6f0 con 0x7fa4d80cbe90 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4c4003530 con 0x7fa4d80cbe90 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147429999 0 0) 0x7fa4c4003530 con 0x7fa4d80cbe90 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 msgr2=0x7fa4d80cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4d80cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 >> v2:172.21.15.162:3300/0 conn(0x7fa4d806d1a0 msgr2=0x7fa4d80cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 --2- 172.21.15.73:0/3729843886 >> v2:172.21.15.162:3300/0 conn(0x7fa4d806d1a0 0x7fa4d80cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80c9ae0 con 0x7fa4d80cbe90 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fa4c0001680 con 0x7fa4d80cbe90 2023-12-19T16:16:19.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 >> v1:172.21.15.73:6789/0 conn(0x7fa4d80cbe90 legacy=0x7fa4d8070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4003980 0x7fa4c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4c40047d0 0x7fa4c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8159530 con 0x7fa4c40047d0 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c400b990 con 0x7fa4c4003980 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c400bad0 con 0x7fa4d806ddf0 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4cffff640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4c40047d0 0x7fa4c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d77fe640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4003980 0x7fa4c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.908+0000 7fa4d7fff640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 -- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 msgr2=0x7fa4c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4d806ddf0 0x7fa4c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 -- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4003980 msgr2=0x7fa4c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4c4003980 0x7fa4c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 -- 172.21.15.73:0/3729843886 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c4003530 con 0x7fa4c40047d0 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4cffff640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4c40047d0 0x7fa4c4004c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c210 tx=0x7fa4c001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b044268fe02a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c00a8ce0 con 0x7fa4c40047d0 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c00a8e40 con 0x7fa4c40047d0 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4d6ffd640 1 -- 172.21.15.73:0/3729843886 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0005b00 con 0x7fa4c40047d0 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4ddd52640 1 -- 172.21.15.73:0/3729843886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4c40047d0 msgr2=0x7fa4c4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/3729843886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4c40047d0 0x7fa4c4004c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000c210 tx=0x7fa4c001f3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4d7fff640 1 -- 172.21.15.73:0/3729843886 reap_dead start 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4ddd52640 1 -- 172.21.15.73:0/3729843886 shutdown_connections 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.912+0000 7fa4ddd52640 1 -- 172.21.15.73:0/3729843886 >> 172.21.15.73:0/3729843886 conn(0x7fa4d80b0270 msgr2=0x7fa4d80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- 172.21.15.73:0/3729843886 shutdown_connections 2023-12-19T16:16:19.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- 172.21.15.73:0/3729843886 wait complete. 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 Processor -- start 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- start start 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40047d0 0x7fa4d80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d80b33b0 0x7fa4d81f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80c1fb0 con 0x7fa4d80b3830 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80b25c0 con 0x7fa4d80b33b0 2023-12-19T16:16:19.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80b28a0 con 0x7fa4c40047d0 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60002/0 (socket says 172.21.15.73:60002) 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 -- 172.21.15.73:0/4190575585 learned_addr learned my addr 172.21.15.73:0/4190575585 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d77fe640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40047d0 0x7fa4d80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4cffff640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d80b33b0 0x7fa4d81f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 -- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40047d0 msgr2=0x7fa4d80b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40047d0 0x7fa4d80b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 -- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d80b33b0 msgr2=0x7fa4d81f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d80b33b0 0x7fa4d81f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 -- 172.21.15.73:0/4190575585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80b2b80 con 0x7fa4d80b3830 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d7fff640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80c1ee0 tx=0x7fa4d000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d000e040 con 0x7fa4d80b3830 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d000f040 con 0x7fa4d80b3830 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0015670 con 0x7fa4d80b3830 2023-12-19T16:16:19.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.916+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d80b2e60 con 0x7fa4d80b3830 2023-12-19T16:16:19.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81f4b20 con 0x7fa4d80b3830 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8074050 con 0x7fa4d80b3830 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4d00157d0 con 0x7fa4d80b3830 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4d4ff9640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 0x7fa4b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4d0083ad0 con 0x7fa4d80b3830 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4d77fe640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 0x7fa4b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:19.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.920+0000 7fa4d77fe640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 0x7fa4b8067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80099e0 tx=0x7fa4c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:19.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:19.924+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa4d0051360 con 0x7fa4d80b3830 2023-12-19T16:16:20.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.104+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa4d80ce230 con 0x7fa4d80b3830 2023-12-19T16:16:20.110 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-19T16:16:20.104+0000 7f8e22455640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:16:20.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4d4ff9640 1 -- 172.21.15.73:0/4190575585 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa4d0054980 con 0x7fa4d80b3830 2023-12-19T16:16:20.120 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 msgr2=0x7fa4b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 0x7fa4b8067f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80099e0 tx=0x7fa4c8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 msgr2=0x7fa4d81f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80c1ee0 tx=0x7fa4d000f580 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 shutdown_connections 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa4b8065a60 0x7fa4b8067f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4d80b3830 0x7fa4d81f45e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4d80b33b0 0x7fa4d81f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 --2- 172.21.15.73:0/4190575585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4c40047d0 0x7fa4d80b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 >> 172.21.15.73:0/4190575585 conn(0x7fa4d80b0270 msgr2=0x7fa4d80ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 shutdown_connections 2023-12-19T16:16:20.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.116+0000 7fa4ddd52640 1 -- 172.21.15.73:0/4190575585 wait complete. 2023-12-19T16:16:20.132 INFO:tasks.ceph.mds.b.smithi162.stderr: -6502> 2023-12-19T16:15:45.108+0000 7f3741fd1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:16:20.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:16:20.186 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:16:20.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 Processor -- start 2023-12-19T16:16:20.285 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 -- start start 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9e41598c0 0x7fd9e406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e40cce80 con 0x7fd9e406d410 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e406cad0 con 0x7fd9e40b0830 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ec2fc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e40cc270 con 0x7fd9e41598c0 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9e9897640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd9e406d410 0x7fd9e40b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56232/0 (socket says 172.21.15.73:56232) 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9e9897640 1 -- 172.21.15.73:0/3535365883 learned_addr learned my addr 172.21.15.73:0/3535365883 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.280+0000 7fd9ea098640 1 --2- 172.21.15.73:0/3535365883 >> v2:172.21.15.162:3300/0 conn(0x7fd9e41598c0 0x7fd9e406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9ea098640 1 -- 172.21.15.73:0/3535365883 >> v1:172.21.15.162:6789/0 conn(0x7fd9e40b0830 legacy=0x7fd9e40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9ea098640 1 -- 172.21.15.73:0/3535365883 >> v1:172.21.15.73:6789/0 conn(0x7fd9e406d410 legacy=0x7fd9e40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9ea098640 1 -- 172.21.15.73:0/3535365883 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40cc550 con 0x7fd9e41598c0 2023-12-19T16:16:20.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9ea098640 1 --2- 172.21.15.73:0/3535365883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e41598c0 0x7fd9e406c590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00097c0 tx=0x7fd9e001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90affc1fe10eeaa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9e9096640 1 -- 172.21.15.73:0/3535365883 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00ab650 con 0x7fd9e41598c0 2023-12-19T16:16:20.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9e9096640 1 -- 172.21.15.73:0/3535365883 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e00ab7b0 con 0x7fd9e41598c0 2023-12-19T16:16:20.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.284+0000 7fd9e9096640 1 -- 172.21.15.73:0/3535365883 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00abb40 con 0x7fd9e41598c0 2023-12-19T16:16:20.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/3535365883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e41598c0 msgr2=0x7fd9e406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/3535365883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e41598c0 0x7fd9e406c590 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00097c0 tx=0x7fd9e001c450 comp rx=0 tx=0).stop 2023-12-19T16:16:20.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/3535365883 shutdown_connections 2023-12-19T16:16:20.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/3535365883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e41598c0 0x7fd9e406c590 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/3535365883 >> 172.21.15.73:0/3535365883 conn(0x7fd9e406a570 msgr2=0x7fd9e40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:20.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/3535365883 shutdown_connections 2023-12-19T16:16:20.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/3535365883 wait complete. 2023-12-19T16:16:20.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 Processor -- start 2023-12-19T16:16:20.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- start start 2023-12-19T16:16:20.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e406d410 0x7fd9e414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9e40b0830 0x7fd9e4156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e414cb20 con 0x7fd9e41598c0 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e414f790 con 0x7fd9e406d410 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ec2fc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e41583c0 con 0x7fd9e40b0830 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60006/0 (socket says 172.21.15.73:60006) 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 -- 172.21.15.73:0/2317396543 learned_addr learned my addr 172.21.15.73:0/2317396543 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea098640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e406d410 0x7fd9e414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9e9897640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9e40b0830 0x7fd9e4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 -- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9e40b0830 msgr2=0x7fd9e4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9e40b0830 0x7fd9e4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 -- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e406d410 msgr2=0x7fd9e414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e406d410 0x7fd9e414f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:20.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 -- 172.21.15.73:0/2317396543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e0009420 con 0x7fd9e41598c0 2023-12-19T16:16:20.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.288+0000 7fd9ea899640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c7a0 tx=0x7fd9dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc003b80 con 0x7fd9e41598c0 2023-12-19T16:16:20.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc003ce0 con 0x7fd9e41598c0 2023-12-19T16:16:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc00aa30 con 0x7fd9e41598c0 2023-12-19T16:16:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e41586a0 con 0x7fd9e41598c0 2023-12-19T16:16:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e414b590 con 0x7fd9e41598c0 2023-12-19T16:16:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e404e070 con 0x7fd9e41598c0 2023-12-19T16:16:20.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd9dc00ab90 con 0x7fd9e41598c0 2023-12-19T16:16:20.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 0x7fd9c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:20.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd9dc082f20 con 0x7fd9e41598c0 2023-12-19T16:16:20.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.292+0000 7fd9ea098640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 0x7fd9c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:20.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.296+0000 7fd9ea098640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 0x7fd9c8067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00af000 tx=0x7fd9e00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:20.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.296+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9dc050890 con 0x7fd9e41598c0 2023-12-19T16:16:20.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:20.480+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd9e406ced0 con 0x7fd9e41598c0 2023-12-19T16:16:21.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9daffd640 1 -- 172.21.15.73:0/2317396543 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd9dc053eb0 con 0x7fd9e41598c0 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 msgr2=0x7fd9c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 0x7fd9c8067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9e00af000 tx=0x7fd9e00a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 msgr2=0x7fd9e4153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00c7a0 tx=0x7fd9dc00cc60 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 shutdown_connections 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd9c8065a60 0x7fd9c8067f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9e41598c0 0x7fd9e4153690 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9e40b0830 0x7fd9e4156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 --2- 172.21.15.73:0/2317396543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e406d410 0x7fd9e414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 >> 172.21.15.73:0/2317396543 conn(0x7fd9e406a570 msgr2=0x7fd9e40cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 shutdown_connections 2023-12-19T16:16:21.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.120+0000 7fd9ec2fc640 1 -- 172.21.15.73:0/2317396543 wait complete. 2023-12-19T16:16:21.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:16:21.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 Processor -- start 2023-12-19T16:16:21.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 -- start start 2023-12-19T16:16:21.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feaa4158650 0x7feaa4070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7feaa406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa406ffb0 con 0x7feaa4158270 2023-12-19T16:16:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa415b730 con 0x7feaa4158650 2023-12-19T16:16:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaaaf60640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415ba10 con 0x7feaa415e4d0 2023-12-19T16:16:21.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaa8cfc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feaa4158270 0x7feaa415aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56244/0 (socket says 172.21.15.73:56244) 2023-12-19T16:16:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaa8cfc640 1 -- 172.21.15.73:0/1757295733 learned_addr learned my addr 172.21.15.73:0/1757295733 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9bfff640 1 --2- 172.21.15.73:0/1757295733 >> v2:172.21.15.162:3300/0 conn(0x7feaa4158650 0x7feaa4070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaa94fd640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7feaa406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153765815 0 0) 0x7feaa406ffb0 con 0x7feaa4158270 2023-12-19T16:16:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea8c003530 con 0x7feaa4158270 2023-12-19T16:16:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2977538737 0 0) 0x7fea8c003530 con 0x7feaa4158270 2023-12-19T16:16:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 msgr2=0x7feaa406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7feaa406bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 >> v2:172.21.15.162:3300/0 conn(0x7feaa4158650 msgr2=0x7feaa4070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 --2- 172.21.15.73:0/1757295733 >> v2:172.21.15.162:3300/0 conn(0x7feaa4158650 0x7feaa4070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa415bcf0 con 0x7feaa4158270 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7feaa0001680 con 0x7feaa4158270 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 >> v1:172.21.15.73:6789/0 conn(0x7feaa4158270 legacy=0x7feaa415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea8c003980 0x7fea8c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7fea8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c004d10 0x7fea8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415b730 con 0x7fea8c003980 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa415ba10 con 0x7fea8c004d10 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c00b990 con 0x7feaa415e4d0 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea8c003980 0x7fea8c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.288+0000 7feaa94fd640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c004d10 0x7fea8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7fea9bfff640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7fea8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 -- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 msgr2=0x7fea8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feaa415e4d0 0x7fea8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 -- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c004d10 msgr2=0x7fea8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea8c004d10 0x7fea8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 -- 172.21.15.73:0/1757295733 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c003530 con 0x7fea8c003980 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea8c003980 0x7fea8c003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c240 tx=0x7feaa001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa527de6f24855ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0005ae0 con 0x7fea8c003980 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0005c40 con 0x7fea8c003980 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7fea9b7fe640 1 -- 172.21.15.73:0/1757295733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00a5800 con 0x7fea8c003980 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 -- 172.21.15.73:0/1757295733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea8c003980 msgr2=0x7fea8c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 --2- 172.21.15.73:0/1757295733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea8c003980 0x7fea8c003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feaa000c240 tx=0x7feaa001cc10 comp rx=0 tx=0).stop 2023-12-19T16:16:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaa94fd640 1 -- 172.21.15.73:0/1757295733 reap_dead start 2023-12-19T16:16:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 -- 172.21.15.73:0/1757295733 shutdown_connections 2023-12-19T16:16:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 -- 172.21.15.73:0/1757295733 >> 172.21.15.73:0/1757295733 conn(0x7feaa406a570 msgr2=0x7feaa40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 -- 172.21.15.73:0/1757295733 shutdown_connections 2023-12-19T16:16:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.292+0000 7feaaaf60640 1 -- 172.21.15.73:0/1757295733 wait complete. 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 Processor -- start 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 -- start start 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea8c003980 0x7feaa415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 0x7feaa415cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c67a0 con 0x7feaa4148600 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c4ea0 con 0x7feaa40c5660 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa40c5b20 con 0x7fea8c003980 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60028/0 (socket says 172.21.15.73:60028) 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 -- 172.21.15.73:0/30518839 learned_addr learned my addr 172.21.15.73:0/30518839 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7fea9bfff640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 0x7feaa415cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea8c003980 0x7feaa415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 -- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea8c003980 msgr2=0x7feaa415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea8c003980 0x7feaa415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 -- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 msgr2=0x7feaa415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 0x7feaa415cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 -- 172.21.15.73:0/30518839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa40c5e00 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7fea9bfff640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 0x7feaa415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaa94fd640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feaa406e3b0 tx=0x7fea9c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00e070 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c011e10 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa40c60e0 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.296+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0039a0 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa4148f90 con 0x7feaa4148600 2023-12-19T16:16:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa404e070 con 0x7feaa4148600 2023-12-19T16:16:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea9c003b00 con 0x7feaa4148600 2023-12-19T16:16:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7fea997fa640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 0x7fea90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fea9c083890 con 0x7feaa4148600 2023-12-19T16:16:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 0x7fea90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.300+0000 7feaa8cfc640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 0x7fea90067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feaa00ab000 tx=0x7feaa00a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.304+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea9c0511e0 con 0x7feaa4148600 2023-12-19T16:16:21.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:21.464+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feaa40cf200 con 0x7feaa4148600 2023-12-19T16:16:22.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.380+0000 7fea997fa640 1 -- 172.21.15.73:0/30518839 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fea9c054800 con 0x7feaa4148600 2023-12-19T16:16:22.388 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:16:22.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.384+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 msgr2=0x7fea90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.384+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 0x7fea90067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feaa00ab000 tx=0x7feaa00a7070 comp rx=0 tx=0).stop 2023-12-19T16:16:22.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.384+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 msgr2=0x7feaa4148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.384+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feaa406e3b0 tx=0x7fea9c0115a0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 shutdown_connections 2023-12-19T16:16:22.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fea90065a60 0x7fea90067f20 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feaa00ab000 tx=0x7feaa00a7070 comp rx=0 tx=0).stop 2023-12-19T16:16:22.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa4148600 0x7feaa4148a50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feaa40c5660 0x7feaa415cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 --2- 172.21.15.73:0/30518839 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fea8c003980 0x7feaa415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.388+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 >> 172.21.15.73:0/30518839 conn(0x7feaa406a570 msgr2=0x7feaa40b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.392+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 shutdown_connections 2023-12-19T16:16:22.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.392+0000 7feaaaf60640 1 -- 172.21.15.73:0/30518839 wait complete. 2023-12-19T16:16:22.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:16:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 Processor -- start 2023-12-19T16:16:22.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 -- start start 2023-12-19T16:16:22.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b015e4d0 0x7f77b006bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b006ffb0 con 0x7f77b0158270 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b015b730 con 0x7f77b0158650 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b6725640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b015ba10 con 0x7f77b015e4d0 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77b4cc2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b015e4d0 0x7f77b006bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77affff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77b0158270 0x7f77b015aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56246/0 (socket says 172.21.15.73:56246) 2023-12-19T16:16:22.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.580+0000 7f77affff640 1 -- 172.21.15.73:0/1881743720 learned_addr learned my addr 172.21.15.73:0/1881743720 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1881743720 >> v1:172.21.15.162:6789/0 conn(0x7f77b0158650 legacy=0x7f77b0070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1881743720 >> v1:172.21.15.73:6789/0 conn(0x7f77b0158270 legacy=0x7f77b015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1881743720 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b015bcf0 con 0x7f77b015e4d0 2023-12-19T16:16:22.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77aeffd640 1 -- 172.21.15.73:0/1881743720 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720715340 0 0) 0x7f77b006ffb0 con 0x7f77b0158270 2023-12-19T16:16:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b4cc2640 1 --2- 172.21.15.73:0/1881743720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b006bb80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77b00701a0 tx=0x7f77a801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c200cfc87e954fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77aeffd640 1 -- 172.21.15.73:0/1881743720 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80a5950 con 0x7f77b015e4d0 2023-12-19T16:16:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77aeffd640 1 -- 172.21.15.73:0/1881743720 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80a5ab0 con 0x7f77b015e4d0 2023-12-19T16:16:22.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77aeffd640 1 -- 172.21.15.73:0/1881743720 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80a5e40 con 0x7f77b015e4d0 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 -- 172.21.15.73:0/1881743720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 msgr2=0x7f77b006bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 --2- 172.21.15.73:0/1881743720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b006bb80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f77b00701a0 tx=0x7f77a801c870 comp rx=0 tx=0).stop 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 -- 172.21.15.73:0/1881743720 shutdown_connections 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 --2- 172.21.15.73:0/1881743720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b006bb80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 -- 172.21.15.73:0/1881743720 >> 172.21.15.73:0/1881743720 conn(0x7f77b006a570 msgr2=0x7f77b00ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 -- 172.21.15.73:0/1881743720 shutdown_connections 2023-12-19T16:16:22.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.584+0000 7f77b6725640 1 -- 172.21.15.73:0/1881743720 wait complete. 2023-12-19T16:16:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 Processor -- start 2023-12-19T16:16:22.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 -- start start 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b0158270 0x7f77b01555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 0x7f77b014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00cc950 con 0x7f77b015e4d0 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01f9880 con 0x7f77b0158270 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b015d820 con 0x7f77b0158650 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60046/0 (socket says 172.21.15.73:60046) 2023-12-19T16:16:22.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1296926936 learned_addr learned my addr 172.21.15.73:0/1296926936 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77af7fe640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 0x7f77b014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77affff640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b0158270 0x7f77b01555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 msgr2=0x7f77b014f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 0x7f77b014f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b0158270 msgr2=0x7f77b01555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b0158270 0x7f77b01555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 -- 172.21.15.73:0/1296926936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a8009a70 con 0x7f77b015e4d0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77af7fe640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 0x7f77b014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b4cc2640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77a8019480 tx=0x7f77a8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80adca0 con 0x7f77b015e4d0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80ade00 con 0x7f77b015e4d0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80b8620 con 0x7f77b015e4d0 2023-12-19T16:16:22.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.588+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b015d540 con 0x7f77b015e4d0 2023-12-19T16:16:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00cc570 con 0x7f77b015e4d0 2023-12-19T16:16:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00cca90 con 0x7f77b015e4d0 2023-12-19T16:16:22.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77a80b8780 con 0x7f77b015e4d0 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77acff9640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f77a811e5d0 con 0x7f77b015e4d0 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77affff640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:22.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.592+0000 7f77affff640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 0x7f779c067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000f70 tx=0x7f77a0007240 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:22.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.596+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77b00cca90 con 0x7f77b015e4d0 2023-12-19T16:16:22.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:22.748+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77b00cca90 con 0x7f77b015e4d0 2023-12-19T16:16:23.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77acff9640 1 -- 172.21.15.73:0/1296926936 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f77b00cca90 con 0x7f77b015e4d0 2023-12-19T16:16:23.404 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 msgr2=0x7f779c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 0x7f779c067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77a0000f70 tx=0x7f77a0007240 comp rx=0 tx=0).stop 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 msgr2=0x7f77b00c2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77a8019480 tx=0x7f77a8019610 comp rx=0 tx=0).stop 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 shutdown_connections 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f779c065a60 0x7f779c067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b015e4d0 0x7f77b00c2c70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b0158650 0x7f77b014f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 --2- 172.21.15.73:0/1296926936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b0158270 0x7f77b01555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.400+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 >> 172.21.15.73:0/1296926936 conn(0x7f77b006a570 msgr2=0x7f77b0159640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.404+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 shutdown_connections 2023-12-19T16:16:23.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.404+0000 7f77b6725640 1 -- 172.21.15.73:0/1296926936 wait complete. 2023-12-19T16:16:23.434 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:16:23.435 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:16:23.435 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:23.435 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:16:23.435 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:16:23.435 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:16:23.435 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:23.436 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:16:23.436 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:16:23.436 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:23.436 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:16:23.436 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:16:23.436 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:16:23.436 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:23.452 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:16:23.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:16:23.452 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:16:23.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:16:23.454 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:16:23.454 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:16:23.455 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:16:23.455 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:16:23.502 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:16:23.502 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:23.503 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:16:23.503 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:23.504 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:16:23.504 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:23.504 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:16:23.505 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:23.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T16:16:23.592 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:16:23.592 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:16:23.593 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-19T16:16:23.594 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:16:23.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.664+0000 7fb312f6d640 1 Processor -- start 2023-12-19T16:16:23.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.664+0000 7fb312f6d640 1 -- start start 2023-12-19T16:16:23.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb312f6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb30c159830 0x7fb30c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb312f6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb30c0cdc40 0x7fb30c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb312f6d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c15ad00 con 0x7fb30c0b40b0 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb312f6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c15e110 con 0x7fb30c0cdc40 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb312f6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0ce2d0 con 0x7fb30c159830 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb30c0cdc40 0x7fb30c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb30bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb30c0b40b0 0x7fb30c0cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56280/0 (socket says 172.21.15.73:56280) 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb30bfff640 1 -- 172.21.15.73:0/277708998 learned_addr learned my addr 172.21.15.73:0/277708998 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:23.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb310d09640 1 --2- 172.21.15.73:0/277708998 >> v2:172.21.15.162:3300/0 conn(0x7fb30c159830 0x7fb30c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 -- 172.21.15.73:0/277708998 >> v2:172.21.15.162:3300/0 conn(0x7fb30c159830 msgr2=0x7fb30c15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:23.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 --2- 172.21.15.73:0/277708998 >> v2:172.21.15.162:3300/0 conn(0x7fb30c159830 0x7fb30c15a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 -- 172.21.15.73:0/277708998 >> v1:172.21.15.73:6789/0 conn(0x7fb30c0b40b0 legacy=0x7fb30c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 -- 172.21.15.73:0/277708998 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c15d490 con 0x7fb30c0cdc40 2023-12-19T16:16:23.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb30b7fe640 1 -- 172.21.15.73:0/277708998 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978542408 0 0) 0x7fb30c15ad00 con 0x7fb30c0b40b0 2023-12-19T16:16:23.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.668+0000 7fb31150a640 1 --2- 172.21.15.73:0/277708998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0cdc40 0x7fb30c0ca080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb30c06bf10 tx=0x7fb30401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1fdc65b9005433 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb30b7fe640 1 -- 172.21.15.73:0/277708998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a5910 con 0x7fb30c0cdc40 2023-12-19T16:16:23.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb30b7fe640 1 -- 172.21.15.73:0/277708998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040a5a70 con 0x7fb30c0cdc40 2023-12-19T16:16:23.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb30b7fe640 1 -- 172.21.15.73:0/277708998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a5e00 con 0x7fb30c0cdc40 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- 172.21.15.73:0/277708998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0cdc40 msgr2=0x7fb30c0ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- 172.21.15.73:0/277708998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0cdc40 0x7fb30c0ca080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb30c06bf10 tx=0x7fb30401c850 comp rx=0 tx=0).stop 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- 172.21.15.73:0/277708998 shutdown_connections 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- 172.21.15.73:0/277708998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c0cdc40 0x7fb30c0ca080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- 172.21.15.73:0/277708998 >> v2:172.21.15.162:3300/0 conn(0x7fb30c159830 0x7fb30c15a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- 172.21.15.73:0/277708998 >> 172.21.15.73:0/277708998 conn(0x7fb30c0b0270 msgr2=0x7fb30c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- 172.21.15.73:0/277708998 shutdown_connections 2023-12-19T16:16:23.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- 172.21.15.73:0/277708998 wait complete. 2023-12-19T16:16:23.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 Processor -- start 2023-12-19T16:16:23.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- start start 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb30c0b40b0 0x7fb30c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 0x7fb30c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c152e90 con 0x7fb30c159830 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c153130 con 0x7fb30c0cdc40 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb312f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c153410 con 0x7fb30c0b40b0 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb31150a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb31150a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60098/0 (socket says 172.21.15.73:60098) 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.672+0000 7fb31150a640 1 -- 172.21.15.73:0/3004413797 learned_addr learned my addr 172.21.15.73:0/3004413797 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb30bfff640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 0x7fb30c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 -- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb30c0b40b0 msgr2=0x7fb30c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb30c0b40b0 0x7fb30c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 -- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 msgr2=0x7fb30c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 0x7fb30c1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 -- 172.21.15.73:0/3004413797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304009a70 con 0x7fb30c159830 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb30bfff640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 0x7fb30c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb31150a640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb30401cd30 tx=0x7fb3040195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040ad850 con 0x7fb30c159830 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040ad9b0 con 0x7fb30c159830 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c1536f0 con 0x7fb30c159830 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040add40 con 0x7fb30c159830 2023-12-19T16:16:23.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c153cb0 con 0x7fb30c159830 2023-12-19T16:16:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c153ea0 con 0x7fb30c159830 2023-12-19T16:16:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3040b4070 con 0x7fb30c159830 2023-12-19T16:16:23.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 0x7fb2f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb30411d810 con 0x7fb30c159830 2023-12-19T16:16:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.676+0000 7fb310d09640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 0x7fb2f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:23.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.680+0000 7fb310d09640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 0x7fb2f0067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb300006aa0 tx=0x7fb300006a30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:23.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.680+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb3040eb5f0 con 0x7fb30c159830 2023-12-19T16:16:23.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:23.844+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb30c0c9ff0 con 0x7fb30c159830 2023-12-19T16:16:24.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.644+0000 7fb3097fa640 1 -- 172.21.15.73:0/3004413797 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb3040eec10 con 0x7fb30c159830 2023-12-19T16:16:24.649 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2023-12-19T16:16:24.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 msgr2=0x7fb2f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 0x7fb2f0067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb300006aa0 tx=0x7fb300006a30 comp rx=0 tx=0).stop 2023-12-19T16:16:24.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 msgr2=0x7fb30c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb30401cd30 tx=0x7fb3040195f0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 shutdown_connections 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb2f0065a60 0x7fb2f0067f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb30c159830 0x7fb30c1517c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb30c0cdc40 0x7fb30c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 --2- 172.21.15.73:0/3004413797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb30c0b40b0 0x7fb30c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 >> 172.21.15.73:0/3004413797 conn(0x7fb30c0b0270 msgr2=0x7fb30c0cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 shutdown_connections 2023-12-19T16:16:24.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.648+0000 7fb312f6d640 1 -- 172.21.15.73:0/3004413797 wait complete. 2023-12-19T16:16:24.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T16:16:24.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 Processor -- start 2023-12-19T16:16:24.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 -- start start 2023-12-19T16:16:24.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d0806bf50 0x7f3d0806b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3d080b0920 0x7f3d080ad480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080b1a40 con 0x7f3d080cd7b0 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d080d1760 con 0x7f3d080b0920 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0f925640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080b0e30 con 0x7f3d0806bf50 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3d080b0920 0x7f3d080ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3d080b0920 0x7f3d080ad480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55674/0 (socket says 172.21.15.73:55674) 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 -- 172.21.15.73:0/2377741393 learned_addr learned my addr 172.21.15.73:0/2377741393 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0cec0640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d0806bf50 0x7f3d0806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 -- 172.21.15.73:0/2377741393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d0806bf50 msgr2=0x7f3d0806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d0806bf50 0x7f3d0806b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 -- 172.21.15.73:0/2377741393 >> v1:172.21.15.162:6789/0 conn(0x7f3d080cd7b0 legacy=0x7f3d0806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.808+0000 7f3d0dec2640 1 -- 172.21.15.73:0/2377741393 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080b1110 con 0x7f3d080b0920 2023-12-19T16:16:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0dec2640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d080b0920 0x7f3d080ad480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009e50 tx=0x7f3d0001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eb14ad2989d36d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3cfffff640 1 -- 172.21.15.73:0/2377741393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000a57d0 con 0x7f3d080b0920 2023-12-19T16:16:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3cfffff640 1 -- 172.21.15.73:0/2377741393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d000a5930 con 0x7f3d080b0920 2023-12-19T16:16:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3cfffff640 1 -- 172.21.15.73:0/2377741393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000a5cc0 con 0x7f3d080b0920 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 -- 172.21.15.73:0/2377741393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d080b0920 msgr2=0x7f3d080ad480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d080b0920 0x7f3d080ad480 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009e50 tx=0x7f3d0001ca10 comp rx=0 tx=0).stop 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 -- 172.21.15.73:0/2377741393 shutdown_connections 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d080b0920 0x7f3d080ad480 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 --2- 172.21.15.73:0/2377741393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d0806bf50 0x7f3d0806b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 -- 172.21.15.73:0/2377741393 >> 172.21.15.73:0/2377741393 conn(0x7f3d080d08f0 msgr2=0x7f3d080d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 -- 172.21.15.73:0/2377741393 shutdown_connections 2023-12-19T16:16:24.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.812+0000 7f3d0f925640 1 -- 172.21.15.73:0/2377741393 wait complete. 2023-12-19T16:16:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 Processor -- start 2023-12-19T16:16:24.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- start start 2023-12-19T16:16:24.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d080b0920 0x7f3d0815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d080cd7b0 0x7f3d0815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0815f9b0 con 0x7f3d0806bf50 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d08153cf0 con 0x7f3d080cd7b0 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0815f6d0 con 0x7f3d080b0920 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55676/0 (socket says 172.21.15.73:55676) 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 -- 172.21.15.73:0/91426074 learned_addr learned my addr 172.21.15.73:0/91426074 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0dec2640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d080cd7b0 0x7f3d0815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0cec0640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d080b0920 0x7f3d0815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 -- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d080b0920 msgr2=0x7f3d0815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d080b0920 0x7f3d0815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 -- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d080cd7b0 msgr2=0x7f3d0815d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d080cd7b0 0x7f3d0815d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 -- 172.21.15.73:0/91426074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00009b30 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0d6c1640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c3c0 tx=0x7f3d0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040052d0 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d04005430 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04003840 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d080cdd10 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d080c5890 con 0x7f3d0806bf50 2023-12-19T16:16:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.816+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d08074050 con 0x7f3d0806bf50 2023-12-19T16:16:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.820+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3d040039a0 con 0x7f3d0806bf50 2023-12-19T16:16:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.820+0000 7f3cfdffb640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 0x7f3cec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.820+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d040822f0 con 0x7f3d0806bf50 2023-12-19T16:16:24.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.820+0000 7f3d0cec0640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 0x7f3cec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:24.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.820+0000 7f3d0cec0640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 0x7f3cec067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d080cccd0 tx=0x7f3cf8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:24.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:24.824+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3d040500a0 con 0x7f3d0806bf50 2023-12-19T16:16:25.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.024+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d080af550 con 0x7f3d0806bf50 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.024+0000 7f3cfdffb640 1 -- 172.21.15.73:0/91426074 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3d040536c0 con 0x7f3d0806bf50 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlEa21KBAAPi35lLT1QVm0TtqHtAkVBQ==", 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:16:25.030 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlPWcWNRAAg+P1Pb2YDSAluRy+kgP9vA==", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlHRYLMBAAe6JO4aNCG3tRKcf301jEGA==", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFlYT3lABAAvTiyPDU3fDNRgpUeTgQhMw==", 2023-12-19T16:16:25.032 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB0wYFlnEe8GhAAFy+bGsYQdTfzzRIvVsSmOg==", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB3wYFlUm36IhAA2xVp+ZXzw7xti1Pkx5KdIg==", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB6wYFlDtP5KRAAglWrB9m+EVDcWoUU1j7sNA==", 2023-12-19T16:16:25.034 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB9wYFlx9lDMBAA6L1/ZYNN8OrH77GacAfDlA==", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.035 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCEwYFlzK5bABAAm36Alvm7ZfE52fDUGc7GQQ==", 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2023-12-19T16:16:25.036 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCHwYFlCWpPBhAAjS701JMVRnTSQQ3tYx9fuQ==", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCKwYFlwfPDDBAAeQxfTEkcpet6fVrXEqwaSA==", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.037 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCNwYFlVxsgExAAWN8f82RULx+p0mTwVOf/SA==", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFlWX79BBAAAARcLd3AscjfpzZ6uWTRGw==", 2023-12-19T16:16:25.038 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFluZ2CDhAAydccccZqgYYK2rtJ5PQhSQ==", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:16:25.039 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFl1JX8ChAAB6m058FKdH4c1IyeCnnd3w==", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2023-12-19T16:16:25.040 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFl7tp6FBAAHqaB7TYTKy55/x3oA393gw==", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlpRNMDBAAhFBeHnFTKjx1PdD7B82YxA==", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:16:25.041 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFlAIESGhAA7I1Yv15nBDrs4RyWVn4vLw==", 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFl+YoSGhAAn8prEiUKVfdv90Q5t6gMbA==", 2023-12-19T16:16:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFlbJMSGhAAfXBbWuZsZdZ1LnoSK1nfUA==", 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFlxJsSGhAAH6G6WCWww/4R5DBRp1gXtg==", 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T16:16:25.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFlNKQSGhAAem5gBwbhCHNY7xOcPXZ/vg==", 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTwYFly6wSGhAAQMEy8ZYQj2/ymYkNOpkHsQ==", 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlSD18JBAAWCIX1iH3o6OdOn866TPV/Q==", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlUC6tIBAApfXknRNqcF6e4Va+YWlomQ==", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:16:25.045 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-19T16:16:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:16:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:25.046 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-12-19T16:16:25.046 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 msgr2=0x7f3cec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 0x7f3cec067f20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d080cccd0 tx=0x7f3cf8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 msgr2=0x7f3d081561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400c3c0 tx=0x7f3d0400c880 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 shutdown_connections 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d080cd7b0 0x7f3d0815d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d080b0920 0x7f3d0815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cec065a60 0x7f3cec067f20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 --2- 172.21.15.73:0/91426074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d0806bf50 0x7f3d081561e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 >> 172.21.15.73:0/91426074 conn(0x7f3d080d08f0 msgr2=0x7f3d0806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 shutdown_connections 2023-12-19T16:16:25.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.028+0000 7f3d0f925640 1 -- 172.21.15.73:0/91426074 wait complete. 2023-12-19T16:16:25.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T16:16:25.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 Processor -- start 2023-12-19T16:16:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 -- start start 2023-12-19T16:16:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 0x7f3ed00d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ed00d1920 0x7f3ed00cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed00b1ec0 con 0x7f3ed00cd6c0 2023-12-19T16:16:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed00cdb50 con 0x7f3ed00d1920 2023-12-19T16:16:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ed59a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00d1f10 con 0x7f3ed015cb20 2023-12-19T16:16:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3eceffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 0x7f3ed00d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ed00d1920 0x7f3ed00cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ed00d1920 0x7f3ed00cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51168/0 (socket says 172.21.15.73:51168) 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3eceffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 0x7f3ed00d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:39200/0 (socket says 172.21.15.73:39200) 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 -- 172.21.15.73:0/3064275193 learned_addr learned my addr 172.21.15.73:0/3064275193 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 -- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 msgr2=0x7f3ed00d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 --2- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 0x7f3ed00d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 -- 172.21.15.73:0/3064275193 >> v1:172.21.15.162:6789/0 conn(0x7f3ed00cd6c0 legacy=0x7f3ed00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.184+0000 7f3ece7fc640 1 -- 172.21.15.73:0/3064275193 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00d21b0 con 0x7f3ed00d1920 2023-12-19T16:16:25.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ece7fc640 1 --2- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00cd180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009870 tx=0x7f3ec401ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a5f5989ea62e330 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ecdffb640 1 -- 172.21.15.73:0/3064275193 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40a8a30 con 0x7f3ed00d1920 2023-12-19T16:16:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ecdffb640 1 -- 172.21.15.73:0/3064275193 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40a8b90 con 0x7f3ed00d1920 2023-12-19T16:16:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ecdffb640 1 -- 172.21.15.73:0/3064275193 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40b0440 con 0x7f3ed00d1920 2023-12-19T16:16:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 -- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 msgr2=0x7f3ed00cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00cd180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4009870 tx=0x7f3ec401ed30 comp rx=0 tx=0).stop 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 -- 172.21.15.73:0/3064275193 shutdown_connections 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00cd180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/3064275193 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed015cb20 0x7f3ed00d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 -- 172.21.15.73:0/3064275193 >> 172.21.15.73:0/3064275193 conn(0x7f3ed0065ce0 msgr2=0x7f3ed00660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 -- 172.21.15.73:0/3064275193 shutdown_connections 2023-12-19T16:16:25.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.188+0000 7f3ed59a6640 1 -- 172.21.15.73:0/3064275193 wait complete. 2023-12-19T16:16:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 Processor -- start 2023-12-19T16:16:25.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- start start 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed00cd6c0 0x7f3ed014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 0x7f3ed00cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00a9310 con 0x7f3ed015cb20 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00c6450 con 0x7f3ed00d1920 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed01f2940 con 0x7f3ed00cd6c0 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ecf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 0x7f3ed00cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3eceffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed00cd6c0 0x7f3ed014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ecf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 0x7f3ed00cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55678/0 (socket says 172.21.15.73:55678) 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ecf7fe640 1 -- 172.21.15.73:0/2554118443 learned_addr learned my addr 172.21.15.73:0/2554118443 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 -- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed00cd6c0 msgr2=0x7f3ed014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed00cd6c0 0x7f3ed014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 -- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 msgr2=0x7f3ed00cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 0x7f3ed00cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 -- 172.21.15.73:0/2554118443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40094d0 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ece7fc640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00c6bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40af000 tx=0x7f3ec401bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40be070 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec40ba400 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed01f2c20 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40ba7d0 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.192+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00c66a0 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed01f3140 con 0x7f3ed00d1920 2023-12-19T16:16:25.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ec40c3410 con 0x7f3ed00d1920 2023-12-19T16:16:25.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3eb7fff640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 0x7f3ebc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ec4120830 con 0x7f3ed00d1920 2023-12-19T16:16:25.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3eceffd640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 0x7f3ebc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.196+0000 7f3eceffd640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 0x7f3ebc067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009ac0 tx=0x7f3ec0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.200+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ec40ee5e0 con 0x7f3ed00d1920 2023-12-19T16:16:25.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.404+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3ed00d2750 con 0x7f3ed00d1920 2023-12-19T16:16:25.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.412+0000 7f3eb7fff640 1 -- 172.21.15.73:0/2554118443 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3ed00d2750 con 0x7f3ed00d1920 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 msgr2=0x7f3ebc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 0x7f3ebc067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009ac0 tx=0x7f3ec0009190 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 msgr2=0x7f3ed00c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00c6bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40af000 tx=0x7f3ec401bad0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 shutdown_connections 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ebc065a60 0x7f3ebc067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ed015cb20 0x7f3ed00cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ed00d1920 0x7f3ed00c6bc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 --2- 172.21.15.73:0/2554118443 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ed00cd6c0 0x7f3ed014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 >> 172.21.15.73:0/2554118443 conn(0x7f3ed0065ce0 msgr2=0x7f3ed00b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 shutdown_connections 2023-12-19T16:16:25.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.416+0000 7f3ed59a6640 1 -- 172.21.15.73:0/2554118443 wait complete. 2023-12-19T16:16:25.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T16:16:25.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 Processor -- start 2023-12-19T16:16:25.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 -- start start 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6b00b40b0 0x7fe6b015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b015ad00 con 0x7fe6b00cdc40 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b00ce2d0 con 0x7fe6b0159830 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.572+0000 7fe6b690a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b015e110 con 0x7fe6b00b40b0 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6af7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe6b00cdc40 0x7fe6b00ca080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56056/0 (socket says 172.21.15.73:56056) 2023-12-19T16:16:25.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6af7fe640 1 -- 172.21.15.73:0/2009470051 learned_addr learned my addr 172.21.15.73:0/2009470051 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6b4ea7640 1 --2- 172.21.15.73:0/2009470051 >> v2:172.21.15.162:3300/0 conn(0x7fe6b00b40b0 0x7fe6b015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6aeffd640 1 -- 172.21.15.73:0/2009470051 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941582654 0 0) 0x7fe6b015ad00 con 0x7fe6b00cdc40 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6aeffd640 1 -- 172.21.15.73:0/2009470051 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe698003530 con 0x7fe6b00cdc40 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6b4ea7640 1 -- 172.21.15.73:0/2009470051 >> v1:172.21.15.162:6789/0 conn(0x7fe6b0159830 legacy=0x7fe6b00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6b4ea7640 1 -- 172.21.15.73:0/2009470051 >> v1:172.21.15.73:6789/0 conn(0x7fe6b00cdc40 legacy=0x7fe6b00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.580 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6b4ea7640 1 -- 172.21.15.73:0/2009470051 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b015d490 con 0x7fe6b00b40b0 2023-12-19T16:16:25.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.576+0000 7fe6b4ea7640 1 --2- 172.21.15.73:0/2009470051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00b40b0 0x7fe6b015a7c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009d90 tx=0x7fe6a801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=341acef8c7a9f7b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6aeffd640 1 -- 172.21.15.73:0/2009470051 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80a5950 con 0x7fe6b00b40b0 2023-12-19T16:16:25.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6aeffd640 1 -- 172.21.15.73:0/2009470051 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a80a5ab0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6aeffd640 1 -- 172.21.15.73:0/2009470051 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80a5e40 con 0x7fe6b00b40b0 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- 172.21.15.73:0/2009470051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00b40b0 msgr2=0x7fe6b015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2009470051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00b40b0 0x7fe6b015a7c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009d90 tx=0x7fe6a801c890 comp rx=0 tx=0).stop 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- 172.21.15.73:0/2009470051 shutdown_connections 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2009470051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00b40b0 0x7fe6b015a7c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- 172.21.15.73:0/2009470051 >> 172.21.15.73:0/2009470051 conn(0x7fe6b00b0270 msgr2=0x7fe6b00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- 172.21.15.73:0/2009470051 shutdown_connections 2023-12-19T16:16:25.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- 172.21.15.73:0/2009470051 wait complete. 2023-12-19T16:16:25.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 Processor -- start 2023-12-19T16:16:25.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- start start 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00cdc40 0x7fe6b006d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6b0159830 0x7fe6b00ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b014b9a0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b014bc80 con 0x7fe6b00cdc40 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6b690a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b014bf60 con 0x7fe6b0159830 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6affff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6affff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55686/0 (socket says 172.21.15.73:55686) 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6affff640 1 -- 172.21.15.73:0/2276995993 learned_addr learned my addr 172.21.15.73:0/2276995993 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:25.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.580+0000 7fe6af7fe640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00cdc40 0x7fe6b006d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6b4ea7640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6b0159830 0x7fe6b00ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 -- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6b0159830 msgr2=0x7fe6b00ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6b0159830 0x7fe6b00ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 -- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00cdc40 msgr2=0x7fe6b006d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00cdc40 0x7fe6b006d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 -- 172.21.15.73:0/2276995993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8009a70 con 0x7fe6b00b40b0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6affff640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c3c0 tx=0x7fe6a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00052d0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0005430 con 0x7fe6b00b40b0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0003840 con 0x7fe6b00b40b0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b014c240 con 0x7fe6b00b40b0 2023-12-19T16:16:25.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b014cde0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b0074050 con 0x7fe6b00b40b0 2023-12-19T16:16:25.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6a00039a0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 0x7fe69c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6a0082380 con 0x7fe6b00b40b0 2023-12-19T16:16:25.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.584+0000 7fe6af7fe640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 0x7fe69c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.588+0000 7fe6af7fe640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 0x7fe69c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0156320 tx=0x7fe6a4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.588+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe6a0050090 con 0x7fe6b00b40b0 2023-12-19T16:16:25.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.792+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe6b00cbfc0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.796+0000 7fe6acff9640 1 -- 172.21.15.73:0/2276995993 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe6a00536b0 con 0x7fe6b00b40b0 2023-12-19T16:16:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 msgr2=0x7fe69c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 0x7fe69c067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0156320 tx=0x7fe6a4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 msgr2=0x7fe6b00ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c3c0 tx=0x7fe6a000c880 comp rx=0 tx=0).stop 2023-12-19T16:16:25.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 shutdown_connections 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6b0159830 0x7fe6b00ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6b00cdc40 0x7fe6b006d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe69c065a60 0x7fe69c067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 --2- 172.21.15.73:0/2276995993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6b00b40b0 0x7fe6b00ccca0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 >> 172.21.15.73:0/2276995993 conn(0x7fe6b00b0270 msgr2=0x7fe6b00709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 shutdown_connections 2023-12-19T16:16:25.806 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.800+0000 7fe6b690a640 1 -- 172.21.15.73:0/2276995993 wait complete. 2023-12-19T16:16:25.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T16:16:25.962 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.956+0000 7f1e0662d640 1 Processor -- start 2023-12-19T16:16:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.956+0000 7f1e0662d640 1 -- start start 2023-12-19T16:16:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e0662d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e0662d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e000b26a0 0x7f1e000c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.963 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e0662d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e000c9940 con 0x7f1e000c8fa0 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e0662d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0006d720 con 0x7f1e000b26a0 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e0662d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0015e3a0 con 0x7f1e0015dfc0 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e000b26a0 0x7f1e000c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:39236/0 (socket says 172.21.15.73:39236) 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e000b26a0 0x7f1e000c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:51194/0 (socket says 172.21.15.73:51194) 2023-12-19T16:16:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1dfffff640 1 -- 172.21.15.73:0/297693343 learned_addr learned my addr 172.21.15.73:0/297693343 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:25.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 -- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 msgr2=0x7f1e000cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:25.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 -- 172.21.15.73:0/297693343 >> v1:172.21.15.162:6789/0 conn(0x7f1e000c8fa0 legacy=0x7f1e00070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1e04bca640 1 -- 172.21.15.73:0/297693343 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0006c3a0 con 0x7f1e000b26a0 2023-12-19T16:16:25.965 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.960+0000 7f1dfffff640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:25.967 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e04bca640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000b26a0 0x7f1e000c9400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009d90 tx=0x7f1df801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8aa9496ab7f6d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1dfeffd640 1 -- 172.21.15.73:0/297693343 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80a5900 con 0x7f1e000b26a0 2023-12-19T16:16:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1dfeffd640 1 -- 172.21.15.73:0/297693343 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df80a5a60 con 0x7f1e000b26a0 2023-12-19T16:16:25.968 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1dfeffd640 1 -- 172.21.15.73:0/297693343 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df80a5df0 con 0x7f1e000b26a0 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000b26a0 msgr2=0x7f1e000c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000b26a0 0x7f1e000c9400 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009d90 tx=0x7f1df801c920 comp rx=0 tx=0).stop 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- 172.21.15.73:0/297693343 shutdown_connections 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000b26a0 0x7f1e000c9400 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 --2- 172.21.15.73:0/297693343 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e000cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- 172.21.15.73:0/297693343 >> 172.21.15.73:0/297693343 conn(0x7f1e000b0270 msgr2=0x7f1e000b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- 172.21.15.73:0/297693343 shutdown_connections 2023-12-19T16:16:25.969 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- 172.21.15.73:0/297693343 wait complete. 2023-12-19T16:16:25.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 Processor -- start 2023-12-19T16:16:25.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.964+0000 7f1e0662d640 1 -- start start 2023-12-19T16:16:25.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000c8fa0 0x7f1e000af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e00150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000af2b0 con 0x7f1e000b26a0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c3df0 con 0x7f1e000c8fa0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e000c3500 con 0x7f1e0015dfc0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55700/0 (socket says 172.21.15.73:55700) 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 -- 172.21.15.73:0/1759217760 learned_addr learned my addr 172.21.15.73:0/1759217760 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dff7fe640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000c8fa0 0x7f1e000af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e04bca640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e00150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 -- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 msgr2=0x7f1e00150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e00150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 -- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000c8fa0 msgr2=0x7f1e000af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000c8fa0 0x7f1e000af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 -- 172.21.15.73:0/1759217760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df00094d0 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfffff640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1df000e9d0 tx=0x7f1df000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000ca60 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df000cbc0 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df8009a70 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0013470 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e000c37a0 con 0x7f1e000b26a0 2023-12-19T16:16:25.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e000b1bf0 con 0x7f1e000b26a0 2023-12-19T16:16:25.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.968+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1df00135d0 con 0x7f1e000b26a0 2023-12-19T16:16:25.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.972+0000 7f1dfcff9640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 0x7f1dec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:25.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.972+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1df0083200 con 0x7f1e000b26a0 2023-12-19T16:16:25.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.972+0000 7f1dff7fe640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 0x7f1dec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:25.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.972+0000 7f1dff7fe640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 0x7f1dec067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b3b70 tx=0x7f1df4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:25.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:25.976+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1df0050df0 con 0x7f1e000b26a0 2023-12-19T16:16:26.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.176+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1e00074050 con 0x7f1e000b26a0 2023-12-19T16:16:26.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.180+0000 7f1dfcff9640 1 -- 172.21.15.73:0/1759217760 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1df0054410 con 0x7f1e000b26a0 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 msgr2=0x7f1dec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 0x7f1dec067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e000b3b70 tx=0x7f1df4009040 comp rx=0 tx=0).stop 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 msgr2=0x7f1e000c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1df000e9d0 tx=0x7f1df000ee90 comp rx=0 tx=0).stop 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 shutdown_connections 2023-12-19T16:16:26.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e0015dfc0 0x7f1e00150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e000c8fa0 0x7f1e000af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1dec065a60 0x7f1dec067f20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 --2- 172.21.15.73:0/1759217760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e000b26a0 0x7f1e000c5810 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 >> 172.21.15.73:0/1759217760 conn(0x7f1e000b0270 msgr2=0x7f1e0015d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 shutdown_connections 2023-12-19T16:16:26.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.184+0000 7f1e0662d640 1 -- 172.21.15.73:0/1759217760 wait complete. 2023-12-19T16:16:26.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T16:16:26.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 Processor -- start 2023-12-19T16:16:26.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 -- start start 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 0x7fbb5c167c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0cc8f0 con 0x7fbb5c0cba40 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0ccbd0 con 0x7fbb5c0cc310 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.340+0000 7fbb62f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0cceb0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb60cee640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbb5c0cba40 0x7fbb5c1612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56066/0 (socket says 172.21.15.73:56066) 2023-12-19T16:16:26.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb60cee640 1 -- 172.21.15.73:0/270307382 learned_addr learned my addr 172.21.15.73:0/270307382 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:26.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb614ef640 1 --2- 172.21.15.73:0/270307382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 0x7fbb5c167c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573310946 0 0) 0x7fbb5c0cc8f0 con 0x7fbb5c0cba40 2023-12-19T16:16:26.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb44003530 con 0x7fbb5c0cba40 2023-12-19T16:16:26.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779081017 0 0) 0x7fbb5c0ccbd0 con 0x7fbb5c0cc310 2023-12-19T16:16:26.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb5c0cc8f0 con 0x7fbb5c0cc310 2023-12-19T16:16:26.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb614ef640 1 -- 172.21.15.73:0/270307382 >> v1:172.21.15.162:6789/0 conn(0x7fbb5c0cc310 legacy=0x7fbb5c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb614ef640 1 -- 172.21.15.73:0/270307382 >> v1:172.21.15.73:6789/0 conn(0x7fbb5c0cba40 legacy=0x7fbb5c1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb614ef640 1 -- 172.21.15.73:0/270307382 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0cd190 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.344+0000 7fbb614ef640 1 --2- 172.21.15.73:0/270307382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 0x7fbb5c167c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009dc0 tx=0x7fbb5401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ffc8cf67b39d65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540af600 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540ab050 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb537fe640 1 -- 172.21.15.73:0/270307382 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540af980 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- 172.21.15.73:0/270307382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 msgr2=0x7fbb5c167c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 --2- 172.21.15.73:0/270307382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 0x7fbb5c167c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009dc0 tx=0x7fbb5401f150 comp rx=0 tx=0).stop 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- 172.21.15.73:0/270307382 shutdown_connections 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 --2- 172.21.15.73:0/270307382 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c06cdb0 0x7fbb5c167c50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- 172.21.15.73:0/270307382 >> 172.21.15.73:0/270307382 conn(0x7fbb5c0b0270 msgr2=0x7fbb5c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- 172.21.15.73:0/270307382 shutdown_connections 2023-12-19T16:16:26.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- 172.21.15.73:0/270307382 wait complete. 2023-12-19T16:16:26.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 Processor -- start 2023-12-19T16:16:26.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- start start 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb5c0cba40 0x7fbb5c14bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 0x7fbb5c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c14c170 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0b1360 con 0x7fbb5c0cba40 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.348+0000 7fbb62f52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c15ade0 con 0x7fbb5c0cc310 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.356 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55702/0 (socket says 172.21.15.73:55702) 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 -- 172.21.15.73:0/383473312 learned_addr learned my addr 172.21.15.73:0/383473312 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb614ef640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 0x7fbb5c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb53fff640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb5c0cba40 0x7fbb5c14bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 -- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 msgr2=0x7fbb5c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 0x7fbb5c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 -- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb5c0cba40 msgr2=0x7fbb5c14bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb5c0cba40 0x7fbb5c14bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 -- 172.21.15.73:0/383473312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54009a70 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb614ef640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 0x7fbb5c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb60cee640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c4d0 tx=0x7fbb5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58005cf0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58005e50 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c15b0c0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580072b0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c0b1570 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c074050 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb58007410 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 0x7fbb48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb580824b0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.352+0000 7fbb53fff640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 0x7fbb48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.356+0000 7fbb53fff640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 0x7fbb48067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c1f5b80 tx=0x7fbb4c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.356+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb58050140 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.565 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.560+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbb5c0cd7b0 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.570 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.564+0000 7fbb517fa640 1 -- 172.21.15.73:0/383473312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbb58017020 con 0x7fbb5c06cdb0 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 msgr2=0x7fbb48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 0x7fbb48067f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c1f5b80 tx=0x7fbb4c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 msgr2=0x7fbb5c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c4d0 tx=0x7fbb5800c990 comp rx=0 tx=0).stop 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 shutdown_connections 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb5c0cc310 0x7fbb5c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb5c0cba40 0x7fbb5c14bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.573 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbb48065a60 0x7fbb48067f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 --2- 172.21.15.73:0/383473312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06cdb0 0x7fbb5c0c7f10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 >> 172.21.15.73:0/383473312 conn(0x7fbb5c0b0270 msgr2=0x7fbb5c1605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 shutdown_connections 2023-12-19T16:16:26.574 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.568+0000 7fbb62f52640 1 -- 172.21.15.73:0/383473312 wait complete. 2023-12-19T16:16:26.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T16:16:26.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 Processor -- start 2023-12-19T16:16:26.731 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 -- start start 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 0x7f776c0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f776c0d3000 0x7f776c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c0cdf10 con 0x7f776c160270 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c06b040 con 0x7f776c0d3000 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f77717a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c0ce160 con 0x7f776c0d15e0 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f776bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f776c160270 0x7f776c0d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56068/0 (socket says 172.21.15.73:56068) 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f776bfff640 1 -- 172.21.15.73:0/1580556556 learned_addr learned my addr 172.21.15.73:0/1580556556 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:26.733 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f7770fa1640 1 --2- 172.21.15.73:0/1580556556 >> v2:172.21.15.73:3300/0 conn(0x7f776c0d3000 0x7f776c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f776b7fe640 1 --2- 172.21.15.73:0/1580556556 >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 0x7f776c0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f7770fa1640 1 -- 172.21.15.73:0/1580556556 >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 msgr2=0x7f776c0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f7770fa1640 1 --2- 172.21.15.73:0/1580556556 >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 0x7f776c0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f7770fa1640 1 -- 172.21.15.73:0/1580556556 >> v1:172.21.15.73:6789/0 conn(0x7f776c160270 legacy=0x7f776c0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f7770fa1640 1 -- 172.21.15.73:0/1580556556 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0ce440 con 0x7f776c0d3000 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f776b7fe640 1 --2- 172.21.15.73:0/1580556556 >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 0x7f776c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:26.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.728+0000 7f776affd640 1 -- 172.21.15.73:0/1580556556 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251312464 0 0) 0x7f776c0cdf10 con 0x7f776c160270 2023-12-19T16:16:26.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f7770fa1640 1 --2- 172.21.15.73:0/1580556556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c06b4d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f776c0c9940 tx=0x7f776401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc79d7f354de2bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f776affd640 1 -- 172.21.15.73:0/1580556556 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a58e0 con 0x7f776c0d3000 2023-12-19T16:16:26.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f776affd640 1 -- 172.21.15.73:0/1580556556 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640a5a40 con 0x7f776c0d3000 2023-12-19T16:16:26.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f776affd640 1 -- 172.21.15.73:0/1580556556 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640a5dd0 con 0x7f776c0d3000 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- 172.21.15.73:0/1580556556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 msgr2=0x7f776c06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 --2- 172.21.15.73:0/1580556556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c06b4d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f776c0c9940 tx=0x7f776401c910 comp rx=0 tx=0).stop 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- 172.21.15.73:0/1580556556 shutdown_connections 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 --2- 172.21.15.73:0/1580556556 >> v2:172.21.15.162:3300/0 conn(0x7f776c0d15e0 0x7f776c0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 --2- 172.21.15.73:0/1580556556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c06b4d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- 172.21.15.73:0/1580556556 >> 172.21.15.73:0/1580556556 conn(0x7f776c09bc10 msgr2=0x7f776c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- 172.21.15.73:0/1580556556 shutdown_connections 2023-12-19T16:16:26.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- 172.21.15.73:0/1580556556 wait complete. 2023-12-19T16:16:26.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 Processor -- start 2023-12-19T16:16:26.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.732+0000 7f77717a2640 1 -- start start 2023-12-19T16:16:26.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f776c0d15e0 0x7f776c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776c160270 0x7f776c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c1561c0 con 0x7f776c0d3000 2023-12-19T16:16:26.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b4b50 con 0x7f776c0d15e0 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b3cc0 con 0x7f776c160270 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55726/0 (socket says 172.21.15.73:55726) 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 -- 172.21.15.73:0/2550778621 learned_addr learned my addr 172.21.15.73:0/2550778621 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 -- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776c160270 msgr2=0x7f776c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776c160270 0x7f776c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 -- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f776c0d15e0 msgr2=0x7f776c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f776c0d15e0 0x7f776c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 -- 172.21.15.73:0/2550778621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7764009a70 con 0x7f776c0d3000 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f776b7fe640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f776000e810 tx=0x7f776000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000c8d0 con 0x7f776c0d3000 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776000ca30 con 0x7f776c0d3000 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776000cdc0 con 0x7f776c0d3000 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c0b3f40 con 0x7f776c0d3000 2023-12-19T16:16:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c0b4500 con 0x7f776c0d3000 2023-12-19T16:16:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c04e000 con 0x7f776c0d3000 2023-12-19T16:16:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.736+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7760013410 con 0x7f776c0d3000 2023-12-19T16:16:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.740+0000 7f7768ff9640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 0x7f7758067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.740+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7760082cd0 con 0x7f776c0d3000 2023-12-19T16:16:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.740+0000 7f776bfff640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 0x7f7758067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:26.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.740+0000 7f776bfff640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 0x7f7758067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f775c0015a0 tx=0x7f775c007970 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:26.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.744+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77600509e0 con 0x7f776c0d3000 2023-12-19T16:16:26.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.944+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f776c0b4c90 con 0x7f776c0d3000 2023-12-19T16:16:26.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f7768ff9640 1 -- 172.21.15.73:0/2550778621 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7760009480 con 0x7f776c0d3000 2023-12-19T16:16:26.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 msgr2=0x7f7758067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 0x7f7758067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f775c0015a0 tx=0x7f775c007970 comp rx=0 tx=0).stop 2023-12-19T16:16:26.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 msgr2=0x7f776c0ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:26.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f776000e810 tx=0x7f776000ecd0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 shutdown_connections 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f776c160270 0x7f776c0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7758065a60 0x7f7758067f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f776c0d3000 0x7f776c0ca600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 --2- 172.21.15.73:0/2550778621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f776c0d15e0 0x7f776c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 >> 172.21.15.73:0/2550778621 conn(0x7f776c09bc10 msgr2=0x7f776c0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 shutdown_connections 2023-12-19T16:16:26.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:26.952+0000 7f77717a2640 1 -- 172.21.15.73:0/2550778621 wait complete. 2023-12-19T16:16:26.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T16:16:27.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.108+0000 7f64db339640 1 Processor -- start 2023-12-19T16:16:27.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.108+0000 7f64db339640 1 -- start start 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64db339640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64d40cbe90 0x7f64d406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64db339640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d40ca6f0 con 0x7f64d40cd580 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64db339640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d4159530 con 0x7f64d406ddf0 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64db339640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d40cccb0 con 0x7f64d40cbe90 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d88d4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f64d40cd580 0x7f64d406c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56070/0 (socket says 172.21.15.73:56070) 2023-12-19T16:16:27.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d88d4640 1 -- 172.21.15.73:0/1066111083 learned_addr learned my addr 172.21.15.73:0/1066111083 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:27.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d98d6640 1 --2- 172.21.15.73:0/1066111083 >> v2:172.21.15.162:3300/0 conn(0x7f64d40cbe90 0x7f64d406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205156921 0 0) 0x7f64d40ca6f0 con 0x7f64d40cd580 2023-12-19T16:16:27.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c0003530 con 0x7f64d40cd580 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156274295 0 0) 0x7f64d4159530 con 0x7f64d406ddf0 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d40ca6f0 con 0x7f64d406ddf0 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d98d6640 1 -- 172.21.15.73:0/1066111083 >> v1:172.21.15.162:6789/0 conn(0x7f64d406ddf0 legacy=0x7f64d40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d98d6640 1 -- 172.21.15.73:0/1066111083 >> v1:172.21.15.73:6789/0 conn(0x7f64d40cd580 legacy=0x7f64d406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183461621 0 0) 0x7f64c0003530 con 0x7f64d40cd580 2023-12-19T16:16:27.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.112+0000 7f64d98d6640 1 -- 172.21.15.73:0/1066111083 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40c9ae0 con 0x7f64d40cbe90 2023-12-19T16:16:27.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64d98d6640 1 --2- 172.21.15.73:0/1066111083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d406c8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009d90 tx=0x7f64cc01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c741a23b2f0072ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4001680 con 0x7f64d40cbe90 2023-12-19T16:16:27.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0a5680 con 0x7f64d40cbe90 2023-12-19T16:16:27.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64cbfff640 1 -- 172.21.15.73:0/1066111083 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0a5a10 con 0x7f64d40cbe90 2023-12-19T16:16:27.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 -- 172.21.15.73:0/1066111083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 msgr2=0x7f64d406c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 --2- 172.21.15.73:0/1066111083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d406c8a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009d90 tx=0x7f64cc01c840 comp rx=0 tx=0).stop 2023-12-19T16:16:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 -- 172.21.15.73:0/1066111083 shutdown_connections 2023-12-19T16:16:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 --2- 172.21.15.73:0/1066111083 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d406c8a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 -- 172.21.15.73:0/1066111083 >> 172.21.15.73:0/1066111083 conn(0x7f64d40b0270 msgr2=0x7f64d40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 -- 172.21.15.73:0/1066111083 shutdown_connections 2023-12-19T16:16:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.116+0000 7f64db339640 1 -- 172.21.15.73:0/1066111083 wait complete. 2023-12-19T16:16:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 Processor -- start 2023-12-19T16:16:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- start start 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d41f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64d40cd580 0x7f64d41f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d415b660 con 0x7f64d406ddf0 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d415ace0 con 0x7f64d40cbe90 2023-12-19T16:16:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40ad410 con 0x7f64d40cd580 2023-12-19T16:16:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55734/0 (socket says 172.21.15.73:55734) 2023-12-19T16:16:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 -- 172.21.15.73:0/3838490235 learned_addr learned my addr 172.21.15.73:0/3838490235 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 -- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64d40cd580 msgr2=0x7f64d41f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64d40cd580 0x7f64d41f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 -- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 msgr2=0x7f64d41f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d41f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 -- 172.21.15.73:0/3838490235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009a70 con 0x7f64d406ddf0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64d90d5640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c490 tx=0x7f64d000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d00052d0 con 0x7f64d406ddf0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d0005430 con 0x7f64d406ddf0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d415afa0 con 0x7f64d406ddf0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0012930 con 0x7f64d406ddf0 2023-12-19T16:16:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d40c5d50 con 0x7f64d406ddf0 2023-12-19T16:16:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.120+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4074050 con 0x7f64d406ddf0 2023-12-19T16:16:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.124+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64d0012a90 con 0x7f64d406ddf0 2023-12-19T16:16:27.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.124+0000 7f64c9ffb640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 0x7f64b8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.124+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64d0082a90 con 0x7f64d406ddf0 2023-12-19T16:16:27.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.124+0000 7f64d88d4640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 0x7f64b8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.124+0000 7f64d88d4640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 0x7f64b8067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000c10 tx=0x7f64c40012a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.128+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f64d0050700 con 0x7f64d406ddf0 2023-12-19T16:16:27.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.328+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f64d40b46c0 con 0x7f64d406ddf0 2023-12-19T16:16:27.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.332+0000 7f64c9ffb640 1 -- 172.21.15.73:0/3838490235 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f64d0053d20 con 0x7f64d406ddf0 2023-12-19T16:16:27.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 msgr2=0x7f64b8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 0x7f64b8067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000c10 tx=0x7f64c40012a0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 msgr2=0x7f64d40c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c490 tx=0x7f64d000c950 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 shutdown_connections 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64d40cd580 0x7f64d41f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64d40cbe90 0x7f64d41f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64b8065a90 0x7f64b8067f50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 --2- 172.21.15.73:0/3838490235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64d406ddf0 0x7f64d40c5810 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 >> 172.21.15.73:0/3838490235 conn(0x7f64d40b0270 msgr2=0x7f64d40af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 shutdown_connections 2023-12-19T16:16:27.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.336+0000 7f64db339640 1 -- 172.21.15.73:0/3838490235 wait complete. 2023-12-19T16:16:27.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.492+0000 7fb0d9c66640 1 Processor -- start 2023-12-19T16:16:27.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.492+0000 7fb0d9c66640 1 -- start start 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d9c66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb0d40b40b0 0x7fb0d415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d9c66640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d415ad00 con 0x7fb0d4159830 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d9c66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40ce2d0 con 0x7fb0d40cdc40 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d9c66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d415e110 con 0x7fb0d40b40b0 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb0d4159830 0x7fb0d40cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56076/0 (socket says 172.21.15.73:56076) 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d37fe640 1 -- 172.21.15.73:0/487811051 learned_addr learned my addr 172.21.15.73:0/487811051 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d3fff640 1 --2- 172.21.15.73:0/487811051 >> v2:172.21.15.162:3300/0 conn(0x7fb0d40b40b0 0x7fb0d415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d2ffd640 1 -- 172.21.15.73:0/487811051 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462048428 0 0) 0x7fb0d415ad00 con 0x7fb0d4159830 2023-12-19T16:16:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d2ffd640 1 -- 172.21.15.73:0/487811051 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c0003530 con 0x7fb0d4159830 2023-12-19T16:16:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d3fff640 1 -- 172.21.15.73:0/487811051 >> v1:172.21.15.162:6789/0 conn(0x7fb0d40cdc40 legacy=0x7fb0d40ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d3fff640 1 -- 172.21.15.73:0/487811051 >> v1:172.21.15.73:6789/0 conn(0x7fb0d4159830 legacy=0x7fb0d40cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.496+0000 7fb0d3fff640 1 -- 172.21.15.73:0/487811051 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d415d490 con 0x7fb0d40b40b0 2023-12-19T16:16:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d3fff640 1 --2- 172.21.15.73:0/487811051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d40b40b0 0x7fb0d415a7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d585e2753e5f9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d2ffd640 1 -- 172.21.15.73:0/487811051 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5950 con 0x7fb0d40b40b0 2023-12-19T16:16:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d2ffd640 1 -- 172.21.15.73:0/487811051 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0a5ab0 con 0x7fb0d40b40b0 2023-12-19T16:16:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d2ffd640 1 -- 172.21.15.73:0/487811051 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5e40 con 0x7fb0d40b40b0 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- 172.21.15.73:0/487811051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d40b40b0 msgr2=0x7fb0d415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/487811051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d40b40b0 0x7fb0d415a7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009d90 tx=0x7fb0cc01c890 comp rx=0 tx=0).stop 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- 172.21.15.73:0/487811051 shutdown_connections 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/487811051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d40b40b0 0x7fb0d415a7c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- 172.21.15.73:0/487811051 >> 172.21.15.73:0/487811051 conn(0x7fb0d40b0270 msgr2=0x7fb0d40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- 172.21.15.73:0/487811051 shutdown_connections 2023-12-19T16:16:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- 172.21.15.73:0/487811051 wait complete. 2023-12-19T16:16:27.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 Processor -- start 2023-12-19T16:16:27.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.500+0000 7fb0d9c66640 1 -- start start 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0d40b40b0 0x7fb0d40b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d4159830 0x7fb0d40ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40c6e60 con 0x7fb0d40cdc40 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40abe60 con 0x7fb0d4159830 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40ac140 con 0x7fb0d40b40b0 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55740/0 (socket says 172.21.15.73:55740) 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 -- 172.21.15.73:0/1825236852 learned_addr learned my addr 172.21.15.73:0/1825236852 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d37fe640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0d40b40b0 0x7fb0d40b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d3fff640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d4159830 0x7fb0d40ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 -- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0d40b40b0 msgr2=0x7fb0d40b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0d40b40b0 0x7fb0d40b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 -- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d4159830 msgr2=0x7fb0d40ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d4159830 0x7fb0d40ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 -- 172.21.15.73:0/1825236852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009a70 con 0x7fb0d40cdc40 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0cbfff640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c420 tx=0x7fb0bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0052d0 con 0x7fb0d40cdc40 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc005430 con 0x7fb0d40cdc40 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc007260 con 0x7fb0d40cdc40 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d40ac420 con 0x7fb0d40cdc40 2023-12-19T16:16:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d4153550 con 0x7fb0d40cdc40 2023-12-19T16:16:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d4074050 con 0x7fb0d40cdc40 2023-12-19T16:16:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.504+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0bc0073c0 con 0x7fb0d40cdc40 2023-12-19T16:16:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.508+0000 7fb0d0ff9640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 0x7fb0b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.508+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0bc0821a0 con 0x7fb0d40cdc40 2023-12-19T16:16:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.508+0000 7fb0d37fe640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 0x7fb0b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.508+0000 7fb0d37fe640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 0x7fb0b4067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40011f0 tx=0x7fb0c4007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.512+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb0bc04ff50 con 0x7fb0d40cdc40 2023-12-19T16:16:27.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0d40cbfc0 con 0x7fb0d40cdc40 2023-12-19T16:16:27.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d0ff9640 1 -- 172.21.15.73:0/1825236852 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+12389 (secure 0 0 0) 0x7fb0bc053570 con 0x7fb0d40cdc40 2023-12-19T16:16:27.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:27.668 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:24.640061+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 msgr2=0x7fb0b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 0x7fb0b4067f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40011f0 tx=0x7fb0c4007d40 comp rx=0 tx=0).stop 2023-12-19T16:16:27.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 msgr2=0x7fb0d4153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c420 tx=0x7fb0bc00c8e0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 shutdown_connections 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0d4159830 0x7fb0d40ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb0b4065a60 0x7fb0b4067f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0d40cdc40 0x7fb0d4153010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 --2- 172.21.15.73:0/1825236852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb0d40b40b0 0x7fb0d40b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 >> 172.21.15.73:0/1825236852 conn(0x7fb0d40b0270 msgr2=0x7fb0d40b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 shutdown_connections 2023-12-19T16:16:27.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.664+0000 7fb0d9c66640 1 -- 172.21.15.73:0/1825236852 wait complete. 2023-12-19T16:16:27.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:16:27.690 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:16:27.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 Processor -- start 2023-12-19T16:16:27.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 -- start start 2023-12-19T16:16:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 0x7f51500b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500cce80 con 0x7f51500b0660 2023-12-19T16:16:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51500cc270 con 0x7f51501598c0 2023-12-19T16:16:27.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.828+0000 7f515848c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500b0ae0 con 0x7f515006d410 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5156a29640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f51500b0660 0x7f51500cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56084/0 (socket says 172.21.15.73:56084) 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5156a29640 1 -- 172.21.15.73:0/3387683319 learned_addr learned my addr 172.21.15.73:0/3387683319 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155a27640 1 --2- 172.21.15.73:0/3387683319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 0x7f51500b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581603632 0 0) 0x7f51500cce80 con 0x7f51500b0660 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f513c003530 con 0x7f51500b0660 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775883103 0 0) 0x7f51500cc270 con 0x7f51501598c0 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51500cce80 con 0x7f51501598c0 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155a27640 1 -- 172.21.15.73:0/3387683319 >> v1:172.21.15.162:6789/0 conn(0x7f51501598c0 legacy=0x7f515006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155a27640 1 -- 172.21.15.73:0/3387683319 >> v1:172.21.15.73:6789/0 conn(0x7f51500b0660 legacy=0x7f51500cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155a27640 1 -- 172.21.15.73:0/3387683319 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500cc550 con 0x7f515006d410 2023-12-19T16:16:27.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.832+0000 7f5155a27640 1 --2- 172.21.15.73:0/3387683319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 0x7f51500b0120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51400097f0 tx=0x7f514001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d24c818df085a6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400aa5f0 con 0x7f515006d410 2023-12-19T16:16:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51400aa750 con 0x7f515006d410 2023-12-19T16:16:27.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f5155226640 1 -- 172.21.15.73:0/3387683319 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400aaae0 con 0x7f515006d410 2023-12-19T16:16:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- 172.21.15.73:0/3387683319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 msgr2=0x7f51500b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 --2- 172.21.15.73:0/3387683319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 0x7f51500b0120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f51400097f0 tx=0x7f514001c490 comp rx=0 tx=0).stop 2023-12-19T16:16:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- 172.21.15.73:0/3387683319 shutdown_connections 2023-12-19T16:16:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 --2- 172.21.15.73:0/3387683319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f515006d410 0x7f51500b0120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- 172.21.15.73:0/3387683319 >> 172.21.15.73:0/3387683319 conn(0x7f515006a570 msgr2=0x7f51500ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- 172.21.15.73:0/3387683319 shutdown_connections 2023-12-19T16:16:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- 172.21.15.73:0/3387683319 wait complete. 2023-12-19T16:16:27.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 Processor -- start 2023-12-19T16:16:27.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- start start 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515006d410 0x7f51500cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51501598c0 0x7f51500aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515014b6e0 con 0x7f51500b0660 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515014bff0 con 0x7f515006d410 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f515848c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51500cbe60 con 0x7f51501598c0 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.836+0000 7f5155a27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55750/0 (socket says 172.21.15.73:55750) 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 -- 172.21.15.73:0/1509448984 learned_addr learned my addr 172.21.15.73:0/1509448984 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5156a29640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51501598c0 0x7f51500aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5156228640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515006d410 0x7f51500cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 -- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51501598c0 msgr2=0x7f51500aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51501598c0 0x7f51500aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 -- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515006d410 msgr2=0x7f51500cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515006d410 0x7f51500cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 -- 172.21.15.73:0/1509448984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009420 con 0x7f51500b0660 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5155a27640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51400ac040 tx=0x7f514001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400be410 con 0x7f51500b0660 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5150152340 con 0x7f51500b0660 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51400be5b0 con 0x7f51500b0660 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400be960 con 0x7f51500b0660 2023-12-19T16:16:27.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5150152900 con 0x7f51500b0660 2023-12-19T16:16:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515004e070 con 0x7f51500b0660 2023-12-19T16:16:27.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51400b4400 con 0x7f51500b0660 2023-12-19T16:16:27.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:27.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.840+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51400a7070 con 0x7f51500b0660 2023-12-19T16:16:27.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.844+0000 7f5156228640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:27.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.844+0000 7f5156228640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 0x7f5134067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f514c0011f0 tx=0x7f514c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:27.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.844+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f51400eb560 con 0x7f51500b0660 2023-12-19T16:16:28.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.996+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51500c44c0 con 0x7f51500b0660 2023-12-19T16:16:28.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:27.996+0000 7f5146ffd640 1 -- 172.21.15.73:0/1509448984 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51400eeb80 con 0x7f51500b0660 2023-12-19T16:16:28.003 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:16:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 msgr2=0x7f5134067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 0x7f5134067f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f514c0011f0 tx=0x7f514c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:28.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 msgr2=0x7f515014b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51400ac040 tx=0x7f514001acd0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 shutdown_connections 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51501598c0 0x7f51500aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5134065a60 0x7f5134067f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51500b0660 0x7f515014b1a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 --2- 172.21.15.73:0/1509448984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515006d410 0x7f51500cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 >> 172.21.15.73:0/1509448984 conn(0x7f515006a570 msgr2=0x7f51500aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 shutdown_connections 2023-12-19T16:16:28.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.000+0000 7f515848c640 1 -- 172.21.15.73:0/1509448984 wait complete. 2023-12-19T16:16:28.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:16:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 Processor -- start 2023-12-19T16:16:28.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 -- start start 2023-12-19T16:16:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64f406ddf0 0x7f64f40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f40ca6f0 con 0x7f64f40cbe90 2023-12-19T16:16:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f4070f50 con 0x7f64f406d1a0 2023-12-19T16:16:28.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f8a8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f40cccb0 con 0x7f64f406ddf0 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64e9d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f64f40cbe90 0x7f64f4070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56092/0 (socket says 172.21.15.73:56092) 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64f259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64f406ddf0 0x7f64f40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.156+0000 7f64e9d9b640 1 -- 172.21.15.73:0/2186707194 learned_addr learned my addr 172.21.15.73:0/2186707194 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f259c640 1 -- 172.21.15.73:0/2186707194 >> v1:172.21.15.162:6789/0 conn(0x7f64f406d1a0 legacy=0x7f64f4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f1d9b640 1 -- 172.21.15.73:0/2186707194 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867054108 0 0) 0x7f64f40ca6f0 con 0x7f64f40cbe90 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f259c640 1 -- 172.21.15.73:0/2186707194 >> v1:172.21.15.73:6789/0 conn(0x7f64f40cbe90 legacy=0x7f64f4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f259c640 1 -- 172.21.15.73:0/2186707194 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f4159530 con 0x7f64f406ddf0 2023-12-19T16:16:28.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f259c640 1 --2- 172.21.15.73:0/2186707194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40cce70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64e400a960 tx=0x7f64e401d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3983d48f15e15cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f1d9b640 1 -- 172.21.15.73:0/2186707194 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a68d0 con 0x7f64f406ddf0 2023-12-19T16:16:28.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f1d9b640 1 -- 172.21.15.73:0/2186707194 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40a6a30 con 0x7f64f406ddf0 2023-12-19T16:16:28.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f1d9b640 1 -- 172.21.15.73:0/2186707194 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a6dc0 con 0x7f64f406ddf0 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 -- 172.21.15.73:0/2186707194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 msgr2=0x7f64f40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/2186707194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40cce70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f64e400a960 tx=0x7f64e401d820 comp rx=0 tx=0).stop 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 -- 172.21.15.73:0/2186707194 shutdown_connections 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/2186707194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40cce70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 -- 172.21.15.73:0/2186707194 >> 172.21.15.73:0/2186707194 conn(0x7f64f40b0270 msgr2=0x7f64f40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 -- 172.21.15.73:0/2186707194 shutdown_connections 2023-12-19T16:16:28.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.160+0000 7f64f8a8c640 1 -- 172.21.15.73:0/2186707194 wait complete. 2023-12-19T16:16:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 Processor -- start 2023-12-19T16:16:28.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 -- start start 2023-12-19T16:16:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64f406d1a0 0x7f64f40c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c6710 con 0x7f64f40cbe90 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c7510 con 0x7f64f406ddf0 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f8a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40c8650 con 0x7f64f406d1a0 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55752/0 (socket says 172.21.15.73:55752) 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 -- 172.21.15.73:0/3343435521 learned_addr learned my addr 172.21.15.73:0/3343435521 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f259c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64f406d1a0 0x7f64f40c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64e9d9b640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 -- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64f406d1a0 msgr2=0x7f64f40c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64f406d1a0 0x7f64f40c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 -- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 msgr2=0x7f64f40c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.164+0000 7f64f2d9d640 1 -- 172.21.15.73:0/3343435521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e400a5c0 con 0x7f64f40cbe90 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64f2d9d640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c790 tx=0x7f64ec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec003b80 con 0x7f64f40cbe90 2023-12-19T16:16:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec003ce0 con 0x7f64f40cbe90 2023-12-19T16:16:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f40c6900 con 0x7f64f40cbe90 2023-12-19T16:16:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00aa90 con 0x7f64f40cbe90 2023-12-19T16:16:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f40c6ec0 con 0x7f64f40cbe90 2023-12-19T16:16:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f4074050 con 0x7f64f40cbe90 2023-12-19T16:16:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64ec00abf0 con 0x7f64f40cbe90 2023-12-19T16:16:28.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 0x7f64d4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64ec082a40 con 0x7f64f40cbe90 2023-12-19T16:16:28.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.168+0000 7f64f259c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 0x7f64d4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.172+0000 7f64f259c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 0x7f64d4067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b0000 tx=0x7f64e40a8070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.172+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f64ec084e60 con 0x7f64f40cbe90 2023-12-19T16:16:28.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.324+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f64f4155860 con 0x7f64f40cbe90 2023-12-19T16:16:28.329 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.324+0000 7f64eb7fe640 1 -- 172.21.15.73:0/3343435521 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) v1 ==== 84+0+65 (secure 0 0 0) 0x7f64ec050800 con 0x7f64f40cbe90 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:16:28.330 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 msgr2=0x7f64d4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 0x7f64d4067f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f64e40b0000 tx=0x7f64e40a8070 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 msgr2=0x7f64f40b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f64ec00c790 tx=0x7f64ec00cc50 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 shutdown_connections 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f64d4065a60 0x7f64d4067f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64f40cbe90 0x7f64f40b2820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64f406ddf0 0x7f64f40c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 --2- 172.21.15.73:0/3343435521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64f406d1a0 0x7f64f40c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 >> 172.21.15.73:0/3343435521 conn(0x7f64f40b0270 msgr2=0x7f64f40ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 shutdown_connections 2023-12-19T16:16:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.328+0000 7f64f8a8c640 1 -- 172.21.15.73:0/3343435521 wait complete. 2023-12-19T16:16:28.351 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:16:28.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:16:28.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.488+0000 7eff726f9640 1 Processor -- start 2023-12-19T16:16:28.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.488+0000 7eff726f9640 1 -- start start 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff726f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c1598c0 0x7eff6c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff726f9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff6c06d410 0x7eff6c0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff726f9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0b0ac0 con 0x7eff6c0b0660 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff726f9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0cce80 con 0x7eff6c06d410 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff726f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06cad0 con 0x7eff6c1598c0 2023-12-19T16:16:28.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff6c06d410 0x7eff6c0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff70c96640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7eff6c0b0660 0x7eff6c0c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56106/0 (socket says 172.21.15.73:56106) 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff70c96640 1 -- 172.21.15.73:0/1831537471 learned_addr learned my addr 172.21.15.73:0/1831537471 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6bfff640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c1598c0 0x7eff6c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6b7fe640 1 -- 172.21.15.73:0/1831537471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c1598c0 msgr2=0x7eff6c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6b7fe640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c1598c0 0x7eff6c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6b7fe640 1 -- 172.21.15.73:0/1831537471 >> v1:172.21.15.73:6789/0 conn(0x7eff6c0b0660 legacy=0x7eff6c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6b7fe640 1 -- 172.21.15.73:0/1831537471 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0cc270 con 0x7eff6c06d410 2023-12-19T16:16:28.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.492+0000 7eff6affd640 1 -- 172.21.15.73:0/1831537471 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281640356 0 0) 0x7eff6c0b0ac0 con 0x7eff6c0b0660 2023-12-19T16:16:28.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff6b7fe640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0b0120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff6000ba60 tx=0x7eff6001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a4c4a4fe43a9af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff6affd640 1 -- 172.21.15.73:0/1831537471 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600a7c20 con 0x7eff6c06d410 2023-12-19T16:16:28.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff6affd640 1 -- 172.21.15.73:0/1831537471 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff600a7d80 con 0x7eff6c06d410 2023-12-19T16:16:28.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff6affd640 1 -- 172.21.15.73:0/1831537471 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600af660 con 0x7eff6c06d410 2023-12-19T16:16:28.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- 172.21.15.73:0/1831537471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 msgr2=0x7eff6c0b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0b0120 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff6000ba60 tx=0x7eff6001eb50 comp rx=0 tx=0).stop 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- 172.21.15.73:0/1831537471 shutdown_connections 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0b0120 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 --2- 172.21.15.73:0/1831537471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c1598c0 0x7eff6c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- 172.21.15.73:0/1831537471 >> 172.21.15.73:0/1831537471 conn(0x7eff6c06a570 msgr2=0x7eff6c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- 172.21.15.73:0/1831537471 shutdown_connections 2023-12-19T16:16:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- 172.21.15.73:0/1831537471 wait complete. 2023-12-19T16:16:28.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 Processor -- start 2023-12-19T16:16:28.502 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.496+0000 7eff726f9640 1 -- start start 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c0b0660 0x7eff6c154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6c1598c0 0x7eff6c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0b3920 con 0x7eff6c06d410 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0c8740 con 0x7eff6c1598c0 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c155150 con 0x7eff6c0b0660 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55772/0 (socket says 172.21.15.73:55772) 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 -- 172.21.15.73:0/2858683215 learned_addr learned my addr 172.21.15.73:0/2858683215 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:28.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff70c96640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6c1598c0 0x7eff6c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6b7fe640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c0b0660 0x7eff6c154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 -- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c0b0660 msgr2=0x7eff6c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c0b0660 0x7eff6c154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 -- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6c1598c0 msgr2=0x7eff6c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6c1598c0 0x7eff6c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 -- 172.21.15.73:0/2858683215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6000b6c0 con 0x7eff6c06d410 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff6bfff640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e870 tx=0x7eff5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c009510 con 0x7eff6c06d410 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c00eec0 con 0x7eff6c06d410 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c0c8180 con 0x7eff6c06d410 2023-12-19T16:16:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00cb40 con 0x7eff6c06d410 2023-12-19T16:16:28.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c0b1760 con 0x7eff6c06d410 2023-12-19T16:16:28.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c04e070 con 0x7eff6c06d410 2023-12-19T16:16:28.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.500+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff5c00cca0 con 0x7eff6c06d410 2023-12-19T16:16:28.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.504+0000 7eff68ff9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 0x7eff58067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:28.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.504+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff5c082de0 con 0x7eff6c06d410 2023-12-19T16:16:28.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.504+0000 7eff6b7fe640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 0x7eff58067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:28.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.504+0000 7eff6b7fe640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 0x7eff58067f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff600b1000 tx=0x7eff600a9070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:28.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.508+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff5c050c10 con 0x7eff6c06d410 2023-12-19T16:16:28.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:28.660+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff6c0c1d10 con 0x7eff6c06d410 2023-12-19T16:16:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.440+0000 7eff68ff9640 1 -- 172.21.15.73:0/2858683215 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff5c0170b0 con 0x7eff6c06d410 2023-12-19T16:16:29.443 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-19T16:16:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.440+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 msgr2=0x7eff58067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 0x7eff58067f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff600b1000 tx=0x7eff600a9070 comp rx=0 tx=0).stop 2023-12-19T16:16:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 msgr2=0x7eff6c0ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e870 tx=0x7eff5c00ec70 comp rx=0 tx=0).stop 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 shutdown_connections 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6c1598c0 0x7eff6c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff6c0b0660 0x7eff6c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff58065a90 0x7eff58067f50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 --2- 172.21.15.73:0/2858683215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6c06d410 0x7eff6c0ae0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 >> 172.21.15.73:0/2858683215 conn(0x7eff6c06a570 msgr2=0x7eff6c0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 shutdown_connections 2023-12-19T16:16:29.449 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.444+0000 7eff726f9640 1 -- 172.21.15.73:0/2858683215 wait complete. 2023-12-19T16:16:29.472 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:16:29.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.616+0000 7f1799b0a640 1 Processor -- start 2023-12-19T16:16:29.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.616+0000 7f1799b0a640 1 -- start start 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17941599e0 0x7f1794070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f179406cb10 0x7f17940c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17940ca4c0 0x7f179415d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17940ca950 con 0x7f17940ca4c0 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1794070180 con 0x7f179406cb10 2023-12-19T16:16:29.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1799b0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179406d580 con 0x7f17941599e0 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17940ca4c0 0x7f179415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17940ca4c0 0x7f179415d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55780/0 (socket says 172.21.15.73:55780) 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 -- 172.21.15.73:0/2179365536 learned_addr learned my addr 172.21.15.73:0/2179365536 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f17937fe640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17941599e0 0x7f1794070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1792ffd640 1 --2- 172.21.15.73:0/2179365536 >> v2:172.21.15.162:3300/0 conn(0x7f179406cb10 0x7f17940c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 -- 172.21.15.73:0/2179365536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17941599e0 msgr2=0x7f1794070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17941599e0 0x7f1794070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 -- 172.21.15.73:0/2179365536 >> v2:172.21.15.162:3300/0 conn(0x7f179406cb10 msgr2=0x7f17940c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 --2- 172.21.15.73:0/2179365536 >> v2:172.21.15.162:3300/0 conn(0x7f179406cb10 0x7f17940c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 -- 172.21.15.73:0/2179365536 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940afd60 con 0x7f17940ca4c0 2023-12-19T16:16:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.620+0000 7f1793fff640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415d600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17940b1170 tx=0x7f178c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f31e3aa2bf63f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f17927fc640 1 -- 172.21.15.73:0/2179365536 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0a5820 con 0x7f17940ca4c0 2023-12-19T16:16:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f17927fc640 1 -- 172.21.15.73:0/2179365536 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0a5980 con 0x7f17940ca4c0 2023-12-19T16:16:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f17927fc640 1 -- 172.21.15.73:0/2179365536 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0a5d10 con 0x7f17940ca4c0 2023-12-19T16:16:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- 172.21.15.73:0/2179365536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 msgr2=0x7f179415d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415d600 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17940b1170 tx=0x7f178c01c9a0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- 172.21.15.73:0/2179365536 shutdown_connections 2023-12-19T16:16:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415d600 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- 172.21.15.73:0/2179365536 >> v2:172.21.15.162:3300/0 conn(0x7f179406cb10 0x7f17940c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- 172.21.15.73:0/2179365536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17941599e0 0x7f1794070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- 172.21.15.73:0/2179365536 >> 172.21.15.73:0/2179365536 conn(0x7f17940b0490 msgr2=0x7f17940b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- 172.21.15.73:0/2179365536 shutdown_connections 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- 172.21.15.73:0/2179365536 wait complete. 2023-12-19T16:16:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 Processor -- start 2023-12-19T16:16:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- start start 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f179406cb10 0x7f1794149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17941599e0 0x7f179415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1794149d40 con 0x7f17940ca4c0 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179415cbe0 con 0x7f17941599e0 2023-12-19T16:16:29.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.624+0000 7f1799b0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179414b420 con 0x7f179406cb10 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55796/0 (socket says 172.21.15.73:55796) 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 -- 172.21.15.73:0/3647227705 learned_addr learned my addr 172.21.15.73:0/3647227705 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f17937fe640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f179406cb10 0x7f1794149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1793fff640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17941599e0 0x7f179415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 -- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f179406cb10 msgr2=0x7f1794149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f179406cb10 0x7f1794149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 -- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17941599e0 msgr2=0x7f179415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17941599e0 0x7f179415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 -- 172.21.15.73:0/3647227705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009b30 con 0x7f17940ca4c0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1792ffd640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f178800e8b0 tx=0x7f178800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178800c940 con 0x7f17940ca4c0 2023-12-19T16:16:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178800caa0 con 0x7f17940ca4c0 2023-12-19T16:16:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179415a950 con 0x7f17940ca4c0 2023-12-19T16:16:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178800ce30 con 0x7f17940ca4c0 2023-12-19T16:16:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17940c8030 con 0x7f17940ca4c0 2023-12-19T16:16:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179414b640 con 0x7f17940ca4c0 2023-12-19T16:16:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.628+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1788013470 con 0x7f17940ca4c0 2023-12-19T16:16:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.632+0000 7f177bfff640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 0x7f1780067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.632+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f17880836f0 con 0x7f17940ca4c0 2023-12-19T16:16:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.632+0000 7f17937fe640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 0x7f1780067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.632+0000 7f17937fe640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 0x7f1780067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1784009ac0 tx=0x7f1784009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:29.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.636+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f17880513b0 con 0x7f17940ca4c0 2023-12-19T16:16:29.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:29.784+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f179414b5e0 con 0x7f17940ca4c0 2023-12-19T16:16:30.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.452+0000 7f177bfff640 1 -- 172.21.15.73:0/3647227705 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) v1 ==== 170+0+0 (secure 0 0 0) 0x7f17880549d0 con 0x7f17940ca4c0 2023-12-19T16:16:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-19T16:16:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.460+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 msgr2=0x7f1780067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.460+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 0x7f1780067f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1784009ac0 tx=0x7f1784009190 comp rx=0 tx=0).stop 2023-12-19T16:16:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.460+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 msgr2=0x7f179415c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.465 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.460+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f178800e8b0 tx=0x7f178800ed70 comp rx=0 tx=0).stop 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 shutdown_connections 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17941599e0 0x7f179415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1780065a60 0x7f1780067f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17940ca4c0 0x7f179415c160 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 --2- 172.21.15.73:0/3647227705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f179406cb10 0x7f1794149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 >> 172.21.15.73:0/3647227705 conn(0x7f17940b0490 msgr2=0x7f179414dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 shutdown_connections 2023-12-19T16:16:30.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.464+0000 7f1799b0a640 1 -- 172.21.15.73:0/3647227705 wait complete. 2023-12-19T16:16:30.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:16:30.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.632+0000 7fbeb39a6640 1 Processor -- start 2023-12-19T16:16:30.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.632+0000 7fbeb39a6640 1 -- start start 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb39a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbeac167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb39a6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac15df00 con 0x7fbeac15cb00 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb39a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac15cee0 con 0x7fbeac0b0830 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb39a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c8be0 con 0x7fbeac15dad0 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1742640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbeac15cb00 0x7fbeac0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56114/0 (socket says 172.21.15.73:56114) 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1742640 1 -- 172.21.15.73:0/3644115216 learned_addr learned my addr 172.21.15.73:0/3644115216 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbeac167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867134612 0 0) 0x7fbeac15df00 con 0x7fbeac15cb00 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe98003530 con 0x7fbeac15cb00 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974008922 0 0) 0x7fbeac15cee0 con 0x7fbeac0b0830 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeac15df00 con 0x7fbeac0b0830 2023-12-19T16:16:30.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335249731 0 0) 0x7fbe98003530 con 0x7fbeac15cb00 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 msgr2=0x7fbeac167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbeac167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 >> v1:172.21.15.162:6789/0 conn(0x7fbeac0b0830 legacy=0x7fbeac15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac160860 con 0x7fbeac15cb00 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fbea80016a0 con 0x7fbeac15cb00 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 >> v1:172.21.15.73:6789/0 conn(0x7fbeac15cb00 legacy=0x7fbeac0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbe98003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe980040a0 0x7fbe980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe98004d10 0x7fbe98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0c8be0 con 0x7fbe980040a0 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9800ba70 con 0x7fbe98004d10 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9800bc30 con 0x7fbeac15dad0 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe980040a0 0x7fbe980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1742640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbe98003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe98004d10 0x7fbe98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 -- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 msgr2=0x7fbe98003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac15dad0 0x7fbe98003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 -- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe98004d10 msgr2=0x7fbe98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe98004d10 0x7fbe98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb0f41640 1 -- 172.21.15.73:0/3644115216 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98003530 con 0x7fbe980040a0 2023-12-19T16:16:30.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.636+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe98004d10 0x7fbe98005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb0f41640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe980040a0 0x7fbe980047d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0018d0 tx=0x7fbe9c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f96652a176767a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c0052d0 con 0x7fbe980040a0 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c005450 con 0x7fbe980040a0 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbea3fff640 1 -- 172.21.15.73:0/3644115216 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c003840 con 0x7fbe980040a0 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- 172.21.15.73:0/3644115216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe980040a0 msgr2=0x7fbe980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/3644115216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe980040a0 0x7fbe980047d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0018d0 tx=0x7fbe9c01c560 comp rx=0 tx=0).stop 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb1f43640 1 -- 172.21.15.73:0/3644115216 reap_dead start 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- 172.21.15.73:0/3644115216 shutdown_connections 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- 172.21.15.73:0/3644115216 >> 172.21.15.73:0/3644115216 conn(0x7fbeac06a570 msgr2=0x7fbeac0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- 172.21.15.73:0/3644115216 shutdown_connections 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- 172.21.15.73:0/3644115216 wait complete. 2023-12-19T16:16:30.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 Processor -- start 2023-12-19T16:16:30.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.640+0000 7fbeb39a6640 1 -- start start 2023-12-19T16:16:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 0x7fbeac0aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac0c70a0 0x7fbeac1f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0aefa0 con 0x7fbeac0c74e0 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0afda0 con 0x7fbe980040a0 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0af220 con 0x7fbeac0c70a0 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55814/0 (socket says 172.21.15.73:55814) 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 -- 172.21.15.73:0/2808142075 learned_addr learned my addr 172.21.15.73:0/2808142075 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1742640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 0x7fbeac0aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 -- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac0c70a0 msgr2=0x7fbeac1f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac0c70a0 0x7fbeac1f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 -- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 msgr2=0x7fbeac0aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 0x7fbeac0aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 -- 172.21.15.73:0/2808142075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac0af500 con 0x7fbeac0c74e0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1742640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 0x7fbeac0aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb1f43640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbeac06dcb0 tx=0x7fbea4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea401b070 con 0x7fbeac0c74e0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400f040 con 0x7fbeac0c74e0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0af7e0 con 0x7fbeac0c74e0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400e050 con 0x7fbeac0c74e0 2023-12-19T16:16:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac1f65d0 con 0x7fbeac0c74e0 2023-12-19T16:16:30.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.644+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04e070 con 0x7fbeac0c74e0 2023-12-19T16:16:30.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.648+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbea4003be0 con 0x7fbeac0c74e0 2023-12-19T16:16:30.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.648+0000 7fbea1ffb640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 0x7fbe90067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:30.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.648+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbea4083670 con 0x7fbeac0c74e0 2023-12-19T16:16:30.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.648+0000 7fbeb1742640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 0x7fbe90067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:30.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.648+0000 7fbeb1742640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 0x7fbe90067f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbea8001c50 tx=0x7fbea8001e30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.652+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbea4050f60 con 0x7fbeac0c74e0 2023-12-19T16:16:30.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.832+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbeac0ade30 con 0x7fbeac0c74e0 2023-12-19T16:16:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.840+0000 7fbea1ffb640 1 -- 172.21.15.73:0/2808142075 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbea4054580 con 0x7fbeac0c74e0 2023-12-19T16:16:30.847 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T16:16:30.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 msgr2=0x7fbe90067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 0x7fbe90067f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbea8001c50 tx=0x7fbea8001e30 comp rx=0 tx=0).stop 2023-12-19T16:16:30.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 msgr2=0x7fbeac1f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:30.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbeac06dcb0 tx=0x7fbea4010590 comp rx=0 tx=0).stop 2023-12-19T16:16:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 shutdown_connections 2023-12-19T16:16:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbe90065a90 0x7fbe90067f50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbeac0c74e0 0x7fbeac1f6090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbeac0c70a0 0x7fbeac1f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 --2- 172.21.15.73:0/2808142075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe980040a0 0x7fbeac0aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.844+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 >> 172.21.15.73:0/2808142075 conn(0x7fbeac06a570 msgr2=0x7fbeac0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.848+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 shutdown_connections 2023-12-19T16:16:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:30.848+0000 7fbeb39a6640 1 -- 172.21.15.73:0/2808142075 wait complete. 2023-12-19T16:16:30.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 Processor -- start 2023-12-19T16:16:31.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 -- start start 2023-12-19T16:16:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f28900cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289006d720 con 0x7f28900c8fa0 2023-12-19T16:16:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2890070f50 con 0x7f28900b26a0 2023-12-19T16:16:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2897c8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289015e3a0 con 0x7f289015dfc0 2023-12-19T16:16:31.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2895227640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28900c8fa0 0x7f2890070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56126/0 (socket says 172.21.15.73:56126) 2023-12-19T16:16:31.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2895227640 1 -- 172.21.15.73:0/2543552472 learned_addr learned my addr 172.21.15.73:0/2543552472 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2895a28640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f28900cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431291437 0 0) 0x7f289006d720 con 0x7f28900c8fa0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f287c003530 con 0x7f28900c8fa0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167577781 0 0) 0x7f2890070f50 con 0x7f28900b26a0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f289006d720 con 0x7f28900b26a0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.020+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121022911 0 0) 0x7f287c003530 con 0x7f28900c8fa0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 msgr2=0x7f28900cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f28900cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 >> v1:172.21.15.162:6789/0 conn(0x7f28900b26a0 legacy=0x7f2890070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289006c3a0 con 0x7f28900c8fa0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f2880001680 con 0x7f28900c8fa0 2023-12-19T16:16:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 >> v1:172.21.15.73:6789/0 conn(0x7f28900c8fa0 legacy=0x7f2890070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f287c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f287c0040a0 0x7f287c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c004d10 0x7f287c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289015e3a0 con 0x7f287c0040a0 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c00ba70 con 0x7f287c004d10 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c00bc30 con 0x7f289015dfc0 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f287c0040a0 0x7f287c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895a28640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f287c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2896229640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c004d10 0x7f287c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 -- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 msgr2=0x7f287c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f289015dfc0 0x7f287c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 -- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c004d10 msgr2=0x7f287c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c004d10 0x7f287c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 -- 172.21.15.73:0/2543552472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c003530 con 0x7f287c0040a0 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2895227640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f287c0040a0 0x7f287c0047d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f288000c190 tx=0x7f288001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6691829c9be78831 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800058e0 con 0x7f287c0040a0 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880005a40 con 0x7f287c0040a0 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.024+0000 7f2894a26640 1 -- 172.21.15.73:0/2543552472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880005e10 con 0x7f287c0040a0 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- 172.21.15.73:0/2543552472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f287c0040a0 msgr2=0x7f287c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 --2- 172.21.15.73:0/2543552472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f287c0040a0 0x7f287c0047d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f288000c190 tx=0x7f288001cba0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2896229640 1 -- 172.21.15.73:0/2543552472 reap_dead start 2023-12-19T16:16:31.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- 172.21.15.73:0/2543552472 shutdown_connections 2023-12-19T16:16:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- 172.21.15.73:0/2543552472 >> 172.21.15.73:0/2543552472 conn(0x7f28900b0270 msgr2=0x7f28900b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- 172.21.15.73:0/2543552472 shutdown_connections 2023-12-19T16:16:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- 172.21.15.73:0/2543552472 wait complete. 2023-12-19T16:16:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 Processor -- start 2023-12-19T16:16:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- start start 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 0x7f28900c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 0x7f2890155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c4080 con 0x7f28901ed820 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890155990 con 0x7f287c0040a0 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2897c8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2890154380 con 0x7f2890154810 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2896229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2896229640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55830/0 (socket says 172.21.15.73:55830) 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.028+0000 7f2896229640 1 -- 172.21.15.73:0/1846608933 learned_addr learned my addr 172.21.15.73:0/1846608933 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2895227640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 0x7f2890155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2895a28640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 0x7f28900c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 -- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 msgr2=0x7f2890155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 0x7f2890155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 -- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 msgr2=0x7f28900c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 0x7f28900c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 -- 172.21.15.73:0/1846608933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28901537b0 con 0x7f28901ed820 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2895227640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 0x7f2890155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2895a28640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 0x7f28900c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2896229640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2888007fd0 tx=0x7f2888012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888010ac0 con 0x7f28901ed820 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888010c20 con 0x7f28901ed820 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888012e80 con 0x7f28901ed820 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890153a50 con 0x7f28901ed820 2023-12-19T16:16:31.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2890154010 con 0x7f28901ed820 2023-12-19T16:16:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890154bf0 con 0x7f28901ed820 2023-12-19T16:16:31.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2888016480 con 0x7f28901ed820 2023-12-19T16:16:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 0x7f2874067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28880866b0 con 0x7f28901ed820 2023-12-19T16:16:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.032+0000 7f2895a28640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 0x7f2874067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.036+0000 7f2895a28640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 0x7f2874067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f288c009a00 tx=0x7f288c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.036+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2888054070 con 0x7f28901ed820 2023-12-19T16:16:31.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.188+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2890074050 con 0x7f28901ed820 2023-12-19T16:16:31.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f28867fc640 1 -- 172.21.15.73:0/1846608933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f2888057690 con 0x7f28901ed820 2023-12-19T16:16:31.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:31.196 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:30.837197+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 msgr2=0x7f2874067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 0x7f2874067f20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f288c009a00 tx=0x7f288c008040 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 msgr2=0x7f28900cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2888007fd0 tx=0x7f2888012c90 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 shutdown_connections 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f2874065a60 0x7f2874067f20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28901ed820 0x7f28900cd600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2890154810 0x7f2890155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 --2- 172.21.15.73:0/1846608933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287c0040a0 0x7f28900c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 >> 172.21.15.73:0/1846608933 conn(0x7f28900b0270 msgr2=0x7f28900b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 shutdown_connections 2023-12-19T16:16:31.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.192+0000 7f2897c8c640 1 -- 172.21.15.73:0/1846608933 wait complete. 2023-12-19T16:16:31.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 Processor -- start 2023-12-19T16:16:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 -- start start 2023-12-19T16:16:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbca80c8fa0 0x7fbca80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbca80b1690 0x7fbca80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80c9940 con 0x7fbca815dfc0 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca806d720 con 0x7fbca80c8fa0 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcafff0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca815e3a0 con 0x7fbca80b1690 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcad58b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbca80c8fa0 0x7fbca80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcad58b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbca80c8fa0 0x7fbca80c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55834/0 (socket says 172.21.15.73:55834) 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcad58b640 1 -- 172.21.15.73:0/1524522628 learned_addr learned my addr 172.21.15.73:0/1524522628 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.348+0000 7fbcadd8c640 1 --1- 172.21.15.73:0/1524522628 >> v1:172.21.15.73:6789/0 conn(0x7fbca815dfc0 0x7fbca80cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56132/0 (socket says 172.21.15.73:56132) 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcae58d640 1 --2- 172.21.15.73:0/1524522628 >> v2:172.21.15.162:3300/0 conn(0x7fbca80b1690 0x7fbca80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcad58b640 1 -- 172.21.15.73:0/1524522628 >> v2:172.21.15.162:3300/0 conn(0x7fbca80b1690 msgr2=0x7fbca80b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcad58b640 1 --2- 172.21.15.73:0/1524522628 >> v2:172.21.15.162:3300/0 conn(0x7fbca80b1690 0x7fbca80b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcad58b640 1 -- 172.21.15.73:0/1524522628 >> v1:172.21.15.73:6789/0 conn(0x7fbca815dfc0 legacy=0x7fbca80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcad58b640 1 -- 172.21.15.73:0/1524522628 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca806c3a0 con 0x7fbca80c8fa0 2023-12-19T16:16:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcacd8a640 1 -- 172.21.15.73:0/1524522628 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933124283 0 0) 0x7fbca80c9940 con 0x7fbca815dfc0 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcad58b640 1 --2- 172.21.15.73:0/1524522628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca80c8fa0 0x7fbca80c9400 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca806e550 tx=0x7fbc9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3b4cc85771884a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcacd8a640 1 -- 172.21.15.73:0/1524522628 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc980aa430 con 0x7fbca80c8fa0 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcacd8a640 1 -- 172.21.15.73:0/1524522628 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc980aa590 con 0x7fbca80c8fa0 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcacd8a640 1 -- 172.21.15.73:0/1524522628 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc980aa920 con 0x7fbca80c8fa0 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 -- 172.21.15.73:0/1524522628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca80c8fa0 msgr2=0x7fbca80c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 --2- 172.21.15.73:0/1524522628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca80c8fa0 0x7fbca80c9400 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbca806e550 tx=0x7fbc9801c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 -- 172.21.15.73:0/1524522628 shutdown_connections 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 --2- 172.21.15.73:0/1524522628 >> v2:172.21.15.162:3300/0 conn(0x7fbca80b1690 0x7fbca80b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 --2- 172.21.15.73:0/1524522628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca80c8fa0 0x7fbca80c9400 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.352+0000 7fbcafff0640 1 -- 172.21.15.73:0/1524522628 >> 172.21.15.73:0/1524522628 conn(0x7fbca80b0270 msgr2=0x7fbca80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- 172.21.15.73:0/1524522628 shutdown_connections 2023-12-19T16:16:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- 172.21.15.73:0/1524522628 wait complete. 2023-12-19T16:16:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 Processor -- start 2023-12-19T16:16:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- start start 2023-12-19T16:16:31.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca80b1690 0x7fbca81f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca80c8fa0 0x7fbca80ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca81f5010 con 0x7fbca815dfc0 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80adfa0 con 0x7fbca80c8fa0 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcafff0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8147a00 con 0x7fbca80b1690 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55840/0 (socket says 172.21.15.73:55840) 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 -- 172.21.15.73:0/2174001077 learned_addr learned my addr 172.21.15.73:0/2174001077 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcadd8c640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca80b1690 0x7fbca81f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcad58b640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca80c8fa0 0x7fbca80ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 -- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca80b1690 msgr2=0x7fbca81f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca80b1690 0x7fbca81f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 -- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca80c8fa0 msgr2=0x7fbca80ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca80c8fa0 0x7fbca80ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.356+0000 7fbcae58d640 1 -- 172.21.15.73:0/2174001077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980094d0 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbcae58d640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007e40 tx=0x7fbca000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0014620 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca000ee90 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca80aba10 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00149e0 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca80abfd0 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca8074050 con 0x7fbca815dfc0 2023-12-19T16:16:31.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbca0014b40 con 0x7fbca815dfc0 2023-12-19T16:16:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 0x7fbc8c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbca0083970 con 0x7fbca815dfc0 2023-12-19T16:16:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.360+0000 7fbcadd8c640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 0x7fbc8c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.364+0000 7fbcadd8c640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 0x7fbc8c067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f70 tx=0x7fbca4007df0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.364+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbca0051470 con 0x7fbca815dfc0 2023-12-19T16:16:31.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.520+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca815d160 con 0x7fbca815dfc0 2023-12-19T16:16:31.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.520+0000 7fbc9e7fc640 1 -- 172.21.15.73:0/2174001077 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fbca0054a90 con 0x7fbca815dfc0 2023-12-19T16:16:31.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:31.526 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:30.837197+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:31.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 msgr2=0x7fbc8c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 0x7fbc8c067f20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000f70 tx=0x7fbca4007df0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 msgr2=0x7fbca80ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbca0007e40 tx=0x7fbca000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 shutdown_connections 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbc8c065a60 0x7fbc8c067f20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbca815dfc0 0x7fbca80ad970 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbca80c8fa0 0x7fbca80ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 --2- 172.21.15.73:0/2174001077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbca80b1690 0x7fbca81f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 >> 172.21.15.73:0/2174001077 conn(0x7fbca80b0270 msgr2=0x7fbca815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 shutdown_connections 2023-12-19T16:16:31.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.524+0000 7fbcafff0640 1 -- 172.21.15.73:0/2174001077 wait complete. 2023-12-19T16:16:31.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:16:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 Processor -- start 2023-12-19T16:16:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 -- start start 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c0406d410 0x7f5c040b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040cce80 con 0x7f5c041598c0 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c040cc270 con 0x7f5c040b0660 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c0b241640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c040b0b10 con 0x7f5c0406d410 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5c041598c0 0x7f5c0406c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56138/0 (socket says 172.21.15.73:56138) 2023-12-19T16:16:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 -- 172.21.15.73:0/1027080328 learned_addr learned my addr 172.21.15.73:0/1027080328 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:31.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c03fff640 1 --2- 172.21.15.73:0/1027080328 >> v2:172.21.15.162:3300/0 conn(0x7f5c0406d410 0x7f5c040b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.691 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392527000 0 0) 0x7f5c040cce80 con 0x7f5c041598c0 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf4005740 con 0x7f5c041598c0 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3213922333 0 0) 0x7f5bf4005740 con 0x7f5c041598c0 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 >> v2:172.21.15.162:3300/0 conn(0x7f5c0406d410 msgr2=0x7f5c040b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 --2- 172.21.15.73:0/1027080328 >> v2:172.21.15.162:3300/0 conn(0x7f5c0406d410 0x7f5c040b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 >> v1:172.21.15.162:6789/0 conn(0x7f5c040b0660 legacy=0x7f5c040cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040cc550 con 0x7f5c041598c0 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f5bf8001680 con 0x7f5c041598c0 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 >> v1:172.21.15.73:6789/0 conn(0x7f5c041598c0 legacy=0x7f5c0406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 0x7f5bf4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf40069e0 0x7f5bf4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf40073a0 0x7f5bf400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040b0b10 con 0x7f5bf4005b90 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf400e240 con 0x7f5bf40069e0 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf400e400 con 0x7f5bf40073a0 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 0x7f5bf4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c03fff640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf40069e0 0x7f5bf4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c097de640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf40073a0 0x7f5bf400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 -- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf40073a0 msgr2=0x7f5bf400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf40073a0 0x7f5bf400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 -- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf40069e0 msgr2=0x7f5bf4006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5bf40069e0 0x7f5bf4006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c08fdd640 1 -- 172.21.15.73:0/1027080328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4005740 con 0x7f5bf4005b90 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c097de640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf40073a0 0x7f5bf400dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:31.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.684+0000 7f5c097de640 1 -- 172.21.15.73:0/1027080328 reap_dead start 2023-12-19T16:16:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 0x7f5bf4005fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800c1c0 tx=0x7f5bf801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fb36c04fa627b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8005ae0 con 0x7f5bf4005b90 2023-12-19T16:16:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf8005c40 con 0x7f5bf4005b90 2023-12-19T16:16:31.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c037fe640 1 -- 172.21.15.73:0/1027080328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80072b0 con 0x7f5bf4005b90 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 -- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 msgr2=0x7f5bf4005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 0x7f5bf4005fb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800c1c0 tx=0x7f5bf801cbf0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 -- 172.21.15.73:0/1027080328 shutdown_connections 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 --2- 172.21.15.73:0/1027080328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bf4005b90 0x7f5bf4005fb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 -- 172.21.15.73:0/1027080328 >> 172.21.15.73:0/1027080328 conn(0x7f5c0406a570 msgr2=0x7f5c040ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 -- 172.21.15.73:0/1027080328 shutdown_connections 2023-12-19T16:16:31.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.688+0000 7f5c0b241640 1 -- 172.21.15.73:0/1027080328 wait complete. 2023-12-19T16:16:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 Processor -- start 2023-12-19T16:16:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 -- start start 2023-12-19T16:16:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf4005b90 0x7f5c04158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 0x7f5c041f8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040b2b10 con 0x7f5c040b17c0 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04159100 con 0x7f5c040b2690 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c0b241640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040b3d30 con 0x7f5bf4005b90 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55856/0 (socket says 172.21.15.73:55856) 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 -- 172.21.15.73:0/2964802614 learned_addr learned my addr 172.21.15.73:0/2964802614 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf4005b90 0x7f5c04158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c097de640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 0x7f5c041f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 -- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf4005b90 msgr2=0x7f5c04158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf4005b90 0x7f5c04158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 -- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 msgr2=0x7f5c041f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 0x7f5c041f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 -- 172.21.15.73:0/2964802614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040b4010 con 0x7f5c040b17c0 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c097de640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 0x7f5c041f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:31.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.692+0000 7f5c03fff640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00119a0 tx=0x7f5bf0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000faf0 con 0x7f5c040b17c0 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000fc50 con 0x7f5c040b17c0 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0014440 con 0x7f5c040b17c0 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c040b42f0 con 0x7f5c040b17c0 2023-12-19T16:16:31.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0415b070 con 0x7f5c040b17c0 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0415b230 con 0x7f5c040b17c0 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5bf00145a0 con 0x7f5c040b17c0 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 0x7f5be8067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bf0083850 con 0x7f5c040b17c0 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 0x7f5be8067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:31.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.696+0000 7f5c08fdd640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 0x7f5be8067fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80ab000 tx=0x7f5bf80b1040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:31.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.700+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5bf0051280 con 0x7f5c040b17c0 2023-12-19T16:16:31.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:31.888+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5c0404e070 con 0x7f5c040b17c0 2023-12-19T16:16:32.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c017fa640 1 -- 172.21.15.73:0/2964802614 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5bf00548a0 con 0x7f5c040b17c0 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 msgr2=0x7f5be8067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 0x7f5be8067fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80ab000 tx=0x7f5bf80b1040 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 msgr2=0x7f5c040b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00119a0 tx=0x7f5bf0011e60 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 shutdown_connections 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c040b2690 0x7f5c041f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5be8065ae0 0x7f5be8067fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c040b17c0 0x7f5c040b2150 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 --2- 172.21.15.73:0/2964802614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5bf4005b90 0x7f5c04158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 >> 172.21.15.73:0/2964802614 conn(0x7f5c0406a570 msgr2=0x7f5c040caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 shutdown_connections 2023-12-19T16:16:32.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:32.852+0000 7f5c0b241640 1 -- 172.21.15.73:0/2964802614 wait complete. 2023-12-19T16:16:32.880 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:16:32.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:16:33.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.016+0000 7f137fe8c640 1 Processor -- start 2023-12-19T16:16:33.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.016+0000 7f137fe8c640 1 -- start start 2023-12-19T16:16:33.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137fe8c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f137806d410 0x7f13780b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137fe8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780cce80 con 0x7f13780b0660 2023-12-19T16:16:33.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137fe8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780cc270 con 0x7f13781598c0 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137fe8c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780b0b10 con 0x7f137806d410 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f137806d410 0x7f13780b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137e429640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f13780b0660 0x7f13780cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56144/0 (socket says 172.21.15.73:56144) 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f137806d410 0x7f13780b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55872/0 (socket says 172.21.15.73:55872) 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137e429640 1 -- 172.21.15.73:0/503124558 learned_addr learned my addr 172.21.15.73:0/503124558 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 -- 172.21.15.73:0/503124558 >> v1:172.21.15.162:6789/0 conn(0x7f13781598c0 legacy=0x7f137806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 -- 172.21.15.73:0/503124558 >> v1:172.21.15.73:6789/0 conn(0x7f13780b0660 legacy=0x7f13780cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 -- 172.21.15.73:0/503124558 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780cc550 con 0x7f137806d410 2023-12-19T16:16:33.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137cc26640 1 -- 172.21.15.73:0/503124558 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863180386 0 0) 0x7f13780cce80 con 0x7f13780b0660 2023-12-19T16:16:33.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.020+0000 7f137d427640 1 --2- 172.21.15.73:0/503124558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f137806d410 0x7f13780b0120 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f136800ba60 tx=0x7f136801eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dddbeeb1acc12dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137cc26640 1 -- 172.21.15.73:0/503124558 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680a7bf0 con 0x7f137806d410 2023-12-19T16:16:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137cc26640 1 -- 172.21.15.73:0/503124558 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13680a7d50 con 0x7f137806d410 2023-12-19T16:16:33.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137cc26640 1 -- 172.21.15.73:0/503124558 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680af660 con 0x7f137806d410 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- 172.21.15.73:0/503124558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f137806d410 msgr2=0x7f13780b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 --2- 172.21.15.73:0/503124558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f137806d410 0x7f13780b0120 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f136800ba60 tx=0x7f136801eb20 comp rx=0 tx=0).stop 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- 172.21.15.73:0/503124558 shutdown_connections 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 --2- 172.21.15.73:0/503124558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f137806d410 0x7f13780b0120 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- 172.21.15.73:0/503124558 >> 172.21.15.73:0/503124558 conn(0x7f137806a570 msgr2=0x7f13780ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- 172.21.15.73:0/503124558 shutdown_connections 2023-12-19T16:16:33.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- 172.21.15.73:0/503124558 wait complete. 2023-12-19T16:16:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 Processor -- start 2023-12-19T16:16:33.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- start start 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f137806d410 0x7f13781506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13780b0660 0x7f13780c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c8640 con 0x7f13781598c0 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c8850 con 0x7f137806d410 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137fe8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1378152030 con 0x7f13780b0660 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137e429640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137e429640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55874/0 (socket says 172.21.15.73:55874) 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137e429640 1 -- 172.21.15.73:0/2616046871 learned_addr learned my addr 172.21.15.73:0/2616046871 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137dc28640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f137806d410 0x7f13781506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.024+0000 7f137d427640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13780b0660 0x7f13780c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 -- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13780b0660 msgr2=0x7f13780c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13780b0660 0x7f13780c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 -- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f137806d410 msgr2=0x7f13781506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f137806d410 0x7f13781506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 -- 172.21.15.73:0/2616046871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136800b6c0 con 0x7f13781598c0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137e429640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1370001570 tx=0x7f137000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000a640 con 0x7f13781598c0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000a7c0 con 0x7f13781598c0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1378152310 con 0x7f13781598c0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000ab70 con 0x7f13781598c0 2023-12-19T16:16:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137806c320 con 0x7f13781598c0 2023-12-19T16:16:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804e070 con 0x7f13781598c0 2023-12-19T16:16:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f137000acd0 con 0x7f13781598c0 2023-12-19T16:16:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 0x7f135c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1370082960 con 0x7f13781598c0 2023-12-19T16:16:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.028+0000 7f137dc28640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 0x7f135c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:33.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.032+0000 7f137dc28640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 0x7f135c067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1374007fd0 tx=0x7f1374009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:33.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.032+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f13700503c0 con 0x7f13781598c0 2023-12-19T16:16:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.216+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13780b42e0 con 0x7f13781598c0 2023-12-19T16:16:33.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.852+0000 7f136e7fc640 1 -- 172.21.15.73:0/2616046871 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13700180c0 con 0x7f13781598c0 2023-12-19T16:16:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 msgr2=0x7f135c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 0x7f135c067f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1374007fd0 tx=0x7f1374009040 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 msgr2=0x7f137806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1370001570 tx=0x7f137000cca0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 shutdown_connections 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f135c065a60 0x7f135c067f20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13781598c0 0x7f137806bde0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f13780b0660 0x7f13780c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 --2- 172.21.15.73:0/2616046871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f137806d410 0x7f13781506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 >> 172.21.15.73:0/2616046871 conn(0x7f137806a570 msgr2=0x7f13780ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 shutdown_connections 2023-12-19T16:16:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:33.856+0000 7f137fe8c640 1 -- 172.21.15.73:0/2616046871 wait complete. 2023-12-19T16:16:33.883 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:16:33.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 Processor -- start 2023-12-19T16:16:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 -- start start 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9ac159830 0x7fb9ac15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0b40b0 0x7fb9ac0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac15ad00 con 0x7fb9ac0cda70 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac15e110 con 0x7fb9ac159830 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b47a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0cdf00 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9ac159830 0x7fb9ac15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9ac159830 0x7fb9ac15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55878/0 (socket says 172.21.15.73:55878) 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 -- 172.21.15.73:0/2912916641 learned_addr learned my addr 172.21.15.73:0/2912916641 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b1d41640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0b40b0 0x7fb9ac0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 -- 172.21.15.73:0/2912916641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0b40b0 msgr2=0x7fb9ac0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0b40b0 0x7fb9ac0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 -- 172.21.15.73:0/2912916641 >> v1:172.21.15.162:6789/0 conn(0x7fb9ac0cda70 legacy=0x7fb9ac0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.020+0000 7fb9b2542640 1 -- 172.21.15.73:0/2912916641 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0ce2d0 con 0x7fb9ac159830 2023-12-19T16:16:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b2542640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac159830 0x7fb9ac15a7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009870 tx=0x7fb9a801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7502ca06c031bb4b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b1540640 1 -- 172.21.15.73:0/2912916641 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80ab600 con 0x7fb9ac159830 2023-12-19T16:16:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b1540640 1 -- 172.21.15.73:0/2912916641 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80ab760 con 0x7fb9ac159830 2023-12-19T16:16:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b1540640 1 -- 172.21.15.73:0/2912916641 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80abaf0 con 0x7fb9ac159830 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 -- 172.21.15.73:0/2912916641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac159830 msgr2=0x7fb9ac15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac159830 0x7fb9ac15a7c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009870 tx=0x7fb9a801c440 comp rx=0 tx=0).stop 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 -- 172.21.15.73:0/2912916641 shutdown_connections 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0b40b0 0x7fb9ac0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/2912916641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac159830 0x7fb9ac15a7c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 -- 172.21.15.73:0/2912916641 >> 172.21.15.73:0/2912916641 conn(0x7fb9ac0b0270 msgr2=0x7fb9ac0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 -- 172.21.15.73:0/2912916641 shutdown_connections 2023-12-19T16:16:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.024+0000 7fb9b47a6640 1 -- 172.21.15.73:0/2912916641 wait complete. 2023-12-19T16:16:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 Processor -- start 2023-12-19T16:16:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- start start 2023-12-19T16:16:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0cda70 0x7fb9ac1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9ac159830 0x7fb9ac0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0af040 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0ae0e0 con 0x7fb9ac159830 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0ae3c0 con 0x7fb9ac0cda70 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55888/0 (socket says 172.21.15.73:55888) 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 -- 172.21.15.73:0/1682044419 learned_addr learned my addr 172.21.15.73:0/1682044419 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b1d41640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0cda70 0x7fb9ac1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2d43640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9ac159830 0x7fb9ac0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 -- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0cda70 msgr2=0x7fb9ac1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0cda70 0x7fb9ac1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 -- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9ac159830 msgr2=0x7fb9ac0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9ac159830 0x7fb9ac0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 -- 172.21.15.73:0/1682044419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80094d0 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b2542640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80ad040 tx=0x7fb9a801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80b4800 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a80b4960 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0ae6a0 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a80b4d10 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac0aec60 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.028+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac074050 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.032+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb9a80b3380 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.032+0000 7fb9a2ffd640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 0x7fb990067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.032+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9a811d0b0 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.032+0000 7fb9b1d41640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 0x7fb990067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.032+0000 7fb9b1d41640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 0x7fb990067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15c820 tx=0x7fb99c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.040 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.036+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb9a80eab20 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.216+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9ac0cbfc0 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.216+0000 7fb9a2ffd640 1 -- 172.21.15.73:0/1682044419 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fb9a80ee140 con 0x7fb9ac0b40b0 2023-12-19T16:16:34.223 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:34.223 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/573250328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":573250328},{"type":"v1","addr":"172.21.15.162:6835","nonce":573250328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/145189161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":145189161},{"type":"v1","addr":"172.21.15.73:6835","nonce":145189161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4998,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1808628358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1808628358},{"type":"v1","addr":"172.21.15.73:6837","nonce":1808628358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:33.854063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5035},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5035":{"gid":5035,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1495159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1495159950},{"type":"v1","addr":"172.21.15.162:6834","nonce":1495159950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 16 2023-12-19T16:16:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 msgr2=0x7fb990067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 0x7fb990067f20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15c820 tx=0x7fb99c008040 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 msgr2=0x7fb9ac0af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80ad040 tx=0x7fb9a801ac80 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 shutdown_connections 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9ac159830 0x7fb9ac0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9ac0cda70 0x7fb9ac1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb990065a60 0x7fb990067f20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 --2- 172.21.15.73:0/1682044419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9ac0b40b0 0x7fb9ac0af460 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 >> 172.21.15.73:0/1682044419 conn(0x7fb9ac0b0270 msgr2=0x7fb9ac070130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 shutdown_connections 2023-12-19T16:16:34.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.220+0000 7fb9b47a6640 1 -- 172.21.15.73:0/1682044419 wait complete. 2023-12-19T16:16:34.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:16:34.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 Processor -- start 2023-12-19T16:16:34.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 -- start start 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f060c165800 0x7f060c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0cc4b0 con 0x7f060c0cb860 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0cc790 con 0x7f060c0c1c10 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0613539640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c165d70 con 0x7f060c165800 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0610ad4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f060c0cb860 0x7f060c0c8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56148/0 (socket says 172.21.15.73:56148) 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0610ad4640 1 -- 172.21.15.73:0/100142077 learned_addr learned my addr 172.21.15.73:0/100142077 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:34.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0611ad6640 1 --2- 172.21.15.73:0/100142077 >> v2:172.21.15.73:3300/0 conn(0x7f060c165800 0x7f060c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0611ad6640 1 -- 172.21.15.73:0/100142077 >> v1:172.21.15.162:6789/0 conn(0x7f060c0c1c10 legacy=0x7f060c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0611ad6640 1 -- 172.21.15.73:0/100142077 >> v1:172.21.15.73:6789/0 conn(0x7f060c0cb860 legacy=0x7f060c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0611ad6640 1 -- 172.21.15.73:0/100142077 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0cca70 con 0x7f060c165800 2023-12-19T16:16:34.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.376+0000 7f0603fff640 1 -- 172.21.15.73:0/100142077 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804885623 0 0) 0x7f060c0cc4b0 con 0x7f060c0cb860 2023-12-19T16:16:34.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0611ad6640 1 --2- 172.21.15.73:0/100142077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c165800 0x7f060c0adc90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0604009d90 tx=0x7f060401d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeff44ce360314d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0603fff640 1 -- 172.21.15.73:0/100142077 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040a5920 con 0x7f060c165800 2023-12-19T16:16:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0603fff640 1 -- 172.21.15.73:0/100142077 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040a5a80 con 0x7f060c165800 2023-12-19T16:16:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0603fff640 1 -- 172.21.15.73:0/100142077 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040a5e10 con 0x7f060c165800 2023-12-19T16:16:34.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 -- 172.21.15.73:0/100142077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c165800 msgr2=0x7f060c0adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 --2- 172.21.15.73:0/100142077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c165800 0x7f060c0adc90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0604009d90 tx=0x7f060401d3b0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 -- 172.21.15.73:0/100142077 shutdown_connections 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 --2- 172.21.15.73:0/100142077 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c165800 0x7f060c0adc90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 -- 172.21.15.73:0/100142077 >> 172.21.15.73:0/100142077 conn(0x7f060c0b0270 msgr2=0x7f060c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 -- 172.21.15.73:0/100142077 shutdown_connections 2023-12-19T16:16:34.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.380+0000 7f0613539640 1 -- 172.21.15.73:0/100142077 wait complete. 2023-12-19T16:16:34.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 Processor -- start 2023-12-19T16:16:34.388 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- start start 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f060c0cb860 0x7f060c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c165800 0x7f060c0c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0c6cd0 con 0x7f060c0c1c10 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0c6fb0 con 0x7f060c165800 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0c7290 con 0x7f060c0cb860 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55910/0 (socket says 172.21.15.73:55910) 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 -- 172.21.15.73:0/1767879183 learned_addr learned my addr 172.21.15.73:0/1767879183 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:34.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0611ad6640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c165800 0x7f060c0c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0610ad4640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f060c0cb860 0x7f060c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 -- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f060c0cb860 msgr2=0x7f060c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f060c0cb860 0x7f060c0c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 -- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c165800 msgr2=0x7f060c0c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c165800 0x7f060c0c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 -- 172.21.15.73:0/1767879183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009a70 con 0x7f060c0c1c10 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f06112d5640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f060800c500 tx=0x7f060800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608005220 con 0x7f060c0c1c10 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0608005380 con 0x7f060c0c1c10 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608007270 con 0x7f060c0c1c10 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c0c7570 con 0x7f060c0c1c10 2023-12-19T16:16:34.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.384+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c0c5190 con 0x7f060c0c1c10 2023-12-19T16:16:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c074050 con 0x7f060c0c1c10 2023-12-19T16:16:34.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f06080073d0 con 0x7f060c0c1c10 2023-12-19T16:16:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0601ffb640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 0x7f05f0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0608082b50 con 0x7f060c0c1c10 2023-12-19T16:16:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0610ad4640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 0x7f05f0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.388+0000 7f0610ad4640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 0x7f05f0067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05fc007fd0 tx=0x7f05fc007ba0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.392+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0608050480 con 0x7f060c0c1c10 2023-12-19T16:16:34.417 INFO:tasks.ceph.mds.b.smithi162.stderr:2023-12-19T16:16:34.411+0000 7fbfe863c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:16:34.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.544+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f060c0cbf10 con 0x7f060c0c1c10 2023-12-19T16:16:34.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0601ffb640 1 -- 172.21.15.73:0/1767879183 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f0608053aa0 con 0x7f060c0c1c10 2023-12-19T16:16:34.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:34.552 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:31.841169+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:16:34.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 msgr2=0x7f05f0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 0x7f05f0067f20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05fc007fd0 tx=0x7f05fc007ba0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 msgr2=0x7f060c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f060800c500 tx=0x7f060800c9c0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 shutdown_connections 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f060c165800 0x7f060c0c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f060c0cb860 0x7f060c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f05f0065a60 0x7f05f0067f20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 --2- 172.21.15.73:0/1767879183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f060c0c1c10 0x7f060c15b590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 >> 172.21.15.73:0/1767879183 conn(0x7f060c0b0270 msgr2=0x7f060c163900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 shutdown_connections 2023-12-19T16:16:34.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.548+0000 7f0613539640 1 -- 172.21.15.73:0/1767879183 wait complete. 2023-12-19T16:16:34.574 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:16:34.574 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 Processor -- start 2023-12-19T16:16:34.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 -- start start 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 0x7f31940b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f319415cff0 0x7f31940b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31940b7250 con 0x7f31940b4bd0 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31940b7530 con 0x7f319415cff0 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3199620640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31940b7810 con 0x7f31940b47f0 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f319415cff0 0x7f31940b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f319415cff0 0x7f31940b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55918/0 (socket says 172.21.15.73:55918) 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 -- 172.21.15.73:0/3998607783 learned_addr learned my addr 172.21.15.73:0/3998607783 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:34.714 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3192ffd640 1 --2- 172.21.15.73:0/3998607783 >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 0x7f31940b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 -- 172.21.15.73:0/3998607783 >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 msgr2=0x7f31940b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 --2- 172.21.15.73:0/3998607783 >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 0x7f31940b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 -- 172.21.15.73:0/3998607783 >> v1:172.21.15.162:6789/0 conn(0x7f31940b4bd0 legacy=0x7f319415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f31937fe640 1 -- 172.21.15.73:0/3998607783 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31940b7af0 con 0x7f319415cff0 2023-12-19T16:16:34.715 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.707+0000 7f3192ffd640 1 --2- 172.21.15.73:0/3998607783 >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 0x7f31940b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:34.716 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f31937fe640 1 --2- 172.21.15.73:0/3998607783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f31940b5c40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31940cfcd0 tx=0x7f318c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dba43478880f83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f31927fc640 1 -- 172.21.15.73:0/3998607783 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0a57b0 con 0x7f319415cff0 2023-12-19T16:16:34.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f31927fc640 1 -- 172.21.15.73:0/3998607783 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c0a5910 con 0x7f319415cff0 2023-12-19T16:16:34.717 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f31927fc640 1 -- 172.21.15.73:0/3998607783 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0a5ca0 con 0x7f319415cff0 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 -- 172.21.15.73:0/3998607783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 msgr2=0x7f31940b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 --2- 172.21.15.73:0/3998607783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f31940b5c40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31940cfcd0 tx=0x7f318c01c8d0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 -- 172.21.15.73:0/3998607783 shutdown_connections 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 --2- 172.21.15.73:0/3998607783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f31940b5c40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 --2- 172.21.15.73:0/3998607783 >> v2:172.21.15.162:3300/0 conn(0x7f31940b47f0 0x7f31940b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 -- 172.21.15.73:0/3998607783 >> 172.21.15.73:0/3998607783 conn(0x7f3194065ce0 msgr2=0x7f31940660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 -- 172.21.15.73:0/3998607783 shutdown_connections 2023-12-19T16:16:34.718 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.711+0000 7f3199620640 1 -- 172.21.15.73:0/3998607783 wait complete. 2023-12-19T16:16:34.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 Processor -- start 2023-12-19T16:16:34.719 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- start start 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31940b47f0 0x7f31940c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 0x7f319414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319415f860 con 0x7f319415cff0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31941557d0 con 0x7f31940b4bd0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3194155ab0 con 0x7f31940b47f0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55920/0 (socket says 172.21.15.73:55920) 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 -- 172.21.15.73:0/1394209278 learned_addr learned my addr 172.21.15.73:0/1394209278 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f318a7fc640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 0x7f319414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3192ffd640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31940b47f0 0x7f31940c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.722 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 -- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31940b47f0 msgr2=0x7f31940c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31940b47f0 0x7f31940c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 -- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 msgr2=0x7f319414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 0x7f319414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 -- 172.21.15.73:0/1394209278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c009b30 con 0x7f319415cff0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f318a7fc640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 0x7f319414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f31937fe640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f318c01a500 tx=0x7f318c019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0b8670 con 0x7f319415cff0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c0b87d0 con 0x7f319415cff0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3194155d90 con 0x7f319415cff0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0b8b60 con 0x7f319415cff0 2023-12-19T16:16:34.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3194156350 con 0x7f319415cff0 2023-12-19T16:16:34.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.715+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3194156540 con 0x7f319415cff0 2023-12-19T16:16:34.724 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.719+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f318c0b8cc0 con 0x7f319415cff0 2023-12-19T16:16:34.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.719+0000 7f318bfff640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 0x7f3174067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:34.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.719+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f318c11e680 con 0x7f319415cff0 2023-12-19T16:16:34.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.719+0000 7f3192ffd640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 0x7f3174067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:34.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.719+0000 7f3192ffd640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 0x7f3174067f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3194157680 tx=0x7f3184008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:34.728 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.723+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f318c0ec150 con 0x7f319415cff0 2023-12-19T16:16:34.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.871+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3194074050 con 0x7f3174065a90 2023-12-19T16:16:34.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.879+0000 7f318bfff640 1 -- 172.21.15.73:0/1394209278 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289475 (secure 0 0 0) 0x7f3194074050 con 0x7f3174065a90 2023-12-19T16:16:34.888 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 msgr2=0x7f3174067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 0x7f3174067f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3194157680 tx=0x7f3184008040 comp rx=0 tx=0).stop 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 msgr2=0x7f319415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f318c01a500 tx=0x7f318c019670 comp rx=0 tx=0).stop 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 shutdown_connections 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3174065a90 0x7f3174067f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f319415cff0 0x7f319415e060 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31940b4bd0 0x7f319414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 --2- 172.21.15.73:0/1394209278 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31940b47f0 0x7f31940c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:34.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 >> 172.21.15.73:0/1394209278 conn(0x7f3194065ce0 msgr2=0x7f319415a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:34.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 shutdown_connections 2023-12-19T16:16:34.892 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:34.883+0000 7f3199620640 1 -- 172.21.15.73:0/1394209278 wait complete. 2023-12-19T16:16:34.908 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-12-19T16:16:34.458812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219896,"kb_used_data":4280,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754824,"statfs":{"total":773094113280,"available":772868939776,"internally_reserved":0,"allocated":4382720,"data_stored":2395564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.018871"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610320+0000","last_change":"2023-12-19T16:16:30.873631+0000","last_active":"2023-12-19T16:16:32.610320+0000","last_peered":"2023-12-19T16:16:32.610320+0000","last_clean":"2023-12-19T16:16:32.610320+0000","last_became_active":"2023-12-19T16:16:30.873092+0000","last_became_peered":"2023-12-19T16:16:30.873092+0000","last_unstale":"2023-12-19T16:16:32.610320+0000","last_undegraded":"2023-12-19T16:16:32.610320+0000","last_fullsized":"2023-12-19T16:16:32.610320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888497+0000","last_change":"2023-12-19T16:16:30.885486+0000","last_active":"2023-12-19T16:16:30.888497+0000","last_peered":"2023-12-19T16:16:30.888497+0000","last_clean":"2023-12-19T16:16:30.888497+0000","last_became_active":"2023-12-19T16:16:30.885200+0000","last_became_peered":"2023-12-19T16:16:30.885200+0000","last_unstale":"2023-12-19T16:16:30.888497+0000","last_undegraded":"2023-12-19T16:16:30.888497+0000","last_fullsized":"2023-12-19T16:16:30.888497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:05.388239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850642+0000","last_change":"2023-12-19T16:16:30.872102+0000","last_active":"2023-12-19T16:16:31.850642+0000","last_peered":"2023-12-19T16:16:31.850642+0000","last_clean":"2023-12-19T16:16:31.850642+0000","last_became_active":"2023-12-19T16:16:30.871864+0000","last_became_peered":"2023-12-19T16:16:30.871864+0000","last_unstale":"2023-12-19T16:16:31.850642+0000","last_undegraded":"2023-12-19T16:16:31.850642+0000","last_fullsized":"2023-12-19T16:16:31.850642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:50.987252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891736+0000","last_change":"2023-12-19T16:16:30.885871+0000","last_active":"2023-12-19T16:16:30.891736+0000","last_peered":"2023-12-19T16:16:30.891736+0000","last_clean":"2023-12-19T16:16:30.891736+0000","last_became_active":"2023-12-19T16:16:30.885516+0000","last_became_peered":"2023-12-19T16:16:30.885516+0000","last_unstale":"2023-12-19T16:16:30.891736+0000","last_undegraded":"2023-12-19T16:16:30.891736+0000","last_fullsized":"2023-12-19T16:16:30.891736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:17.863609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.868525+0000","last_change":"2023-12-19T16:16:30.859052+0000","last_active":"2023-12-19T16:16:30.868525+0000","last_peered":"2023-12-19T16:16:30.868525+0000","last_clean":"2023-12-19T16:16:30.868525+0000","last_became_active":"2023-12-19T16:16:30.858758+0000","last_became_peered":"2023-12-19T16:16:30.858758+0000","last_unstale":"2023-12-19T16:16:30.868525+0000","last_undegraded":"2023-12-19T16:16:30.868525+0000","last_fullsized":"2023-12-19T16:16:30.868525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:35.251963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852160+0000","last_change":"2023-12-19T16:16:30.864726+0000","last_active":"2023-12-19T16:16:31.852160+0000","last_peered":"2023-12-19T16:16:31.852160+0000","last_clean":"2023-12-19T16:16:31.852160+0000","last_became_active":"2023-12-19T16:16:30.864439+0000","last_became_peered":"2023-12-19T16:16:30.864439+0000","last_unstale":"2023-12-19T16:16:31.852160+0000","last_undegraded":"2023-12-19T16:16:31.852160+0000","last_fullsized":"2023-12-19T16:16:31.852160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:30.532000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609939+0000","last_change":"2023-12-19T16:16:30.870860+0000","last_active":"2023-12-19T16:16:32.609939+0000","last_peered":"2023-12-19T16:16:32.609939+0000","last_clean":"2023-12-19T16:16:32.609939+0000","last_became_active":"2023-12-19T16:16:30.870586+0000","last_became_peered":"2023-12-19T16:16:30.870586+0000","last_unstale":"2023-12-19T16:16:32.609939+0000","last_undegraded":"2023-12-19T16:16:32.609939+0000","last_fullsized":"2023-12-19T16:16:32.609939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609937+0000","last_change":"2023-12-19T16:16:30.860451+0000","last_active":"2023-12-19T16:16:32.609937+0000","last_peered":"2023-12-19T16:16:32.609937+0000","last_clean":"2023-12-19T16:16:32.609937+0000","last_became_active":"2023-12-19T16:16:30.860191+0000","last_became_peered":"2023-12-19T16:16:30.860191+0000","last_unstale":"2023-12-19T16:16:32.609937+0000","last_undegraded":"2023-12-19T16:16:32.609937+0000","last_fullsized":"2023-12-19T16:16:32.609937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850614+0000","last_change":"2023-12-19T16:16:30.883603+0000","last_active":"2023-12-19T16:16:31.850614+0000","last_peered":"2023-12-19T16:16:31.850614+0000","last_clean":"2023-12-19T16:16:31.850614+0000","last_became_active":"2023-12-19T16:16:30.883290+0000","last_became_peered":"2023-12-19T16:16:30.883290+0000","last_unstale":"2023-12-19T16:16:31.850614+0000","last_undegraded":"2023-12-19T16:16:31.850614+0000","last_fullsized":"2023-12-19T16:16:31.850614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:30:39.119092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891674+0000","last_change":"2023-12-19T16:16:30.885366+0000","last_active":"2023-12-19T16:16:30.891674+0000","last_peered":"2023-12-19T16:16:30.891674+0000","last_clean":"2023-12-19T16:16:30.891674+0000","last_became_active":"2023-12-19T16:16:30.881770+0000","last_became_peered":"2023-12-19T16:16:30.881770+0000","last_unstale":"2023-12-19T16:16:30.891674+0000","last_undegraded":"2023-12-19T16:16:30.891674+0000","last_fullsized":"2023-12-19T16:16:30.891674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:12.761741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804707+0000","last_change":"2023-12-19T16:16:30.882150+0000","last_active":"2023-12-19T16:16:32.804707+0000","last_peered":"2023-12-19T16:16:32.804707+0000","last_clean":"2023-12-19T16:16:32.804707+0000","last_became_active":"2023-12-19T16:16:30.881903+0000","last_became_peered":"2023-12-19T16:16:30.881903+0000","last_unstale":"2023-12-19T16:16:32.804707+0000","last_undegraded":"2023-12-19T16:16:32.804707+0000","last_fullsized":"2023-12-19T16:16:32.804707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:13.687851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850539+0000","last_change":"2023-12-19T16:16:30.862604+0000","last_active":"2023-12-19T16:16:31.850539+0000","last_peered":"2023-12-19T16:16:31.850539+0000","last_clean":"2023-12-19T16:16:31.850539+0000","last_became_active":"2023-12-19T16:16:30.861789+0000","last_became_peered":"2023-12-19T16:16:30.861789+0000","last_unstale":"2023-12-19T16:16:31.850539+0000","last_undegraded":"2023-12-19T16:16:31.850539+0000","last_fullsized":"2023-12-19T16:16:31.850539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:55:13.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888635+0000","last_change":"2023-12-19T16:16:30.884278+0000","last_active":"2023-12-19T16:16:30.888635+0000","last_peered":"2023-12-19T16:16:30.888635+0000","last_clean":"2023-12-19T16:16:30.888635+0000","last_became_active":"2023-12-19T16:16:30.883821+0000","last_became_peered":"2023-12-19T16:16:30.883821+0000","last_unstale":"2023-12-19T16:16:30.888635+0000","last_undegraded":"2023-12-19T16:16:30.888635+0000","last_fullsized":"2023-12-19T16:16:30.888635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891498+0000","last_change":"2023-12-19T16:16:30.881144+0000","last_active":"2023-12-19T16:16:30.891498+0000","last_peered":"2023-12-19T16:16:30.891498+0000","last_clean":"2023-12-19T16:16:30.891498+0000","last_became_active":"2023-12-19T16:16:30.880436+0000","last_became_peered":"2023-12-19T16:16:30.880436+0000","last_unstale":"2023-12-19T16:16:30.891498+0000","last_undegraded":"2023-12-19T16:16:30.891498+0000","last_fullsized":"2023-12-19T16:16:30.891498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:28.466094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804601+0000","last_change":"2023-12-19T16:16:30.873689+0000","last_active":"2023-12-19T16:16:32.804601+0000","last_peered":"2023-12-19T16:16:32.804601+0000","last_clean":"2023-12-19T16:16:32.804601+0000","last_became_active":"2023-12-19T16:16:30.873420+0000","last_became_peered":"2023-12-19T16:16:30.873420+0000","last_unstale":"2023-12-19T16:16:32.804601+0000","last_undegraded":"2023-12-19T16:16:32.804601+0000","last_fullsized":"2023-12-19T16:16:32.804601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804124+0000","last_change":"2023-12-19T16:16:30.866229+0000","last_active":"2023-12-19T16:16:32.804124+0000","last_peered":"2023-12-19T16:16:32.804124+0000","last_clean":"2023-12-19T16:16:32.804124+0000","last_became_active":"2023-12-19T16:16:30.861815+0000","last_became_peered":"2023-12-19T16:16:30.861815+0000","last_unstale":"2023-12-19T16:16:32.804124+0000","last_undegraded":"2023-12-19T16:16:32.804124+0000","last_fullsized":"2023-12-19T16:16:32.804124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804921+0000","last_change":"2023-12-19T16:16:30.869957+0000","last_active":"2023-12-19T16:16:32.804921+0000","last_peered":"2023-12-19T16:16:32.804921+0000","last_clean":"2023-12-19T16:16:32.804921+0000","last_became_active":"2023-12-19T16:16:30.869700+0000","last_became_peered":"2023-12-19T16:16:30.869700+0000","last_unstale":"2023-12-19T16:16:32.804921+0000","last_undegraded":"2023-12-19T16:16:32.804921+0000","last_fullsized":"2023-12-19T16:16:32.804921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:54.350703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852468+0000","last_change":"2023-12-19T16:16:30.870402+0000","last_active":"2023-12-19T16:16:31.852468+0000","last_peered":"2023-12-19T16:16:31.852468+0000","last_clean":"2023-12-19T16:16:31.852468+0000","last_became_active":"2023-12-19T16:16:30.866713+0000","last_became_peered":"2023-12-19T16:16:30.866713+0000","last_unstale":"2023-12-19T16:16:31.852468+0000","last_undegraded":"2023-12-19T16:16:31.852468+0000","last_fullsized":"2023-12-19T16:16:31.852468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:46.763001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852260+0000","last_change":"2023-12-19T16:16:30.859469+0000","last_active":"2023-12-19T16:16:31.852260+0000","last_peered":"2023-12-19T16:16:31.852260+0000","last_clean":"2023-12-19T16:16:31.852260+0000","last_became_active":"2023-12-19T16:16:30.859210+0000","last_became_peered":"2023-12-19T16:16:30.859210+0000","last_unstale":"2023-12-19T16:16:31.852260+0000","last_undegraded":"2023-12-19T16:16:31.852260+0000","last_fullsized":"2023-12-19T16:16:31.852260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:23:28.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875480+0000","last_change":"2023-12-19T16:16:30.869774+0000","last_active":"2023-12-19T16:16:30.875480+0000","last_peered":"2023-12-19T16:16:30.875480+0000","last_clean":"2023-12-19T16:16:30.875480+0000","last_became_active":"2023-12-19T16:16:30.869522+0000","last_became_peered":"2023-12-19T16:16:30.869522+0000","last_unstale":"2023-12-19T16:16:30.875480+0000","last_undegraded":"2023-12-19T16:16:30.875480+0000","last_fullsized":"2023-12-19T16:16:30.875480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804267+0000","last_change":"2023-12-19T16:16:30.867793+0000","last_active":"2023-12-19T16:16:32.804267+0000","last_peered":"2023-12-19T16:16:32.804267+0000","last_clean":"2023-12-19T16:16:32.804267+0000","last_became_active":"2023-12-19T16:16:30.867533+0000","last_became_peered":"2023-12-19T16:16:30.867533+0000","last_unstale":"2023-12-19T16:16:32.804267+0000","last_undegraded":"2023-12-19T16:16:32.804267+0000","last_fullsized":"2023-12-19T16:16:32.804267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610044+0000","last_change":"2023-12-19T16:16:30.883595+0000","last_active":"2023-12-19T16:16:32.610044+0000","last_peered":"2023-12-19T16:16:32.610044+0000","last_clean":"2023-12-19T16:16:32.610044+0000","last_became_active":"2023-12-19T16:16:30.882723+0000","last_became_peered":"2023-12-19T16:16:30.882723+0000","last_unstale":"2023-12-19T16:16:32.610044+0000","last_undegraded":"2023-12-19T16:16:32.610044+0000","last_fullsized":"2023-12-19T16:16:32.610044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:05.388239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875398+0000","last_change":"2023-12-19T16:16:30.868621+0000","last_active":"2023-12-19T16:16:30.875398+0000","last_peered":"2023-12-19T16:16:30.875398+0000","last_clean":"2023-12-19T16:16:30.875398+0000","last_became_active":"2023-12-19T16:16:30.868026+0000","last_became_peered":"2023-12-19T16:16:30.868026+0000","last_unstale":"2023-12-19T16:16:30.875398+0000","last_undegraded":"2023-12-19T16:16:30.875398+0000","last_fullsized":"2023-12-19T16:16:30.875398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610084+0000","last_change":"2023-12-19T16:16:30.878754+0000","last_active":"2023-12-19T16:16:32.610084+0000","last_peered":"2023-12-19T16:16:32.610084+0000","last_clean":"2023-12-19T16:16:32.610084+0000","last_became_active":"2023-12-19T16:16:30.878541+0000","last_became_peered":"2023-12-19T16:16:30.878541+0000","last_unstale":"2023-12-19T16:16:32.610084+0000","last_undegraded":"2023-12-19T16:16:32.610084+0000","last_fullsized":"2023-12-19T16:16:32.610084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891478+0000","last_change":"2023-12-19T16:16:30.880853+0000","last_active":"2023-12-19T16:16:30.891478+0000","last_peered":"2023-12-19T16:16:30.891478+0000","last_clean":"2023-12-19T16:16:30.891478+0000","last_became_active":"2023-12-19T16:16:30.880539+0000","last_became_peered":"2023-12-19T16:16:30.880539+0000","last_unstale":"2023-12-19T16:16:30.891478+0000","last_undegraded":"2023-12-19T16:16:30.891478+0000","last_fullsized":"2023-12-19T16:16:30.891478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:06:05.321280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891552+0000","last_change":"2023-12-19T16:16:30.881649+0000","last_active":"2023-12-19T16:16:30.891552+0000","last_peered":"2023-12-19T16:16:30.891552+0000","last_clean":"2023-12-19T16:16:30.891552+0000","last_became_active":"2023-12-19T16:16:30.881346+0000","last_became_peered":"2023-12-19T16:16:30.881346+0000","last_unstale":"2023-12-19T16:16:30.891552+0000","last_undegraded":"2023-12-19T16:16:30.891552+0000","last_fullsized":"2023-12-19T16:16:30.891552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:42.789732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870931+0000","last_change":"2023-12-19T16:16:30.868862+0000","last_active":"2023-12-19T16:16:30.870931+0000","last_peered":"2023-12-19T16:16:30.870931+0000","last_clean":"2023-12-19T16:16:30.870931+0000","last_became_active":"2023-12-19T16:16:30.868540+0000","last_became_peered":"2023-12-19T16:16:30.868540+0000","last_unstale":"2023-12-19T16:16:30.870931+0000","last_undegraded":"2023-12-19T16:16:30.870931+0000","last_fullsized":"2023-12-19T16:16:30.870931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610252+0000","last_change":"2023-12-19T16:16:30.871821+0000","last_active":"2023-12-19T16:16:32.610252+0000","last_peered":"2023-12-19T16:16:32.610252+0000","last_clean":"2023-12-19T16:16:32.610252+0000","last_became_active":"2023-12-19T16:16:30.871562+0000","last_became_peered":"2023-12-19T16:16:30.871562+0000","last_unstale":"2023-12-19T16:16:32.610252+0000","last_undegraded":"2023-12-19T16:16:32.610252+0000","last_fullsized":"2023-12-19T16:16:32.610252+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804377+0000","last_change":"2023-12-19T16:16:30.882288+0000","last_active":"2023-12-19T16:16:32.804377+0000","last_peered":"2023-12-19T16:16:32.804377+0000","last_clean":"2023-12-19T16:16:32.804377+0000","last_became_active":"2023-12-19T16:16:30.881666+0000","last_became_peered":"2023-12-19T16:16:30.881666+0000","last_unstale":"2023-12-19T16:16:32.804377+0000","last_undegraded":"2023-12-19T16:16:32.804377+0000","last_fullsized":"2023-12-19T16:16:32.804377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804343+0000","last_change":"2023-12-19T16:16:30.861039+0000","last_active":"2023-12-19T16:16:32.804343+0000","last_peered":"2023-12-19T16:16:32.804343+0000","last_clean":"2023-12-19T16:16:32.804343+0000","last_became_active":"2023-12-19T16:16:30.860774+0000","last_became_peered":"2023-12-19T16:16:30.860774+0000","last_unstale":"2023-12-19T16:16:32.804343+0000","last_undegraded":"2023-12-19T16:16:32.804343+0000","last_fullsized":"2023-12-19T16:16:32.804343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609995+0000","last_change":"2023-12-19T16:16:30.856023+0000","last_active":"2023-12-19T16:16:32.609995+0000","last_peered":"2023-12-19T16:16:32.609995+0000","last_clean":"2023-12-19T16:16:32.609995+0000","last_became_active":"2023-12-19T16:16:30.855804+0000","last_became_peered":"2023-12-19T16:16:30.855804+0000","last_unstale":"2023-12-19T16:16:32.609995+0000","last_undegraded":"2023-12-19T16:16:32.609995+0000","last_fullsized":"2023-12-19T16:16:32.609995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804114+0000","last_change":"2023-12-19T16:16:30.861339+0000","last_active":"2023-12-19T16:16:32.804114+0000","last_peered":"2023-12-19T16:16:32.804114+0000","last_clean":"2023-12-19T16:16:32.804114+0000","last_became_active":"2023-12-19T16:16:30.861067+0000","last_became_peered":"2023-12-19T16:16:30.861067+0000","last_unstale":"2023-12-19T16:16:32.804114+0000","last_undegraded":"2023-12-19T16:16:32.804114+0000","last_fullsized":"2023-12-19T16:16:32.804114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:00.160083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.874662+0000","last_change":"2023-12-19T16:16:30.867563+0000","last_active":"2023-12-19T16:16:30.874662+0000","last_peered":"2023-12-19T16:16:30.874662+0000","last_clean":"2023-12-19T16:16:30.874662+0000","last_became_active":"2023-12-19T16:16:30.867229+0000","last_became_peered":"2023-12-19T16:16:30.867229+0000","last_unstale":"2023-12-19T16:16:30.874662+0000","last_undegraded":"2023-12-19T16:16:30.874662+0000","last_fullsized":"2023-12-19T16:16:30.874662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.805002+0000","last_change":"2023-12-19T16:16:30.478887+0000","last_active":"2023-12-19T16:16:32.805002+0000","last_peered":"2023-12-19T16:16:32.805002+0000","last_clean":"2023-12-19T16:16:32.805002+0000","last_became_active":"2023-12-19T16:16:30.478578+0000","last_became_peered":"2023-12-19T16:16:30.478578+0000","last_unstale":"2023-12-19T16:16:32.805002+0000","last_undegraded":"2023-12-19T16:16:32.805002+0000","last_fullsized":"2023-12-19T16:16:32.805002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:03.304594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610380+0000","last_change":"2023-12-19T16:16:30.873583+0000","last_active":"2023-12-19T16:16:32.610380+0000","last_peered":"2023-12-19T16:16:32.610380+0000","last_clean":"2023-12-19T16:16:32.610380+0000","last_became_active":"2023-12-19T16:16:30.873050+0000","last_became_peered":"2023-12-19T16:16:30.873050+0000","last_unstale":"2023-12-19T16:16:32.610380+0000","last_undegraded":"2023-12-19T16:16:32.610380+0000","last_fullsized":"2023-12-19T16:16:32.610380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887706+0000","last_change":"2023-12-19T16:16:30.476371+0000","last_active":"2023-12-19T16:16:30.887706+0000","last_peered":"2023-12-19T16:16:30.887706+0000","last_clean":"2023-12-19T16:16:30.887706+0000","last_became_active":"2023-12-19T16:16:30.476140+0000","last_became_peered":"2023-12-19T16:16:30.476140+0000","last_unstale":"2023-12-19T16:16:30.887706+0000","last_undegraded":"2023-12-19T16:16:30.887706+0000","last_fullsized":"2023-12-19T16:16:30.887706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:49.411553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610312+0000","last_change":"2023-12-19T16:16:30.887598+0000","last_active":"2023-12-19T16:16:32.610312+0000","last_peered":"2023-12-19T16:16:32.610312+0000","last_clean":"2023-12-19T16:16:32.610312+0000","last_became_active":"2023-12-19T16:16:30.887333+0000","last_became_peered":"2023-12-19T16:16:30.887333+0000","last_unstale":"2023-12-19T16:16:32.610312+0000","last_undegraded":"2023-12-19T16:16:32.610312+0000","last_fullsized":"2023-12-19T16:16:32.610312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:35.251963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852435+0000","last_change":"2023-12-19T16:16:30.478270+0000","last_active":"2023-12-19T16:16:31.852435+0000","last_peered":"2023-12-19T16:16:31.852435+0000","last_clean":"2023-12-19T16:16:31.852435+0000","last_became_active":"2023-12-19T16:16:30.477934+0000","last_became_peered":"2023-12-19T16:16:30.477934+0000","last_unstale":"2023-12-19T16:16:31.852435+0000","last_undegraded":"2023-12-19T16:16:31.852435+0000","last_fullsized":"2023-12-19T16:16:31.852435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:07.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891433+0000","last_change":"2023-12-19T16:16:30.880753+0000","last_active":"2023-12-19T16:16:30.891433+0000","last_peered":"2023-12-19T16:16:30.891433+0000","last_clean":"2023-12-19T16:16:30.891433+0000","last_became_active":"2023-12-19T16:16:30.880450+0000","last_became_peered":"2023-12-19T16:16:30.880450+0000","last_unstale":"2023-12-19T16:16:30.891433+0000","last_undegraded":"2023-12-19T16:16:30.891433+0000","last_fullsized":"2023-12-19T16:16:30.891433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:45.110409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887873+0000","last_change":"2023-12-19T16:16:30.473720+0000","last_active":"2023-12-19T16:16:30.887873+0000","last_peered":"2023-12-19T16:16:30.887873+0000","last_clean":"2023-12-19T16:16:30.887873+0000","last_became_active":"2023-12-19T16:16:30.472635+0000","last_became_peered":"2023-12-19T16:16:30.472635+0000","last_unstale":"2023-12-19T16:16:30.887873+0000","last_undegraded":"2023-12-19T16:16:30.887873+0000","last_fullsized":"2023-12-19T16:16:30.887873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:57.879245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850444+0000","last_change":"2023-12-19T16:16:30.883615+0000","last_active":"2023-12-19T16:16:31.850444+0000","last_peered":"2023-12-19T16:16:31.850444+0000","last_clean":"2023-12-19T16:16:31.850444+0000","last_became_active":"2023-12-19T16:16:30.883327+0000","last_became_peered":"2023-12-19T16:16:30.883327+0000","last_unstale":"2023-12-19T16:16:31.850444+0000","last_undegraded":"2023-12-19T16:16:31.850444+0000","last_fullsized":"2023-12-19T16:16:31.850444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:44.019482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609999+0000","last_change":"2023-12-19T16:16:30.474720+0000","last_active":"2023-12-19T16:16:32.609999+0000","last_peered":"2023-12-19T16:16:32.609999+0000","last_clean":"2023-12-19T16:16:32.609999+0000","last_became_active":"2023-12-19T16:16:30.473460+0000","last_became_peered":"2023-12-19T16:16:30.473460+0000","last_unstale":"2023-12-19T16:16:32.609999+0000","last_undegraded":"2023-12-19T16:16:32.609999+0000","last_fullsized":"2023-12-19T16:16:32.609999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:43.011998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610136+0000","last_change":"2023-12-19T16:16:30.870643+0000","last_active":"2023-12-19T16:16:32.610136+0000","last_peered":"2023-12-19T16:16:32.610136+0000","last_clean":"2023-12-19T16:16:32.610136+0000","last_became_active":"2023-12-19T16:16:30.870337+0000","last_became_peered":"2023-12-19T16:16:30.870337+0000","last_unstale":"2023-12-19T16:16:32.610136+0000","last_undegraded":"2023-12-19T16:16:32.610136+0000","last_fullsized":"2023-12-19T16:16:32.610136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:39.870121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609936+0000","last_change":"2023-12-19T16:16:30.477753+0000","last_active":"2023-12-19T16:16:32.609936+0000","last_peered":"2023-12-19T16:16:32.609936+0000","last_clean":"2023-12-19T16:16:32.609936+0000","last_became_active":"2023-12-19T16:16:30.476563+0000","last_became_peered":"2023-12-19T16:16:30.476563+0000","last_unstale":"2023-12-19T16:16:32.609936+0000","last_undegraded":"2023-12-19T16:16:32.609936+0000","last_fullsized":"2023-12-19T16:16:32.609936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:25.523120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850416+0000","last_change":"2023-12-19T16:16:30.867327+0000","last_active":"2023-12-19T16:16:31.850416+0000","last_peered":"2023-12-19T16:16:31.850416+0000","last_clean":"2023-12-19T16:16:31.850416+0000","last_became_active":"2023-12-19T16:16:30.866498+0000","last_became_peered":"2023-12-19T16:16:30.866498+0000","last_unstale":"2023-12-19T16:16:31.850416+0000","last_undegraded":"2023-12-19T16:16:31.850416+0000","last_fullsized":"2023-12-19T16:16:31.850416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:28:04.737848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.851931+0000","last_change":"2023-12-19T16:16:30.473155+0000","last_active":"2023-12-19T16:16:31.851931+0000","last_peered":"2023-12-19T16:16:31.851931+0000","last_clean":"2023-12-19T16:16:31.851931+0000","last_became_active":"2023-12-19T16:16:30.472854+0000","last_became_peered":"2023-12-19T16:16:30.472854+0000","last_unstale":"2023-12-19T16:16:31.851931+0000","last_undegraded":"2023-12-19T16:16:31.851931+0000","last_fullsized":"2023-12-19T16:16:31.851931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:24.250833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891508+0000","last_change":"2023-12-19T16:16:30.880622+0000","last_active":"2023-12-19T16:16:30.891508+0000","last_peered":"2023-12-19T16:16:30.891508+0000","last_clean":"2023-12-19T16:16:30.891508+0000","last_became_active":"2023-12-19T16:16:30.880281+0000","last_became_peered":"2023-12-19T16:16:30.880281+0000","last_unstale":"2023-12-19T16:16:30.891508+0000","last_undegraded":"2023-12-19T16:16:30.891508+0000","last_fullsized":"2023-12-19T16:16:30.891508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:41:17.445126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610226+0000","last_change":"2023-12-19T16:16:30.484145+0000","last_active":"2023-12-19T16:16:32.610226+0000","last_peered":"2023-12-19T16:16:32.610226+0000","last_clean":"2023-12-19T16:16:32.610226+0000","last_became_active":"2023-12-19T16:16:30.483846+0000","last_became_peered":"2023-12-19T16:16:30.483846+0000","last_unstale":"2023-12-19T16:16:32.610226+0000","last_undegraded":"2023-12-19T16:16:32.610226+0000","last_fullsized":"2023-12-19T16:16:32.610226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:32.858098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804913+0000","last_change":"2023-12-19T16:16:30.869526+0000","last_active":"2023-12-19T16:16:32.804913+0000","last_peered":"2023-12-19T16:16:32.804913+0000","last_clean":"2023-12-19T16:16:32.804913+0000","last_became_active":"2023-12-19T16:16:30.869013+0000","last_became_peered":"2023-12-19T16:16:30.869013+0000","last_unstale":"2023-12-19T16:16:32.804913+0000","last_undegraded":"2023-12-19T16:16:32.804913+0000","last_fullsized":"2023-12-19T16:16:32.804913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:39.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848406+0000","last_change":"2023-12-19T16:16:30.478231+0000","last_active":"2023-12-19T16:16:30.848406+0000","last_peered":"2023-12-19T16:16:30.848406+0000","last_clean":"2023-12-19T16:16:30.848406+0000","last_became_active":"2023-12-19T16:16:30.477924+0000","last_became_peered":"2023-12-19T16:16:30.477924+0000","last_unstale":"2023-12-19T16:16:30.848406+0000","last_undegraded":"2023-12-19T16:16:30.848406+0000","last_fullsized":"2023-12-19T16:16:30.848406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:23:27.892556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891628+0000","last_change":"2023-12-19T16:16:30.881789+0000","last_active":"2023-12-19T16:16:30.891628+0000","last_peered":"2023-12-19T16:16:30.891628+0000","last_clean":"2023-12-19T16:16:30.891628+0000","last_became_active":"2023-12-19T16:16:30.881320+0000","last_became_peered":"2023-12-19T16:16:30.881320+0000","last_unstale":"2023-12-19T16:16:30.891628+0000","last_undegraded":"2023-12-19T16:16:30.891628+0000","last_fullsized":"2023-12-19T16:16:30.891628+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:36:11.665210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.847955+0000","last_change":"2023-12-19T16:16:30.477038+0000","last_active":"2023-12-19T16:16:30.847955+0000","last_peered":"2023-12-19T16:16:30.847955+0000","last_clean":"2023-12-19T16:16:30.847955+0000","last_became_active":"2023-12-19T16:16:30.476660+0000","last_became_peered":"2023-12-19T16:16:30.476660+0000","last_unstale":"2023-12-19T16:16:30.847955+0000","last_undegraded":"2023-12-19T16:16:30.847955+0000","last_fullsized":"2023-12-19T16:16:30.847955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:53.771655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891775+0000","last_change":"2023-12-19T16:16:30.886210+0000","last_active":"2023-12-19T16:16:30.891775+0000","last_peered":"2023-12-19T16:16:30.891775+0000","last_clean":"2023-12-19T16:16:30.891775+0000","last_became_active":"2023-12-19T16:16:30.881053+0000","last_became_peered":"2023-12-19T16:16:30.881053+0000","last_unstale":"2023-12-19T16:16:30.891775+0000","last_undegraded":"2023-12-19T16:16:30.891775+0000","last_fullsized":"2023-12-19T16:16:30.891775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:02.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804639+0000","last_change":"2023-12-19T16:16:30.478768+0000","last_active":"2023-12-19T16:16:32.804639+0000","last_peered":"2023-12-19T16:16:32.804639+0000","last_clean":"2023-12-19T16:16:32.804639+0000","last_became_active":"2023-12-19T16:16:30.478499+0000","last_became_peered":"2023-12-19T16:16:30.478499+0000","last_unstale":"2023-12-19T16:16:32.804639+0000","last_undegraded":"2023-12-19T16:16:32.804639+0000","last_fullsized":"2023-12-19T16:16:32.804639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:04.380755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804612+0000","last_change":"2023-12-19T16:16:30.882185+0000","last_active":"2023-12-19T16:16:32.804612+0000","last_peered":"2023-12-19T16:16:32.804612+0000","last_clean":"2023-12-19T16:16:32.804612+0000","last_became_active":"2023-12-19T16:16:30.881925+0000","last_became_peered":"2023-12-19T16:16:30.881925+0000","last_unstale":"2023-12-19T16:16:32.804612+0000","last_undegraded":"2023-12-19T16:16:32.804612+0000","last_fullsized":"2023-12-19T16:16:32.804612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:49.128277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.894063+0000","last_change":"2023-12-19T16:16:30.471116+0000","last_active":"2023-12-19T16:16:30.894063+0000","last_peered":"2023-12-19T16:16:30.894063+0000","last_clean":"2023-12-19T16:16:30.894063+0000","last_became_active":"2023-12-19T16:16:30.470770+0000","last_became_peered":"2023-12-19T16:16:30.470770+0000","last_unstale":"2023-12-19T16:16:30.894063+0000","last_undegraded":"2023-12-19T16:16:30.894063+0000","last_fullsized":"2023-12-19T16:16:30.894063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:14:28.436022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.868868+0000","last_change":"2023-12-19T16:16:30.862968+0000","last_active":"2023-12-19T16:16:30.868868+0000","last_peered":"2023-12-19T16:16:30.868868+0000","last_clean":"2023-12-19T16:16:30.868868+0000","last_became_active":"2023-12-19T16:16:30.861461+0000","last_became_peered":"2023-12-19T16:16:30.861461+0000","last_unstale":"2023-12-19T16:16:30.868868+0000","last_undegraded":"2023-12-19T16:16:30.868868+0000","last_fullsized":"2023-12-19T16:16:30.868868+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610348+0000","last_change":"2023-12-19T16:16:30.475560+0000","last_active":"2023-12-19T16:16:32.610348+0000","last_peered":"2023-12-19T16:16:32.610348+0000","last_clean":"2023-12-19T16:16:32.610348+0000","last_became_active":"2023-12-19T16:16:30.475303+0000","last_became_peered":"2023-12-19T16:16:30.475303+0000","last_unstale":"2023-12-19T16:16:32.610348+0000","last_undegraded":"2023-12-19T16:16:32.610348+0000","last_fullsized":"2023-12-19T16:16:32.610348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:30:38.111608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891568+0000","last_change":"2023-12-19T16:16:30.882682+0000","last_active":"2023-12-19T16:16:30.891568+0000","last_peered":"2023-12-19T16:16:30.891568+0000","last_clean":"2023-12-19T16:16:30.891568+0000","last_became_active":"2023-12-19T16:16:30.881432+0000","last_became_peered":"2023-12-19T16:16:30.881432+0000","last_unstale":"2023-12-19T16:16:30.891568+0000","last_undegraded":"2023-12-19T16:16:30.891568+0000","last_fullsized":"2023-12-19T16:16:30.891568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:56.150622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.874261+0000","last_change":"2023-12-19T16:16:30.472220+0000","last_active":"2023-12-19T16:16:30.874261+0000","last_peered":"2023-12-19T16:16:30.874261+0000","last_clean":"2023-12-19T16:16:30.874261+0000","last_became_active":"2023-12-19T16:16:30.471854+0000","last_became_peered":"2023-12-19T16:16:30.471854+0000","last_unstale":"2023-12-19T16:16:30.874261+0000","last_undegraded":"2023-12-19T16:16:30.874261+0000","last_fullsized":"2023-12-19T16:16:30.874261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:06.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610227+0000","last_change":"2023-12-19T16:16:30.870977+0000","last_active":"2023-12-19T16:16:32.610227+0000","last_peered":"2023-12-19T16:16:32.610227+0000","last_clean":"2023-12-19T16:16:32.610227+0000","last_became_active":"2023-12-19T16:16:30.870732+0000","last_became_peered":"2023-12-19T16:16:30.870732+0000","last_unstale":"2023-12-19T16:16:32.610227+0000","last_undegraded":"2023-12-19T16:16:32.610227+0000","last_fullsized":"2023-12-19T16:16:32.610227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:42.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870366+0000","last_change":"2023-12-19T16:16:30.475287+0000","last_active":"2023-12-19T16:16:30.870366+0000","last_peered":"2023-12-19T16:16:30.870366+0000","last_clean":"2023-12-19T16:16:30.870366+0000","last_became_active":"2023-12-19T16:16:30.474998+0000","last_became_peered":"2023-12-19T16:16:30.474998+0000","last_unstale":"2023-12-19T16:16:30.870366+0000","last_undegraded":"2023-12-19T16:16:30.870366+0000","last_fullsized":"2023-12-19T16:16:30.870366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:15.684960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804476+0000","last_change":"2023-12-19T16:16:30.876198+0000","last_active":"2023-12-19T16:16:32.804476+0000","last_peered":"2023-12-19T16:16:32.804476+0000","last_clean":"2023-12-19T16:16:32.804476+0000","last_became_active":"2023-12-19T16:16:30.875464+0000","last_became_peered":"2023-12-19T16:16:30.875464+0000","last_unstale":"2023-12-19T16:16:32.804476+0000","last_undegraded":"2023-12-19T16:16:32.804476+0000","last_fullsized":"2023-12-19T16:16:32.804476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:39.697830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.851690+0000","last_change":"2023-12-19T16:16:30.473376+0000","last_active":"2023-12-19T16:16:31.851690+0000","last_peered":"2023-12-19T16:16:31.851690+0000","last_clean":"2023-12-19T16:16:31.851690+0000","last_became_active":"2023-12-19T16:16:30.473044+0000","last_became_peered":"2023-12-19T16:16:30.473044+0000","last_unstale":"2023-12-19T16:16:31.851690+0000","last_undegraded":"2023-12-19T16:16:31.851690+0000","last_fullsized":"2023-12-19T16:16:31.851690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:32.858098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804949+0000","last_change":"2023-12-19T16:16:30.884915+0000","last_active":"2023-12-19T16:16:32.804949+0000","last_peered":"2023-12-19T16:16:32.804949+0000","last_clean":"2023-12-19T16:16:32.804949+0000","last_became_active":"2023-12-19T16:16:30.884636+0000","last_became_peered":"2023-12-19T16:16:30.884636+0000","last_unstale":"2023-12-19T16:16:32.804949+0000","last_undegraded":"2023-12-19T16:16:32.804949+0000","last_fullsized":"2023-12-19T16:16:32.804949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:41:30.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852351+0000","last_change":"2023-12-19T16:16:30.474700+0000","last_active":"2023-12-19T16:16:31.852351+0000","last_peered":"2023-12-19T16:16:31.852351+0000","last_clean":"2023-12-19T16:16:31.852351+0000","last_became_active":"2023-12-19T16:16:30.474421+0000","last_became_peered":"2023-12-19T16:16:30.474421+0000","last_unstale":"2023-12-19T16:16:31.852351+0000","last_undegraded":"2023-12-19T16:16:31.852351+0000","last_fullsized":"2023-12-19T16:16:31.852351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:59:07.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850710+0000","last_change":"2023-12-19T16:16:30.867216+0000","last_active":"2023-12-19T16:16:31.850710+0000","last_peered":"2023-12-19T16:16:31.850710+0000","last_clean":"2023-12-19T16:16:31.850710+0000","last_became_active":"2023-12-19T16:16:30.866965+0000","last_became_peered":"2023-12-19T16:16:30.866965+0000","last_unstale":"2023-12-19T16:16:31.850710+0000","last_undegraded":"2023-12-19T16:16:31.850710+0000","last_fullsized":"2023-12-19T16:16:31.850710+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:08.165700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610216+0000","last_change":"2023-12-19T16:16:30.475753+0000","last_active":"2023-12-19T16:16:32.610216+0000","last_peered":"2023-12-19T16:16:32.610216+0000","last_clean":"2023-12-19T16:16:32.610216+0000","last_became_active":"2023-12-19T16:16:30.475516+0000","last_became_peered":"2023-12-19T16:16:30.475516+0000","last_unstale":"2023-12-19T16:16:32.610216+0000","last_undegraded":"2023-12-19T16:16:32.610216+0000","last_fullsized":"2023-12-19T16:16:32.610216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:49.979768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.866909+0000","last_change":"2023-12-19T16:16:30.855343+0000","last_active":"2023-12-19T16:16:30.866909+0000","last_peered":"2023-12-19T16:16:30.866909+0000","last_clean":"2023-12-19T16:16:30.866909+0000","last_became_active":"2023-12-19T16:16:30.855019+0000","last_became_peered":"2023-12-19T16:16:30.855019+0000","last_unstale":"2023-12-19T16:16:30.866909+0000","last_undegraded":"2023-12-19T16:16:30.866909+0000","last_fullsized":"2023-12-19T16:16:30.866909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804744+0000","last_change":"2023-12-19T16:16:30.470950+0000","last_active":"2023-12-19T16:16:32.804744+0000","last_peered":"2023-12-19T16:16:32.804744+0000","last_clean":"2023-12-19T16:16:32.804744+0000","last_became_active":"2023-12-19T16:16:30.470502+0000","last_became_peered":"2023-12-19T16:16:30.470502+0000","last_unstale":"2023-12-19T16:16:32.804744+0000","last_undegraded":"2023-12-19T16:16:32.804744+0000","last_fullsized":"2023-12-19T16:16:32.804744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:34.244480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852420+0000","last_change":"2023-12-19T16:16:30.865568+0000","last_active":"2023-12-19T16:16:31.852420+0000","last_peered":"2023-12-19T16:16:31.852420+0000","last_clean":"2023-12-19T16:16:31.852420+0000","last_became_active":"2023-12-19T16:16:30.865294+0000","last_became_peered":"2023-12-19T16:16:30.865294+0000","last_unstale":"2023-12-19T16:16:31.852420+0000","last_undegraded":"2023-12-19T16:16:31.852420+0000","last_fullsized":"2023-12-19T16:16:31.852420+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:34.372942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804404+0000","last_change":"2023-12-19T16:16:30.471166+0000","last_active":"2023-12-19T16:16:32.804404+0000","last_peered":"2023-12-19T16:16:32.804404+0000","last_clean":"2023-12-19T16:16:32.804404+0000","last_became_active":"2023-12-19T16:16:30.470880+0000","last_became_peered":"2023-12-19T16:16:30.470880+0000","last_unstale":"2023-12-19T16:16:32.804404+0000","last_undegraded":"2023-12-19T16:16:32.804404+0000","last_fullsized":"2023-12-19T16:16:32.804404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:14.258540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870936+0000","last_change":"2023-12-19T16:16:30.865179+0000","last_active":"2023-12-19T16:16:30.870936+0000","last_peered":"2023-12-19T16:16:30.870936+0000","last_clean":"2023-12-19T16:16:30.870936+0000","last_became_active":"2023-12-19T16:16:30.864892+0000","last_became_peered":"2023-12-19T16:16:30.864892+0000","last_unstale":"2023-12-19T16:16:30.870936+0000","last_undegraded":"2023-12-19T16:16:30.870936+0000","last_fullsized":"2023-12-19T16:16:30.870936+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.942570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888444+0000","last_change":"2023-12-19T16:16:30.478610+0000","last_active":"2023-12-19T16:16:30.888444+0000","last_peered":"2023-12-19T16:16:30.888444+0000","last_clean":"2023-12-19T16:16:30.888444+0000","last_became_active":"2023-12-19T16:16:30.478366+0000","last_became_peered":"2023-12-19T16:16:30.478366+0000","last_unstale":"2023-12-19T16:16:30.888444+0000","last_undegraded":"2023-12-19T16:16:30.888444+0000","last_fullsized":"2023-12-19T16:16:30.888444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:45.755517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.866453+0000","last_change":"2023-12-19T16:16:30.854845+0000","last_active":"2023-12-19T16:16:30.866453+0000","last_peered":"2023-12-19T16:16:30.866453+0000","last_clean":"2023-12-19T16:16:30.866453+0000","last_became_active":"2023-12-19T16:16:30.854537+0000","last_became_peered":"2023-12-19T16:16:30.854537+0000","last_unstale":"2023-12-19T16:16:30.866453+0000","last_undegraded":"2023-12-19T16:16:30.866453+0000","last_fullsized":"2023-12-19T16:16:30.866453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610067+0000","last_change":"2023-12-19T16:16:30.476561+0000","last_active":"2023-12-19T16:16:32.610067+0000","last_peered":"2023-12-19T16:16:32.610067+0000","last_clean":"2023-12-19T16:16:32.610067+0000","last_became_active":"2023-12-19T16:16:30.476104+0000","last_became_peered":"2023-12-19T16:16:30.476104+0000","last_unstale":"2023-12-19T16:16:32.610067+0000","last_undegraded":"2023-12-19T16:16:32.610067+0000","last_fullsized":"2023-12-19T16:16:32.610067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:07.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.880072+0000","last_change":"2023-12-19T16:16:30.876637+0000","last_active":"2023-12-19T16:16:30.880072+0000","last_peered":"2023-12-19T16:16:30.880072+0000","last_clean":"2023-12-19T16:16:30.880072+0000","last_became_active":"2023-12-19T16:16:30.876337+0000","last_became_peered":"2023-12-19T16:16:30.876337+0000","last_unstale":"2023-12-19T16:16:30.880072+0000","last_undegraded":"2023-12-19T16:16:30.880072+0000","last_fullsized":"2023-12-19T16:16:30.880072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:39.870121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850415+0000","last_change":"2023-12-19T16:16:30.474170+0000","last_active":"2023-12-19T16:16:31.850415+0000","last_peered":"2023-12-19T16:16:31.850415+0000","last_clean":"2023-12-19T16:16:31.850415+0000","last_became_active":"2023-12-19T16:16:30.473836+0000","last_became_peered":"2023-12-19T16:16:30.473836+0000","last_unstale":"2023-12-19T16:16:31.850415+0000","last_undegraded":"2023-12-19T16:16:31.850415+0000","last_fullsized":"2023-12-19T16:16:31.850415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:17.794989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850426+0000","last_change":"2023-12-19T16:16:30.864236+0000","last_active":"2023-12-19T16:16:31.850426+0000","last_peered":"2023-12-19T16:16:31.850426+0000","last_clean":"2023-12-19T16:16:31.850426+0000","last_became_active":"2023-12-19T16:16:30.864022+0000","last_became_peered":"2023-12-19T16:16:30.864022+0000","last_unstale":"2023-12-19T16:16:31.850426+0000","last_undegraded":"2023-12-19T16:16:31.850426+0000","last_fullsized":"2023-12-19T16:16:31.850426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:26.530603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804161+0000","last_change":"2023-12-19T16:16:30.471152+0000","last_active":"2023-12-19T16:16:32.804161+0000","last_peered":"2023-12-19T16:16:32.804161+0000","last_clean":"2023-12-19T16:16:32.804161+0000","last_became_active":"2023-12-19T16:16:30.470878+0000","last_became_peered":"2023-12-19T16:16:30.470878+0000","last_unstale":"2023-12-19T16:16:32.804161+0000","last_undegraded":"2023-12-19T16:16:32.804161+0000","last_fullsized":"2023-12-19T16:16:32.804161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.159501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852360+0000","last_change":"2023-12-19T16:16:30.872448+0000","last_active":"2023-12-19T16:16:31.852360+0000","last_peered":"2023-12-19T16:16:31.852360+0000","last_clean":"2023-12-19T16:16:31.852360+0000","last_became_active":"2023-12-19T16:16:30.872185+0000","last_became_peered":"2023-12-19T16:16:30.872185+0000","last_unstale":"2023-12-19T16:16:31.852360+0000","last_undegraded":"2023-12-19T16:16:31.852360+0000","last_fullsized":"2023-12-19T16:16:31.852360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:14:29.443506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.877644+0000","last_change":"2023-12-19T16:16:30.473746+0000","last_active":"2023-12-19T16:16:30.877644+0000","last_peered":"2023-12-19T16:16:30.877644+0000","last_clean":"2023-12-19T16:16:30.877644+0000","last_became_active":"2023-12-19T16:16:30.473432+0000","last_became_peered":"2023-12-19T16:16:30.473432+0000","last_unstale":"2023-12-19T16:16:30.877644+0000","last_undegraded":"2023-12-19T16:16:30.877644+0000","last_fullsized":"2023-12-19T16:16:30.877644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:38.296564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804993+0000","last_change":"2023-12-19T16:16:30.856154+0000","last_active":"2023-12-19T16:16:32.804993+0000","last_peered":"2023-12-19T16:16:32.804993+0000","last_clean":"2023-12-19T16:16:32.804993+0000","last_became_active":"2023-12-19T16:16:30.855939+0000","last_became_peered":"2023-12-19T16:16:30.855939+0000","last_unstale":"2023-12-19T16:16:32.804993+0000","last_undegraded":"2023-12-19T16:16:32.804993+0000","last_fullsized":"2023-12-19T16:16:32.804993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:02.916442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848052+0000","last_change":"2023-12-19T16:16:30.476903+0000","last_active":"2023-12-19T16:16:30.848052+0000","last_peered":"2023-12-19T16:16:30.848052+0000","last_clean":"2023-12-19T16:16:30.848052+0000","last_became_active":"2023-12-19T16:16:30.476305+0000","last_became_peered":"2023-12-19T16:16:30.476305+0000","last_unstale":"2023-12-19T16:16:30.848052+0000","last_undegraded":"2023-12-19T16:16:30.848052+0000","last_fullsized":"2023-12-19T16:16:30.848052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:26.675811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852372+0000","last_change":"2023-12-19T16:16:30.882940+0000","last_active":"2023-12-19T16:16:31.852372+0000","last_peered":"2023-12-19T16:16:31.852372+0000","last_clean":"2023-12-19T16:16:31.852372+0000","last_became_active":"2023-12-19T16:16:30.882581+0000","last_became_peered":"2023-12-19T16:16:30.882581+0000","last_unstale":"2023-12-19T16:16:31.852372+0000","last_undegraded":"2023-12-19T16:16:31.852372+0000","last_fullsized":"2023-12-19T16:16:31.852372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:15.266024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861986+0000","last_change":"2023-12-19T16:16:30.475338+0000","last_active":"2023-12-19T16:16:30.861986+0000","last_peered":"2023-12-19T16:16:30.861986+0000","last_clean":"2023-12-19T16:16:30.861986+0000","last_became_active":"2023-12-19T16:16:30.475035+0000","last_became_peered":"2023-12-19T16:16:30.475035+0000","last_unstale":"2023-12-19T16:16:30.861986+0000","last_undegraded":"2023-12-19T16:16:30.861986+0000","last_fullsized":"2023-12-19T16:16:30.861986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:55.679181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804458+0000","last_change":"2023-12-19T16:16:30.873788+0000","last_active":"2023-12-19T16:16:32.804458+0000","last_peered":"2023-12-19T16:16:32.804458+0000","last_clean":"2023-12-19T16:16:32.804458+0000","last_became_active":"2023-12-19T16:16:30.873506+0000","last_became_peered":"2023-12-19T16:16:30.873506+0000","last_unstale":"2023-12-19T16:16:32.804458+0000","last_undegraded":"2023-12-19T16:16:32.804458+0000","last_fullsized":"2023-12-19T16:16:32.804458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861866+0000","last_change":"2023-12-19T16:16:30.471931+0000","last_active":"2023-12-19T16:16:30.861866+0000","last_peered":"2023-12-19T16:16:30.861866+0000","last_clean":"2023-12-19T16:16:30.861866+0000","last_became_active":"2023-12-19T16:16:30.471639+0000","last_became_peered":"2023-12-19T16:16:30.471639+0000","last_unstale":"2023-12-19T16:16:30.861866+0000","last_undegraded":"2023-12-19T16:16:30.861866+0000","last_fullsized":"2023-12-19T16:16:30.861866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:24.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891425+0000","last_change":"2023-12-19T16:16:30.880649+0000","last_active":"2023-12-19T16:16:30.891425+0000","last_peered":"2023-12-19T16:16:30.891425+0000","last_clean":"2023-12-19T16:16:30.891425+0000","last_became_active":"2023-12-19T16:16:30.880341+0000","last_became_peered":"2023-12-19T16:16:30.880341+0000","last_unstale":"2023-12-19T16:16:30.891425+0000","last_undegraded":"2023-12-19T16:16:30.891425+0000","last_fullsized":"2023-12-19T16:16:30.891425+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:01.065995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861761+0000","last_change":"2023-12-19T16:16:30.472026+0000","last_active":"2023-12-19T16:16:30.861761+0000","last_peered":"2023-12-19T16:16:30.861761+0000","last_clean":"2023-12-19T16:16:30.861761+0000","last_became_active":"2023-12-19T16:16:30.471696+0000","last_became_peered":"2023-12-19T16:16:30.471696+0000","last_unstale":"2023-12-19T16:16:30.861761+0000","last_undegraded":"2023-12-19T16:16:30.861761+0000","last_fullsized":"2023-12-19T16:16:30.861761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:43.011998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887745+0000","last_change":"2023-12-19T16:16:30.875508+0000","last_active":"2023-12-19T16:16:30.887745+0000","last_peered":"2023-12-19T16:16:30.887745+0000","last_clean":"2023-12-19T16:16:30.887745+0000","last_became_active":"2023-12-19T16:16:30.875076+0000","last_became_peered":"2023-12-19T16:16:30.875076+0000","last_unstale":"2023-12-19T16:16:30.887745+0000","last_undegraded":"2023-12-19T16:16:30.887745+0000","last_fullsized":"2023-12-19T16:16:30.887745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:56.993356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610094+0000","last_change":"2023-12-19T16:16:30.475390+0000","last_active":"2023-12-19T16:16:32.610094+0000","last_peered":"2023-12-19T16:16:32.610094+0000","last_clean":"2023-12-19T16:16:32.610094+0000","last_became_active":"2023-12-19T16:16:30.475117+0000","last_became_peered":"2023-12-19T16:16:30.475117+0000","last_unstale":"2023-12-19T16:16:32.610094+0000","last_undegraded":"2023-12-19T16:16:32.610094+0000","last_fullsized":"2023-12-19T16:16:32.610094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:55:12.589540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804410+0000","last_change":"2023-12-19T16:16:30.854948+0000","last_active":"2023-12-19T16:16:32.804410+0000","last_peered":"2023-12-19T16:16:32.804410+0000","last_clean":"2023-12-19T16:16:32.804410+0000","last_became_active":"2023-12-19T16:16:30.854659+0000","last_became_peered":"2023-12-19T16:16:30.854659+0000","last_unstale":"2023-12-19T16:16:32.804410+0000","last_undegraded":"2023-12-19T16:16:32.804410+0000","last_fullsized":"2023-12-19T16:16:32.804410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:28.861502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875106+0000","last_change":"2023-12-19T16:16:30.471804+0000","last_active":"2023-12-19T16:16:30.875106+0000","last_peered":"2023-12-19T16:16:30.875106+0000","last_clean":"2023-12-19T16:16:30.875106+0000","last_became_active":"2023-12-19T16:16:30.471064+0000","last_became_peered":"2023-12-19T16:16:30.471064+0000","last_unstale":"2023-12-19T16:16:30.875106+0000","last_undegraded":"2023-12-19T16:16:30.875106+0000","last_fullsized":"2023-12-19T16:16:30.875106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:55.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804325+0000","last_change":"2023-12-19T16:16:30.862453+0000","last_active":"2023-12-19T16:16:32.804325+0000","last_peered":"2023-12-19T16:16:32.804325+0000","last_clean":"2023-12-19T16:16:32.804325+0000","last_became_active":"2023-12-19T16:16:30.862230+0000","last_became_peered":"2023-12-19T16:16:30.862230+0000","last_unstale":"2023-12-19T16:16:32.804325+0000","last_undegraded":"2023-12-19T16:16:32.804325+0000","last_fullsized":"2023-12-19T16:16:32.804325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804796+0000","last_change":"2023-12-19T16:16:30.470784+0000","last_active":"2023-12-19T16:16:32.804796+0000","last_peered":"2023-12-19T16:16:32.804796+0000","last_clean":"2023-12-19T16:16:32.804796+0000","last_became_active":"2023-12-19T16:16:30.470219+0000","last_became_peered":"2023-12-19T16:16:30.470219+0000","last_unstale":"2023-12-19T16:16:32.804796+0000","last_undegraded":"2023-12-19T16:16:32.804796+0000","last_fullsized":"2023-12-19T16:16:32.804796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:59.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848540+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:16:30.848540+0000","last_peered":"2023-12-19T16:16:30.848540+0000","last_clean":"2023-12-19T16:16:30.848540+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:16:30.848540+0000","last_undegraded":"2023-12-19T16:16:30.848540+0000","last_fullsized":"2023-12-19T16:16:30.848540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":155189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51000000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80500000000000005}]}]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":154447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.999}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.0209999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476753,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":744851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.38800000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.79500000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.76000000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476752,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":148203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53800000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.83999999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.876}]}]},{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":154435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.629}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":149677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.749},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.67600000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.627},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72699999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":983040,"data_stored":739063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.629}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.60499999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.432},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69899999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":149699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.70899999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.81599999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:34.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:16:35.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 Processor -- start 2023-12-19T16:16:35.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 -- start start 2023-12-19T16:16:35.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6e0c0d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0d3540 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.093 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0cdf10 con 0x7f6e0c160270 2023-12-19T16:16:35.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e117a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0d0ca0 con 0x7f6e0c0d0820 2023-12-19T16:16:35.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6e0c0d15e0 0x7f6e0c06b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53190/0 (socket says 172.21.15.73:53190) 2023-12-19T16:16:35.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0b7fe640 1 -- 172.21.15.73:0/1077664291 learned_addr learned my addr 172.21.15.73:0/1077664291 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e10fa1640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6e0c0d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381222669 0 0) 0x7f6e0c0d3540 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df4003530 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382103653 0 0) 0x7f6df4003530 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 msgr2=0x7f6e0c0d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6e0c0d3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 >> v1:172.21.15.162:6789/0 conn(0x7f6e0c160270 legacy=0x7f6e0c0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c06b040 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f6e00001680 con 0x7f6e0c0d15e0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 >> v1:172.21.15.73:6789/0 conn(0x7f6e0c0d15e0 legacy=0x7f6e0c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6df40039b0 0x7f6df4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6df4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0d0ca0 con 0x7f6df40039b0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400ba70 con 0x7f6df40047d0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df400bc30 con 0x7f6e0c0d0820 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6df40039b0 0x7f6df4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0b7fe640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e10fa1640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6df4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 -- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 msgr2=0x7f6df4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e0c0d0820 0x7f6df4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 -- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6df40047d0 msgr2=0x7f6df4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.087+0000 7f6e0bfff640 1 -- 172.21.15.73:0/1077664291 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df4003530 con 0x7f6df40039b0 2023-12-19T16:16:35.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e0b7fe640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6df40047d0 0x7f6df4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6df40039b0 0x7f6df4003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc001750 tx=0x7f6dfc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abf0a99fda848ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0052d0 con 0x7f6df40039b0 2023-12-19T16:16:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc0a7050 con 0x7f6df40039b0 2023-12-19T16:16:35.098 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e0affd640 1 -- 172.21.15.73:0/1077664291 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc003600 con 0x7f6df40039b0 2023-12-19T16:16:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e117a2640 1 -- 172.21.15.73:0/1077664291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6df40039b0 msgr2=0x7f6df4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1077664291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6df40039b0 0x7f6df4003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc001750 tx=0x7f6dfc01c3a0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e10fa1640 1 -- 172.21.15.73:0/1077664291 reap_dead start 2023-12-19T16:16:35.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e117a2640 1 -- 172.21.15.73:0/1077664291 shutdown_connections 2023-12-19T16:16:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.091+0000 7f6e117a2640 1 -- 172.21.15.73:0/1077664291 >> 172.21.15.73:0/1077664291 conn(0x7f6e0c09bc10 msgr2=0x7f6e0c0d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- 172.21.15.73:0/1077664291 shutdown_connections 2023-12-19T16:16:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- 172.21.15.73:0/1077664291 wait complete. 2023-12-19T16:16:35.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 Processor -- start 2023-12-19T16:16:35.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- start start 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df40039b0 0x7f6e0c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 0x7f6e0c0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c1586e0 con 0x7f6e0c157580 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b5c30 con 0x7f6e0c156670 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e117a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c157ad0 con 0x7f6df40039b0 2023-12-19T16:16:35.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33820/0 (socket says 172.21.15.73:33820) 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 -- 172.21.15.73:0/1678895990 learned_addr learned my addr 172.21.15.73:0/1678895990 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df40039b0 0x7f6e0c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 -- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df40039b0 msgr2=0x7f6e0c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e10fa1640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 0x7f6e0c0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df40039b0 0x7f6e0c0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 -- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 msgr2=0x7f6e0c0b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 0x7f6e0c0b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 -- 172.21.15.73:0/1678895990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c157db0 con 0x7f6e0c157580 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e10fa1640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 0x7f6e0c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.095+0000 7f6e0b7fe640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e700 tx=0x7f6e0000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000ee10 con 0x7f6e0c157580 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0000c8d0 con 0x7f6e0c157580 2023-12-19T16:16:35.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000cc60 con 0x7f6e0c157580 2023-12-19T16:16:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c158090 con 0x7f6e0c157580 2023-12-19T16:16:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c156d80 con 0x7f6e0c157580 2023-12-19T16:16:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c04e000 con 0x7f6e0c157580 2023-12-19T16:16:35.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e0001d460 con 0x7f6e0c157580 2023-12-19T16:16:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e00083230 con 0x7f6e0c157580 2023-12-19T16:16:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.099+0000 7f6e0bfff640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 0x7f6df8067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6df40057b0 tx=0x7f6dfc0011a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.103+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e00050ac0 con 0x7f6e0c157580 2023-12-19T16:16:35.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.251+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e0c158540 con 0x7f6df8065a60 2023-12-19T16:16:35.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.259+0000 7f6e08ff9640 1 -- 172.21.15.73:0/1678895990 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289475 (secure 0 0 0) 0x7f6dfc005310 con 0x7f6df8065a60 2023-12-19T16:16:35.266 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:35.268 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:16:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 msgr2=0x7f6df8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 0x7f6df8067f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6df40057b0 tx=0x7f6dfc0011a0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 msgr2=0x7f6e0c0c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e700 tx=0x7f6e0000ebc0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 shutdown_connections 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e0c156670 0x7f6e0c0b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6df8065a60 0x7f6df8067f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e0c157580 0x7f6e0c0c8560 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 --2- 172.21.15.73:0/1678895990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6df40039b0 0x7f6e0c0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 >> 172.21.15.73:0/1678895990 conn(0x7f6e0c09bc10 msgr2=0x7f6e0c0afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 shutdown_connections 2023-12-19T16:16:35.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.263+0000 7f6e117a2640 1 -- 172.21.15.73:0/1678895990 wait complete. 2023-12-19T16:16:35.286 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-12-19T16:16:34.458812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219896,"kb_used_data":4280,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754824,"statfs":{"total":773094113280,"available":772868939776,"internally_reserved":0,"allocated":4382720,"data_stored":2395564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.018871"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610320+0000","last_change":"2023-12-19T16:16:30.873631+0000","last_active":"2023-12-19T16:16:32.610320+0000","last_peered":"2023-12-19T16:16:32.610320+0000","last_clean":"2023-12-19T16:16:32.610320+0000","last_became_active":"2023-12-19T16:16:30.873092+0000","last_became_peered":"2023-12-19T16:16:30.873092+0000","last_unstale":"2023-12-19T16:16:32.610320+0000","last_undegraded":"2023-12-19T16:16:32.610320+0000","last_fullsized":"2023-12-19T16:16:32.610320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888497+0000","last_change":"2023-12-19T16:16:30.885486+0000","last_active":"2023-12-19T16:16:30.888497+0000","last_peered":"2023-12-19T16:16:30.888497+0000","last_clean":"2023-12-19T16:16:30.888497+0000","last_became_active":"2023-12-19T16:16:30.885200+0000","last_became_peered":"2023-12-19T16:16:30.885200+0000","last_unstale":"2023-12-19T16:16:30.888497+0000","last_undegraded":"2023-12-19T16:16:30.888497+0000","last_fullsized":"2023-12-19T16:16:30.888497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:05.388239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850642+0000","last_change":"2023-12-19T16:16:30.872102+0000","last_active":"2023-12-19T16:16:31.850642+0000","last_peered":"2023-12-19T16:16:31.850642+0000","last_clean":"2023-12-19T16:16:31.850642+0000","last_became_active":"2023-12-19T16:16:30.871864+0000","last_became_peered":"2023-12-19T16:16:30.871864+0000","last_unstale":"2023-12-19T16:16:31.850642+0000","last_undegraded":"2023-12-19T16:16:31.850642+0000","last_fullsized":"2023-12-19T16:16:31.850642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:50.987252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891736+0000","last_change":"2023-12-19T16:16:30.885871+0000","last_active":"2023-12-19T16:16:30.891736+0000","last_peered":"2023-12-19T16:16:30.891736+0000","last_clean":"2023-12-19T16:16:30.891736+0000","last_became_active":"2023-12-19T16:16:30.885516+0000","last_became_peered":"2023-12-19T16:16:30.885516+0000","last_unstale":"2023-12-19T16:16:30.891736+0000","last_undegraded":"2023-12-19T16:16:30.891736+0000","last_fullsized":"2023-12-19T16:16:30.891736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:33:17.863609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.868525+0000","last_change":"2023-12-19T16:16:30.859052+0000","last_active":"2023-12-19T16:16:30.868525+0000","last_peered":"2023-12-19T16:16:30.868525+0000","last_clean":"2023-12-19T16:16:30.868525+0000","last_became_active":"2023-12-19T16:16:30.858758+0000","last_became_peered":"2023-12-19T16:16:30.858758+0000","last_unstale":"2023-12-19T16:16:30.868525+0000","last_undegraded":"2023-12-19T16:16:30.868525+0000","last_fullsized":"2023-12-19T16:16:30.868525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:35.251963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852160+0000","last_change":"2023-12-19T16:16:30.864726+0000","last_active":"2023-12-19T16:16:31.852160+0000","last_peered":"2023-12-19T16:16:31.852160+0000","last_clean":"2023-12-19T16:16:31.852160+0000","last_became_active":"2023-12-19T16:16:30.864439+0000","last_became_peered":"2023-12-19T16:16:30.864439+0000","last_unstale":"2023-12-19T16:16:31.852160+0000","last_undegraded":"2023-12-19T16:16:31.852160+0000","last_fullsized":"2023-12-19T16:16:31.852160+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:30.532000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609939+0000","last_change":"2023-12-19T16:16:30.870860+0000","last_active":"2023-12-19T16:16:32.609939+0000","last_peered":"2023-12-19T16:16:32.609939+0000","last_clean":"2023-12-19T16:16:32.609939+0000","last_became_active":"2023-12-19T16:16:30.870586+0000","last_became_peered":"2023-12-19T16:16:30.870586+0000","last_unstale":"2023-12-19T16:16:32.609939+0000","last_undegraded":"2023-12-19T16:16:32.609939+0000","last_fullsized":"2023-12-19T16:16:32.609939+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609937+0000","last_change":"2023-12-19T16:16:30.860451+0000","last_active":"2023-12-19T16:16:32.609937+0000","last_peered":"2023-12-19T16:16:32.609937+0000","last_clean":"2023-12-19T16:16:32.609937+0000","last_became_active":"2023-12-19T16:16:30.860191+0000","last_became_peered":"2023-12-19T16:16:30.860191+0000","last_unstale":"2023-12-19T16:16:32.609937+0000","last_undegraded":"2023-12-19T16:16:32.609937+0000","last_fullsized":"2023-12-19T16:16:32.609937+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850614+0000","last_change":"2023-12-19T16:16:30.883603+0000","last_active":"2023-12-19T16:16:31.850614+0000","last_peered":"2023-12-19T16:16:31.850614+0000","last_clean":"2023-12-19T16:16:31.850614+0000","last_became_active":"2023-12-19T16:16:30.883290+0000","last_became_peered":"2023-12-19T16:16:30.883290+0000","last_unstale":"2023-12-19T16:16:31.850614+0000","last_undegraded":"2023-12-19T16:16:31.850614+0000","last_fullsized":"2023-12-19T16:16:31.850614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:30:39.119092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891674+0000","last_change":"2023-12-19T16:16:30.885366+0000","last_active":"2023-12-19T16:16:30.891674+0000","last_peered":"2023-12-19T16:16:30.891674+0000","last_clean":"2023-12-19T16:16:30.891674+0000","last_became_active":"2023-12-19T16:16:30.881770+0000","last_became_peered":"2023-12-19T16:16:30.881770+0000","last_unstale":"2023-12-19T16:16:30.891674+0000","last_undegraded":"2023-12-19T16:16:30.891674+0000","last_fullsized":"2023-12-19T16:16:30.891674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:12.761741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804707+0000","last_change":"2023-12-19T16:16:30.882150+0000","last_active":"2023-12-19T16:16:32.804707+0000","last_peered":"2023-12-19T16:16:32.804707+0000","last_clean":"2023-12-19T16:16:32.804707+0000","last_became_active":"2023-12-19T16:16:30.881903+0000","last_became_peered":"2023-12-19T16:16:30.881903+0000","last_unstale":"2023-12-19T16:16:32.804707+0000","last_undegraded":"2023-12-19T16:16:32.804707+0000","last_fullsized":"2023-12-19T16:16:32.804707+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:13.687851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850539+0000","last_change":"2023-12-19T16:16:30.862604+0000","last_active":"2023-12-19T16:16:31.850539+0000","last_peered":"2023-12-19T16:16:31.850539+0000","last_clean":"2023-12-19T16:16:31.850539+0000","last_became_active":"2023-12-19T16:16:30.861789+0000","last_became_peered":"2023-12-19T16:16:30.861789+0000","last_unstale":"2023-12-19T16:16:31.850539+0000","last_undegraded":"2023-12-19T16:16:31.850539+0000","last_fullsized":"2023-12-19T16:16:31.850539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:55:13.597023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888635+0000","last_change":"2023-12-19T16:16:30.884278+0000","last_active":"2023-12-19T16:16:30.888635+0000","last_peered":"2023-12-19T16:16:30.888635+0000","last_clean":"2023-12-19T16:16:30.888635+0000","last_became_active":"2023-12-19T16:16:30.883821+0000","last_became_peered":"2023-12-19T16:16:30.883821+0000","last_unstale":"2023-12-19T16:16:30.888635+0000","last_undegraded":"2023-12-19T16:16:30.888635+0000","last_fullsized":"2023-12-19T16:16:30.888635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891498+0000","last_change":"2023-12-19T16:16:30.881144+0000","last_active":"2023-12-19T16:16:30.891498+0000","last_peered":"2023-12-19T16:16:30.891498+0000","last_clean":"2023-12-19T16:16:30.891498+0000","last_became_active":"2023-12-19T16:16:30.880436+0000","last_became_peered":"2023-12-19T16:16:30.880436+0000","last_unstale":"2023-12-19T16:16:30.891498+0000","last_undegraded":"2023-12-19T16:16:30.891498+0000","last_fullsized":"2023-12-19T16:16:30.891498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:28.466094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804601+0000","last_change":"2023-12-19T16:16:30.873689+0000","last_active":"2023-12-19T16:16:32.804601+0000","last_peered":"2023-12-19T16:16:32.804601+0000","last_clean":"2023-12-19T16:16:32.804601+0000","last_became_active":"2023-12-19T16:16:30.873420+0000","last_became_peered":"2023-12-19T16:16:30.873420+0000","last_unstale":"2023-12-19T16:16:32.804601+0000","last_undegraded":"2023-12-19T16:16:32.804601+0000","last_fullsized":"2023-12-19T16:16:32.804601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804124+0000","last_change":"2023-12-19T16:16:30.866229+0000","last_active":"2023-12-19T16:16:32.804124+0000","last_peered":"2023-12-19T16:16:32.804124+0000","last_clean":"2023-12-19T16:16:32.804124+0000","last_became_active":"2023-12-19T16:16:30.861815+0000","last_became_peered":"2023-12-19T16:16:30.861815+0000","last_unstale":"2023-12-19T16:16:32.804124+0000","last_undegraded":"2023-12-19T16:16:32.804124+0000","last_fullsized":"2023-12-19T16:16:32.804124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804921+0000","last_change":"2023-12-19T16:16:30.869957+0000","last_active":"2023-12-19T16:16:32.804921+0000","last_peered":"2023-12-19T16:16:32.804921+0000","last_clean":"2023-12-19T16:16:32.804921+0000","last_became_active":"2023-12-19T16:16:30.869700+0000","last_became_peered":"2023-12-19T16:16:30.869700+0000","last_unstale":"2023-12-19T16:16:32.804921+0000","last_undegraded":"2023-12-19T16:16:32.804921+0000","last_fullsized":"2023-12-19T16:16:32.804921+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:54.350703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852468+0000","last_change":"2023-12-19T16:16:30.870402+0000","last_active":"2023-12-19T16:16:31.852468+0000","last_peered":"2023-12-19T16:16:31.852468+0000","last_clean":"2023-12-19T16:16:31.852468+0000","last_became_active":"2023-12-19T16:16:30.866713+0000","last_became_peered":"2023-12-19T16:16:30.866713+0000","last_unstale":"2023-12-19T16:16:31.852468+0000","last_undegraded":"2023-12-19T16:16:31.852468+0000","last_fullsized":"2023-12-19T16:16:31.852468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:46.763001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852260+0000","last_change":"2023-12-19T16:16:30.859469+0000","last_active":"2023-12-19T16:16:31.852260+0000","last_peered":"2023-12-19T16:16:31.852260+0000","last_clean":"2023-12-19T16:16:31.852260+0000","last_became_active":"2023-12-19T16:16:30.859210+0000","last_became_peered":"2023-12-19T16:16:30.859210+0000","last_unstale":"2023-12-19T16:16:31.852260+0000","last_undegraded":"2023-12-19T16:16:31.852260+0000","last_fullsized":"2023-12-19T16:16:31.852260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:23:28.900040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875480+0000","last_change":"2023-12-19T16:16:30.869774+0000","last_active":"2023-12-19T16:16:30.875480+0000","last_peered":"2023-12-19T16:16:30.875480+0000","last_clean":"2023-12-19T16:16:30.875480+0000","last_became_active":"2023-12-19T16:16:30.869522+0000","last_became_peered":"2023-12-19T16:16:30.869522+0000","last_unstale":"2023-12-19T16:16:30.875480+0000","last_undegraded":"2023-12-19T16:16:30.875480+0000","last_fullsized":"2023-12-19T16:16:30.875480+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:44.629683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804267+0000","last_change":"2023-12-19T16:16:30.867793+0000","last_active":"2023-12-19T16:16:32.804267+0000","last_peered":"2023-12-19T16:16:32.804267+0000","last_clean":"2023-12-19T16:16:32.804267+0000","last_became_active":"2023-12-19T16:16:30.867533+0000","last_became_peered":"2023-12-19T16:16:30.867533+0000","last_unstale":"2023-12-19T16:16:32.804267+0000","last_undegraded":"2023-12-19T16:16:32.804267+0000","last_fullsized":"2023-12-19T16:16:32.804267+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610044+0000","last_change":"2023-12-19T16:16:30.883595+0000","last_active":"2023-12-19T16:16:32.610044+0000","last_peered":"2023-12-19T16:16:32.610044+0000","last_clean":"2023-12-19T16:16:32.610044+0000","last_became_active":"2023-12-19T16:16:30.882723+0000","last_became_peered":"2023-12-19T16:16:30.882723+0000","last_unstale":"2023-12-19T16:16:32.610044+0000","last_undegraded":"2023-12-19T16:16:32.610044+0000","last_fullsized":"2023-12-19T16:16:32.610044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:05.388239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875398+0000","last_change":"2023-12-19T16:16:30.868621+0000","last_active":"2023-12-19T16:16:30.875398+0000","last_peered":"2023-12-19T16:16:30.875398+0000","last_clean":"2023-12-19T16:16:30.875398+0000","last_became_active":"2023-12-19T16:16:30.868026+0000","last_became_peered":"2023-12-19T16:16:30.868026+0000","last_unstale":"2023-12-19T16:16:30.875398+0000","last_undegraded":"2023-12-19T16:16:30.875398+0000","last_fullsized":"2023-12-19T16:16:30.875398+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610084+0000","last_change":"2023-12-19T16:16:30.878754+0000","last_active":"2023-12-19T16:16:32.610084+0000","last_peered":"2023-12-19T16:16:32.610084+0000","last_clean":"2023-12-19T16:16:32.610084+0000","last_became_active":"2023-12-19T16:16:30.878541+0000","last_became_peered":"2023-12-19T16:16:30.878541+0000","last_unstale":"2023-12-19T16:16:32.610084+0000","last_undegraded":"2023-12-19T16:16:32.610084+0000","last_fullsized":"2023-12-19T16:16:32.610084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891478+0000","last_change":"2023-12-19T16:16:30.880853+0000","last_active":"2023-12-19T16:16:30.891478+0000","last_peered":"2023-12-19T16:16:30.891478+0000","last_clean":"2023-12-19T16:16:30.891478+0000","last_became_active":"2023-12-19T16:16:30.880539+0000","last_became_peered":"2023-12-19T16:16:30.880539+0000","last_unstale":"2023-12-19T16:16:30.891478+0000","last_undegraded":"2023-12-19T16:16:30.891478+0000","last_fullsized":"2023-12-19T16:16:30.891478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:06:05.321280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891552+0000","last_change":"2023-12-19T16:16:30.881649+0000","last_active":"2023-12-19T16:16:30.891552+0000","last_peered":"2023-12-19T16:16:30.891552+0000","last_clean":"2023-12-19T16:16:30.891552+0000","last_became_active":"2023-12-19T16:16:30.881346+0000","last_became_peered":"2023-12-19T16:16:30.881346+0000","last_unstale":"2023-12-19T16:16:30.891552+0000","last_undegraded":"2023-12-19T16:16:30.891552+0000","last_fullsized":"2023-12-19T16:16:30.891552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:39:42.789732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870931+0000","last_change":"2023-12-19T16:16:30.868862+0000","last_active":"2023-12-19T16:16:30.870931+0000","last_peered":"2023-12-19T16:16:30.870931+0000","last_clean":"2023-12-19T16:16:30.870931+0000","last_became_active":"2023-12-19T16:16:30.868540+0000","last_became_peered":"2023-12-19T16:16:30.868540+0000","last_unstale":"2023-12-19T16:16:30.870931+0000","last_undegraded":"2023-12-19T16:16:30.870931+0000","last_fullsized":"2023-12-19T16:16:30.870931+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:00.886170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610252+0000","last_change":"2023-12-19T16:16:30.871821+0000","last_active":"2023-12-19T16:16:32.610252+0000","last_peered":"2023-12-19T16:16:32.610252+0000","last_clean":"2023-12-19T16:16:32.610252+0000","last_became_active":"2023-12-19T16:16:30.871562+0000","last_became_peered":"2023-12-19T16:16:30.871562+0000","last_unstale":"2023-12-19T16:16:32.610252+0000","last_undegraded":"2023-12-19T16:16:32.610252+0000","last_fullsized":"2023-12-19T16:16:32.610252+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:26.587976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804377+0000","last_change":"2023-12-19T16:16:30.882288+0000","last_active":"2023-12-19T16:16:32.804377+0000","last_peered":"2023-12-19T16:16:32.804377+0000","last_clean":"2023-12-19T16:16:32.804377+0000","last_became_active":"2023-12-19T16:16:30.881666+0000","last_became_peered":"2023-12-19T16:16:30.881666+0000","last_unstale":"2023-12-19T16:16:32.804377+0000","last_undegraded":"2023-12-19T16:16:32.804377+0000","last_fullsized":"2023-12-19T16:16:32.804377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804343+0000","last_change":"2023-12-19T16:16:30.861039+0000","last_active":"2023-12-19T16:16:32.804343+0000","last_peered":"2023-12-19T16:16:32.804343+0000","last_clean":"2023-12-19T16:16:32.804343+0000","last_became_active":"2023-12-19T16:16:30.860774+0000","last_became_peered":"2023-12-19T16:16:30.860774+0000","last_unstale":"2023-12-19T16:16:32.804343+0000","last_undegraded":"2023-12-19T16:16:32.804343+0000","last_fullsized":"2023-12-19T16:16:32.804343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609995+0000","last_change":"2023-12-19T16:16:30.856023+0000","last_active":"2023-12-19T16:16:32.609995+0000","last_peered":"2023-12-19T16:16:32.609995+0000","last_clean":"2023-12-19T16:16:32.609995+0000","last_became_active":"2023-12-19T16:16:30.855804+0000","last_became_peered":"2023-12-19T16:16:30.855804+0000","last_unstale":"2023-12-19T16:16:32.609995+0000","last_undegraded":"2023-12-19T16:16:32.609995+0000","last_fullsized":"2023-12-19T16:16:32.609995+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804114+0000","last_change":"2023-12-19T16:16:30.861339+0000","last_active":"2023-12-19T16:16:32.804114+0000","last_peered":"2023-12-19T16:16:32.804114+0000","last_clean":"2023-12-19T16:16:32.804114+0000","last_became_active":"2023-12-19T16:16:30.861067+0000","last_became_peered":"2023-12-19T16:16:30.861067+0000","last_unstale":"2023-12-19T16:16:32.804114+0000","last_undegraded":"2023-12-19T16:16:32.804114+0000","last_fullsized":"2023-12-19T16:16:32.804114+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:47:00.160083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.874662+0000","last_change":"2023-12-19T16:16:30.867563+0000","last_active":"2023-12-19T16:16:30.874662+0000","last_peered":"2023-12-19T16:16:30.874662+0000","last_clean":"2023-12-19T16:16:30.874662+0000","last_became_active":"2023-12-19T16:16:30.867229+0000","last_became_peered":"2023-12-19T16:16:30.867229+0000","last_unstale":"2023-12-19T16:16:30.874662+0000","last_undegraded":"2023-12-19T16:16:30.874662+0000","last_fullsized":"2023-12-19T16:16:30.874662+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.805002+0000","last_change":"2023-12-19T16:16:30.478887+0000","last_active":"2023-12-19T16:16:32.805002+0000","last_peered":"2023-12-19T16:16:32.805002+0000","last_clean":"2023-12-19T16:16:32.805002+0000","last_became_active":"2023-12-19T16:16:30.478578+0000","last_became_peered":"2023-12-19T16:16:30.478578+0000","last_unstale":"2023-12-19T16:16:32.805002+0000","last_undegraded":"2023-12-19T16:16:32.805002+0000","last_fullsized":"2023-12-19T16:16:32.805002+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:03.304594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610380+0000","last_change":"2023-12-19T16:16:30.873583+0000","last_active":"2023-12-19T16:16:32.610380+0000","last_peered":"2023-12-19T16:16:32.610380+0000","last_clean":"2023-12-19T16:16:32.610380+0000","last_became_active":"2023-12-19T16:16:30.873050+0000","last_became_peered":"2023-12-19T16:16:30.873050+0000","last_unstale":"2023-12-19T16:16:32.610380+0000","last_undegraded":"2023-12-19T16:16:32.610380+0000","last_fullsized":"2023-12-19T16:16:32.610380+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887706+0000","last_change":"2023-12-19T16:16:30.476371+0000","last_active":"2023-12-19T16:16:30.887706+0000","last_peered":"2023-12-19T16:16:30.887706+0000","last_clean":"2023-12-19T16:16:30.887706+0000","last_became_active":"2023-12-19T16:16:30.476140+0000","last_became_peered":"2023-12-19T16:16:30.476140+0000","last_unstale":"2023-12-19T16:16:30.887706+0000","last_undegraded":"2023-12-19T16:16:30.887706+0000","last_fullsized":"2023-12-19T16:16:30.887706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:49.411553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610312+0000","last_change":"2023-12-19T16:16:30.887598+0000","last_active":"2023-12-19T16:16:32.610312+0000","last_peered":"2023-12-19T16:16:32.610312+0000","last_clean":"2023-12-19T16:16:32.610312+0000","last_became_active":"2023-12-19T16:16:30.887333+0000","last_became_peered":"2023-12-19T16:16:30.887333+0000","last_unstale":"2023-12-19T16:16:32.610312+0000","last_undegraded":"2023-12-19T16:16:32.610312+0000","last_fullsized":"2023-12-19T16:16:32.610312+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:35.251963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852435+0000","last_change":"2023-12-19T16:16:30.478270+0000","last_active":"2023-12-19T16:16:31.852435+0000","last_peered":"2023-12-19T16:16:31.852435+0000","last_clean":"2023-12-19T16:16:31.852435+0000","last_became_active":"2023-12-19T16:16:30.477934+0000","last_became_peered":"2023-12-19T16:16:30.477934+0000","last_unstale":"2023-12-19T16:16:31.852435+0000","last_undegraded":"2023-12-19T16:16:31.852435+0000","last_fullsized":"2023-12-19T16:16:31.852435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:07.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891433+0000","last_change":"2023-12-19T16:16:30.880753+0000","last_active":"2023-12-19T16:16:30.891433+0000","last_peered":"2023-12-19T16:16:30.891433+0000","last_clean":"2023-12-19T16:16:30.891433+0000","last_became_active":"2023-12-19T16:16:30.880450+0000","last_became_peered":"2023-12-19T16:16:30.880450+0000","last_unstale":"2023-12-19T16:16:30.891433+0000","last_undegraded":"2023-12-19T16:16:30.891433+0000","last_fullsized":"2023-12-19T16:16:30.891433+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:45.110409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887873+0000","last_change":"2023-12-19T16:16:30.473720+0000","last_active":"2023-12-19T16:16:30.887873+0000","last_peered":"2023-12-19T16:16:30.887873+0000","last_clean":"2023-12-19T16:16:30.887873+0000","last_became_active":"2023-12-19T16:16:30.472635+0000","last_became_peered":"2023-12-19T16:16:30.472635+0000","last_unstale":"2023-12-19T16:16:30.887873+0000","last_undegraded":"2023-12-19T16:16:30.887873+0000","last_fullsized":"2023-12-19T16:16:30.887873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:57.879245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850444+0000","last_change":"2023-12-19T16:16:30.883615+0000","last_active":"2023-12-19T16:16:31.850444+0000","last_peered":"2023-12-19T16:16:31.850444+0000","last_clean":"2023-12-19T16:16:31.850444+0000","last_became_active":"2023-12-19T16:16:30.883327+0000","last_became_peered":"2023-12-19T16:16:30.883327+0000","last_unstale":"2023-12-19T16:16:31.850444+0000","last_undegraded":"2023-12-19T16:16:31.850444+0000","last_fullsized":"2023-12-19T16:16:31.850444+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:44.019482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609999+0000","last_change":"2023-12-19T16:16:30.474720+0000","last_active":"2023-12-19T16:16:32.609999+0000","last_peered":"2023-12-19T16:16:32.609999+0000","last_clean":"2023-12-19T16:16:32.609999+0000","last_became_active":"2023-12-19T16:16:30.473460+0000","last_became_peered":"2023-12-19T16:16:30.473460+0000","last_unstale":"2023-12-19T16:16:32.609999+0000","last_undegraded":"2023-12-19T16:16:32.609999+0000","last_fullsized":"2023-12-19T16:16:32.609999+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:43.011998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610136+0000","last_change":"2023-12-19T16:16:30.870643+0000","last_active":"2023-12-19T16:16:32.610136+0000","last_peered":"2023-12-19T16:16:32.610136+0000","last_clean":"2023-12-19T16:16:32.610136+0000","last_became_active":"2023-12-19T16:16:30.870337+0000","last_became_peered":"2023-12-19T16:16:30.870337+0000","last_unstale":"2023-12-19T16:16:32.610136+0000","last_undegraded":"2023-12-19T16:16:32.610136+0000","last_fullsized":"2023-12-19T16:16:32.610136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:39.870121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.609936+0000","last_change":"2023-12-19T16:16:30.477753+0000","last_active":"2023-12-19T16:16:32.609936+0000","last_peered":"2023-12-19T16:16:32.609936+0000","last_clean":"2023-12-19T16:16:32.609936+0000","last_became_active":"2023-12-19T16:16:30.476563+0000","last_became_peered":"2023-12-19T16:16:30.476563+0000","last_unstale":"2023-12-19T16:16:32.609936+0000","last_undegraded":"2023-12-19T16:16:32.609936+0000","last_fullsized":"2023-12-19T16:16:32.609936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:25.523120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850416+0000","last_change":"2023-12-19T16:16:30.867327+0000","last_active":"2023-12-19T16:16:31.850416+0000","last_peered":"2023-12-19T16:16:31.850416+0000","last_clean":"2023-12-19T16:16:31.850416+0000","last_became_active":"2023-12-19T16:16:30.866498+0000","last_became_peered":"2023-12-19T16:16:30.866498+0000","last_unstale":"2023-12-19T16:16:31.850416+0000","last_undegraded":"2023-12-19T16:16:31.850416+0000","last_fullsized":"2023-12-19T16:16:31.850416+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:28:04.737848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.851931+0000","last_change":"2023-12-19T16:16:30.473155+0000","last_active":"2023-12-19T16:16:31.851931+0000","last_peered":"2023-12-19T16:16:31.851931+0000","last_clean":"2023-12-19T16:16:31.851931+0000","last_became_active":"2023-12-19T16:16:30.472854+0000","last_became_peered":"2023-12-19T16:16:30.472854+0000","last_unstale":"2023-12-19T16:16:31.851931+0000","last_undegraded":"2023-12-19T16:16:31.851931+0000","last_fullsized":"2023-12-19T16:16:31.851931+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:42:24.250833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891508+0000","last_change":"2023-12-19T16:16:30.880622+0000","last_active":"2023-12-19T16:16:30.891508+0000","last_peered":"2023-12-19T16:16:30.891508+0000","last_clean":"2023-12-19T16:16:30.891508+0000","last_became_active":"2023-12-19T16:16:30.880281+0000","last_became_peered":"2023-12-19T16:16:30.880281+0000","last_unstale":"2023-12-19T16:16:30.891508+0000","last_undegraded":"2023-12-19T16:16:30.891508+0000","last_fullsized":"2023-12-19T16:16:30.891508+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:41:17.445126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610226+0000","last_change":"2023-12-19T16:16:30.484145+0000","last_active":"2023-12-19T16:16:32.610226+0000","last_peered":"2023-12-19T16:16:32.610226+0000","last_clean":"2023-12-19T16:16:32.610226+0000","last_became_active":"2023-12-19T16:16:30.483846+0000","last_became_peered":"2023-12-19T16:16:30.483846+0000","last_unstale":"2023-12-19T16:16:32.610226+0000","last_undegraded":"2023-12-19T16:16:32.610226+0000","last_fullsized":"2023-12-19T16:16:32.610226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:32.858098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804913+0000","last_change":"2023-12-19T16:16:30.869526+0000","last_active":"2023-12-19T16:16:32.804913+0000","last_peered":"2023-12-19T16:16:32.804913+0000","last_clean":"2023-12-19T16:16:32.804913+0000","last_became_active":"2023-12-19T16:16:30.869013+0000","last_became_peered":"2023-12-19T16:16:30.869013+0000","last_unstale":"2023-12-19T16:16:32.804913+0000","last_undegraded":"2023-12-19T16:16:32.804913+0000","last_fullsized":"2023-12-19T16:16:32.804913+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:39.605485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848406+0000","last_change":"2023-12-19T16:16:30.478231+0000","last_active":"2023-12-19T16:16:30.848406+0000","last_peered":"2023-12-19T16:16:30.848406+0000","last_clean":"2023-12-19T16:16:30.848406+0000","last_became_active":"2023-12-19T16:16:30.477924+0000","last_became_peered":"2023-12-19T16:16:30.477924+0000","last_unstale":"2023-12-19T16:16:30.848406+0000","last_undegraded":"2023-12-19T16:16:30.848406+0000","last_fullsized":"2023-12-19T16:16:30.848406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:23:27.892556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891628+0000","last_change":"2023-12-19T16:16:30.881789+0000","last_active":"2023-12-19T16:16:30.891628+0000","last_peered":"2023-12-19T16:16:30.891628+0000","last_clean":"2023-12-19T16:16:30.891628+0000","last_became_active":"2023-12-19T16:16:30.881320+0000","last_became_peered":"2023-12-19T16:16:30.881320+0000","last_unstale":"2023-12-19T16:16:30.891628+0000","last_undegraded":"2023-12-19T16:16:30.891628+0000","last_fullsized":"2023-12-19T16:16:30.891628+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:36:11.665210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.847955+0000","last_change":"2023-12-19T16:16:30.477038+0000","last_active":"2023-12-19T16:16:30.847955+0000","last_peered":"2023-12-19T16:16:30.847955+0000","last_clean":"2023-12-19T16:16:30.847955+0000","last_became_active":"2023-12-19T16:16:30.476660+0000","last_became_peered":"2023-12-19T16:16:30.476660+0000","last_unstale":"2023-12-19T16:16:30.847955+0000","last_undegraded":"2023-12-19T16:16:30.847955+0000","last_fullsized":"2023-12-19T16:16:30.847955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:30:53.771655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891775+0000","last_change":"2023-12-19T16:16:30.886210+0000","last_active":"2023-12-19T16:16:30.891775+0000","last_peered":"2023-12-19T16:16:30.891775+0000","last_clean":"2023-12-19T16:16:30.891775+0000","last_became_active":"2023-12-19T16:16:30.881053+0000","last_became_peered":"2023-12-19T16:16:30.881053+0000","last_unstale":"2023-12-19T16:16:30.891775+0000","last_undegraded":"2023-12-19T16:16:30.891775+0000","last_fullsized":"2023-12-19T16:16:30.891775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:02.193785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804639+0000","last_change":"2023-12-19T16:16:30.478768+0000","last_active":"2023-12-19T16:16:32.804639+0000","last_peered":"2023-12-19T16:16:32.804639+0000","last_clean":"2023-12-19T16:16:32.804639+0000","last_became_active":"2023-12-19T16:16:30.478499+0000","last_became_peered":"2023-12-19T16:16:30.478499+0000","last_unstale":"2023-12-19T16:16:32.804639+0000","last_undegraded":"2023-12-19T16:16:32.804639+0000","last_fullsized":"2023-12-19T16:16:32.804639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:25:04.380755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804612+0000","last_change":"2023-12-19T16:16:30.882185+0000","last_active":"2023-12-19T16:16:32.804612+0000","last_peered":"2023-12-19T16:16:32.804612+0000","last_clean":"2023-12-19T16:16:32.804612+0000","last_became_active":"2023-12-19T16:16:30.881925+0000","last_became_peered":"2023-12-19T16:16:30.881925+0000","last_unstale":"2023-12-19T16:16:32.804612+0000","last_undegraded":"2023-12-19T16:16:32.804612+0000","last_fullsized":"2023-12-19T16:16:32.804612+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:34:49.128277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.894063+0000","last_change":"2023-12-19T16:16:30.471116+0000","last_active":"2023-12-19T16:16:30.894063+0000","last_peered":"2023-12-19T16:16:30.894063+0000","last_clean":"2023-12-19T16:16:30.894063+0000","last_became_active":"2023-12-19T16:16:30.470770+0000","last_became_peered":"2023-12-19T16:16:30.470770+0000","last_unstale":"2023-12-19T16:16:30.894063+0000","last_undegraded":"2023-12-19T16:16:30.894063+0000","last_fullsized":"2023-12-19T16:16:30.894063+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:14:28.436022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.868868+0000","last_change":"2023-12-19T16:16:30.862968+0000","last_active":"2023-12-19T16:16:30.868868+0000","last_peered":"2023-12-19T16:16:30.868868+0000","last_clean":"2023-12-19T16:16:30.868868+0000","last_became_active":"2023-12-19T16:16:30.861461+0000","last_became_peered":"2023-12-19T16:16:30.861461+0000","last_unstale":"2023-12-19T16:16:30.868868+0000","last_undegraded":"2023-12-19T16:16:30.868868+0000","last_fullsized":"2023-12-19T16:16:30.868868+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610348+0000","last_change":"2023-12-19T16:16:30.475560+0000","last_active":"2023-12-19T16:16:32.610348+0000","last_peered":"2023-12-19T16:16:32.610348+0000","last_clean":"2023-12-19T16:16:32.610348+0000","last_became_active":"2023-12-19T16:16:30.475303+0000","last_became_peered":"2023-12-19T16:16:30.475303+0000","last_unstale":"2023-12-19T16:16:32.610348+0000","last_undegraded":"2023-12-19T16:16:32.610348+0000","last_fullsized":"2023-12-19T16:16:32.610348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:30:38.111608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891568+0000","last_change":"2023-12-19T16:16:30.882682+0000","last_active":"2023-12-19T16:16:30.891568+0000","last_peered":"2023-12-19T16:16:30.891568+0000","last_clean":"2023-12-19T16:16:30.891568+0000","last_became_active":"2023-12-19T16:16:30.881432+0000","last_became_peered":"2023-12-19T16:16:30.881432+0000","last_unstale":"2023-12-19T16:16:30.891568+0000","last_undegraded":"2023-12-19T16:16:30.891568+0000","last_fullsized":"2023-12-19T16:16:30.891568+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:56.150622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.874261+0000","last_change":"2023-12-19T16:16:30.472220+0000","last_active":"2023-12-19T16:16:30.874261+0000","last_peered":"2023-12-19T16:16:30.874261+0000","last_clean":"2023-12-19T16:16:30.874261+0000","last_became_active":"2023-12-19T16:16:30.471854+0000","last_became_peered":"2023-12-19T16:16:30.471854+0000","last_unstale":"2023-12-19T16:16:30.874261+0000","last_undegraded":"2023-12-19T16:16:30.874261+0000","last_fullsized":"2023-12-19T16:16:30.874261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:06.530179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610227+0000","last_change":"2023-12-19T16:16:30.870977+0000","last_active":"2023-12-19T16:16:32.610227+0000","last_peered":"2023-12-19T16:16:32.610227+0000","last_clean":"2023-12-19T16:16:32.610227+0000","last_became_active":"2023-12-19T16:16:30.870732+0000","last_became_peered":"2023-12-19T16:16:30.870732+0000","last_unstale":"2023-12-19T16:16:32.610227+0000","last_undegraded":"2023-12-19T16:16:32.610227+0000","last_fullsized":"2023-12-19T16:16:32.610227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:29:42.576738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870366+0000","last_change":"2023-12-19T16:16:30.475287+0000","last_active":"2023-12-19T16:16:30.870366+0000","last_peered":"2023-12-19T16:16:30.870366+0000","last_clean":"2023-12-19T16:16:30.870366+0000","last_became_active":"2023-12-19T16:16:30.474998+0000","last_became_peered":"2023-12-19T16:16:30.474998+0000","last_unstale":"2023-12-19T16:16:30.870366+0000","last_undegraded":"2023-12-19T16:16:30.870366+0000","last_fullsized":"2023-12-19T16:16:30.870366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:15.684960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804476+0000","last_change":"2023-12-19T16:16:30.876198+0000","last_active":"2023-12-19T16:16:32.804476+0000","last_peered":"2023-12-19T16:16:32.804476+0000","last_clean":"2023-12-19T16:16:32.804476+0000","last_became_active":"2023-12-19T16:16:30.875464+0000","last_became_peered":"2023-12-19T16:16:30.875464+0000","last_unstale":"2023-12-19T16:16:32.804476+0000","last_undegraded":"2023-12-19T16:16:32.804476+0000","last_fullsized":"2023-12-19T16:16:32.804476+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:39.697830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.851690+0000","last_change":"2023-12-19T16:16:30.473376+0000","last_active":"2023-12-19T16:16:31.851690+0000","last_peered":"2023-12-19T16:16:31.851690+0000","last_clean":"2023-12-19T16:16:31.851690+0000","last_became_active":"2023-12-19T16:16:30.473044+0000","last_became_peered":"2023-12-19T16:16:30.473044+0000","last_unstale":"2023-12-19T16:16:31.851690+0000","last_undegraded":"2023-12-19T16:16:31.851690+0000","last_fullsized":"2023-12-19T16:16:31.851690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:32.858098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804949+0000","last_change":"2023-12-19T16:16:30.884915+0000","last_active":"2023-12-19T16:16:32.804949+0000","last_peered":"2023-12-19T16:16:32.804949+0000","last_clean":"2023-12-19T16:16:32.804949+0000","last_became_active":"2023-12-19T16:16:30.884636+0000","last_became_peered":"2023-12-19T16:16:30.884636+0000","last_unstale":"2023-12-19T16:16:32.804949+0000","last_undegraded":"2023-12-19T16:16:32.804949+0000","last_fullsized":"2023-12-19T16:16:32.804949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:41:30.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852351+0000","last_change":"2023-12-19T16:16:30.474700+0000","last_active":"2023-12-19T16:16:31.852351+0000","last_peered":"2023-12-19T16:16:31.852351+0000","last_clean":"2023-12-19T16:16:31.852351+0000","last_became_active":"2023-12-19T16:16:30.474421+0000","last_became_peered":"2023-12-19T16:16:30.474421+0000","last_unstale":"2023-12-19T16:16:31.852351+0000","last_undegraded":"2023-12-19T16:16:31.852351+0000","last_fullsized":"2023-12-19T16:16:31.852351+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:59:07.653444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850710+0000","last_change":"2023-12-19T16:16:30.867216+0000","last_active":"2023-12-19T16:16:31.850710+0000","last_peered":"2023-12-19T16:16:31.850710+0000","last_clean":"2023-12-19T16:16:31.850710+0000","last_became_active":"2023-12-19T16:16:30.866965+0000","last_became_peered":"2023-12-19T16:16:30.866965+0000","last_unstale":"2023-12-19T16:16:31.850710+0000","last_undegraded":"2023-12-19T16:16:31.850710+0000","last_fullsized":"2023-12-19T16:16:31.850710+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:08.165700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610216+0000","last_change":"2023-12-19T16:16:30.475753+0000","last_active":"2023-12-19T16:16:32.610216+0000","last_peered":"2023-12-19T16:16:32.610216+0000","last_clean":"2023-12-19T16:16:32.610216+0000","last_became_active":"2023-12-19T16:16:30.475516+0000","last_became_peered":"2023-12-19T16:16:30.475516+0000","last_unstale":"2023-12-19T16:16:32.610216+0000","last_undegraded":"2023-12-19T16:16:32.610216+0000","last_fullsized":"2023-12-19T16:16:32.610216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:49.979768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.866909+0000","last_change":"2023-12-19T16:16:30.855343+0000","last_active":"2023-12-19T16:16:30.866909+0000","last_peered":"2023-12-19T16:16:30.866909+0000","last_clean":"2023-12-19T16:16:30.866909+0000","last_became_active":"2023-12-19T16:16:30.855019+0000","last_became_peered":"2023-12-19T16:16:30.855019+0000","last_unstale":"2023-12-19T16:16:30.866909+0000","last_undegraded":"2023-12-19T16:16:30.866909+0000","last_fullsized":"2023-12-19T16:16:30.866909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:27.166985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804744+0000","last_change":"2023-12-19T16:16:30.470950+0000","last_active":"2023-12-19T16:16:32.804744+0000","last_peered":"2023-12-19T16:16:32.804744+0000","last_clean":"2023-12-19T16:16:32.804744+0000","last_became_active":"2023-12-19T16:16:30.470502+0000","last_became_peered":"2023-12-19T16:16:30.470502+0000","last_unstale":"2023-12-19T16:16:32.804744+0000","last_undegraded":"2023-12-19T16:16:32.804744+0000","last_fullsized":"2023-12-19T16:16:32.804744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:34.244480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852420+0000","last_change":"2023-12-19T16:16:30.865568+0000","last_active":"2023-12-19T16:16:31.852420+0000","last_peered":"2023-12-19T16:16:31.852420+0000","last_clean":"2023-12-19T16:16:31.852420+0000","last_became_active":"2023-12-19T16:16:30.865294+0000","last_became_peered":"2023-12-19T16:16:30.865294+0000","last_unstale":"2023-12-19T16:16:31.852420+0000","last_undegraded":"2023-12-19T16:16:31.852420+0000","last_fullsized":"2023-12-19T16:16:31.852420+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:34.372942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804404+0000","last_change":"2023-12-19T16:16:30.471166+0000","last_active":"2023-12-19T16:16:32.804404+0000","last_peered":"2023-12-19T16:16:32.804404+0000","last_clean":"2023-12-19T16:16:32.804404+0000","last_became_active":"2023-12-19T16:16:30.470880+0000","last_became_peered":"2023-12-19T16:16:30.470880+0000","last_unstale":"2023-12-19T16:16:32.804404+0000","last_undegraded":"2023-12-19T16:16:32.804404+0000","last_fullsized":"2023-12-19T16:16:32.804404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:14.258540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.870936+0000","last_change":"2023-12-19T16:16:30.865179+0000","last_active":"2023-12-19T16:16:30.870936+0000","last_peered":"2023-12-19T16:16:30.870936+0000","last_clean":"2023-12-19T16:16:30.870936+0000","last_became_active":"2023-12-19T16:16:30.864892+0000","last_became_peered":"2023-12-19T16:16:30.864892+0000","last_unstale":"2023-12-19T16:16:30.870936+0000","last_undegraded":"2023-12-19T16:16:30.870936+0000","last_fullsized":"2023-12-19T16:16:30.870936+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:32.942570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.888444+0000","last_change":"2023-12-19T16:16:30.478610+0000","last_active":"2023-12-19T16:16:30.888444+0000","last_peered":"2023-12-19T16:16:30.888444+0000","last_clean":"2023-12-19T16:16:30.888444+0000","last_became_active":"2023-12-19T16:16:30.478366+0000","last_became_peered":"2023-12-19T16:16:30.478366+0000","last_unstale":"2023-12-19T16:16:30.888444+0000","last_undegraded":"2023-12-19T16:16:30.888444+0000","last_fullsized":"2023-12-19T16:16:30.888444+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:01:45.755517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.866453+0000","last_change":"2023-12-19T16:16:30.854845+0000","last_active":"2023-12-19T16:16:30.866453+0000","last_peered":"2023-12-19T16:16:30.866453+0000","last_clean":"2023-12-19T16:16:30.866453+0000","last_became_active":"2023-12-19T16:16:30.854537+0000","last_became_peered":"2023-12-19T16:16:30.854537+0000","last_unstale":"2023-12-19T16:16:30.866453+0000","last_undegraded":"2023-12-19T16:16:30.866453+0000","last_fullsized":"2023-12-19T16:16:30.866453+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:59.112683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610067+0000","last_change":"2023-12-19T16:16:30.476561+0000","last_active":"2023-12-19T16:16:32.610067+0000","last_peered":"2023-12-19T16:16:32.610067+0000","last_clean":"2023-12-19T16:16:32.610067+0000","last_became_active":"2023-12-19T16:16:30.476104+0000","last_became_peered":"2023-12-19T16:16:30.476104+0000","last_unstale":"2023-12-19T16:16:32.610067+0000","last_undegraded":"2023-12-19T16:16:32.610067+0000","last_fullsized":"2023-12-19T16:16:32.610067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:07.158216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.880072+0000","last_change":"2023-12-19T16:16:30.876637+0000","last_active":"2023-12-19T16:16:30.880072+0000","last_peered":"2023-12-19T16:16:30.880072+0000","last_clean":"2023-12-19T16:16:30.880072+0000","last_became_active":"2023-12-19T16:16:30.876337+0000","last_became_peered":"2023-12-19T16:16:30.876337+0000","last_unstale":"2023-12-19T16:16:30.880072+0000","last_undegraded":"2023-12-19T16:16:30.880072+0000","last_fullsized":"2023-12-19T16:16:30.880072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:45:39.870121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850415+0000","last_change":"2023-12-19T16:16:30.474170+0000","last_active":"2023-12-19T16:16:31.850415+0000","last_peered":"2023-12-19T16:16:31.850415+0000","last_clean":"2023-12-19T16:16:31.850415+0000","last_became_active":"2023-12-19T16:16:30.473836+0000","last_became_peered":"2023-12-19T16:16:30.473836+0000","last_unstale":"2023-12-19T16:16:31.850415+0000","last_undegraded":"2023-12-19T16:16:31.850415+0000","last_fullsized":"2023-12-19T16:16:31.850415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:17.794989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.850426+0000","last_change":"2023-12-19T16:16:30.864236+0000","last_active":"2023-12-19T16:16:31.850426+0000","last_peered":"2023-12-19T16:16:31.850426+0000","last_clean":"2023-12-19T16:16:31.850426+0000","last_became_active":"2023-12-19T16:16:30.864022+0000","last_became_peered":"2023-12-19T16:16:30.864022+0000","last_unstale":"2023-12-19T16:16:31.850426+0000","last_undegraded":"2023-12-19T16:16:31.850426+0000","last_fullsized":"2023-12-19T16:16:31.850426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:21:26.530603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804161+0000","last_change":"2023-12-19T16:16:30.471152+0000","last_active":"2023-12-19T16:16:32.804161+0000","last_peered":"2023-12-19T16:16:32.804161+0000","last_clean":"2023-12-19T16:16:32.804161+0000","last_became_active":"2023-12-19T16:16:30.470878+0000","last_became_peered":"2023-12-19T16:16:30.470878+0000","last_unstale":"2023-12-19T16:16:32.804161+0000","last_undegraded":"2023-12-19T16:16:32.804161+0000","last_fullsized":"2023-12-19T16:16:32.804161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:26.159501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852360+0000","last_change":"2023-12-19T16:16:30.872448+0000","last_active":"2023-12-19T16:16:31.852360+0000","last_peered":"2023-12-19T16:16:31.852360+0000","last_clean":"2023-12-19T16:16:31.852360+0000","last_became_active":"2023-12-19T16:16:30.872185+0000","last_became_peered":"2023-12-19T16:16:30.872185+0000","last_unstale":"2023-12-19T16:16:31.852360+0000","last_undegraded":"2023-12-19T16:16:31.852360+0000","last_fullsized":"2023-12-19T16:16:31.852360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:14:29.443506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.877644+0000","last_change":"2023-12-19T16:16:30.473746+0000","last_active":"2023-12-19T16:16:30.877644+0000","last_peered":"2023-12-19T16:16:30.877644+0000","last_clean":"2023-12-19T16:16:30.877644+0000","last_became_active":"2023-12-19T16:16:30.473432+0000","last_became_peered":"2023-12-19T16:16:30.473432+0000","last_unstale":"2023-12-19T16:16:30.877644+0000","last_undegraded":"2023-12-19T16:16:30.877644+0000","last_fullsized":"2023-12-19T16:16:30.877644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:38.296564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804993+0000","last_change":"2023-12-19T16:16:30.856154+0000","last_active":"2023-12-19T16:16:32.804993+0000","last_peered":"2023-12-19T16:16:32.804993+0000","last_clean":"2023-12-19T16:16:32.804993+0000","last_became_active":"2023-12-19T16:16:30.855939+0000","last_became_peered":"2023-12-19T16:16:30.855939+0000","last_unstale":"2023-12-19T16:16:32.804993+0000","last_undegraded":"2023-12-19T16:16:32.804993+0000","last_fullsized":"2023-12-19T16:16:32.804993+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:03:02.916442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848052+0000","last_change":"2023-12-19T16:16:30.476903+0000","last_active":"2023-12-19T16:16:30.848052+0000","last_peered":"2023-12-19T16:16:30.848052+0000","last_clean":"2023-12-19T16:16:30.848052+0000","last_became_active":"2023-12-19T16:16:30.476305+0000","last_became_peered":"2023-12-19T16:16:30.476305+0000","last_unstale":"2023-12-19T16:16:30.848052+0000","last_undegraded":"2023-12-19T16:16:30.848052+0000","last_fullsized":"2023-12-19T16:16:30.848052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:00:26.675811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:31.852372+0000","last_change":"2023-12-19T16:16:30.882940+0000","last_active":"2023-12-19T16:16:31.852372+0000","last_peered":"2023-12-19T16:16:31.852372+0000","last_clean":"2023-12-19T16:16:31.852372+0000","last_became_active":"2023-12-19T16:16:30.882581+0000","last_became_peered":"2023-12-19T16:16:30.882581+0000","last_unstale":"2023-12-19T16:16:31.852372+0000","last_undegraded":"2023-12-19T16:16:31.852372+0000","last_fullsized":"2023-12-19T16:16:31.852372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:15.266024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861986+0000","last_change":"2023-12-19T16:16:30.475338+0000","last_active":"2023-12-19T16:16:30.861986+0000","last_peered":"2023-12-19T16:16:30.861986+0000","last_clean":"2023-12-19T16:16:30.861986+0000","last_became_active":"2023-12-19T16:16:30.475035+0000","last_became_peered":"2023-12-19T16:16:30.475035+0000","last_unstale":"2023-12-19T16:16:30.861986+0000","last_undegraded":"2023-12-19T16:16:30.861986+0000","last_fullsized":"2023-12-19T16:16:30.861986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:55.679181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804458+0000","last_change":"2023-12-19T16:16:30.873788+0000","last_active":"2023-12-19T16:16:32.804458+0000","last_peered":"2023-12-19T16:16:32.804458+0000","last_clean":"2023-12-19T16:16:32.804458+0000","last_became_active":"2023-12-19T16:16:30.873506+0000","last_became_peered":"2023-12-19T16:16:30.873506+0000","last_unstale":"2023-12-19T16:16:32.804458+0000","last_undegraded":"2023-12-19T16:16:32.804458+0000","last_fullsized":"2023-12-19T16:16:32.804458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:28.232920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861866+0000","last_change":"2023-12-19T16:16:30.471931+0000","last_active":"2023-12-19T16:16:30.861866+0000","last_peered":"2023-12-19T16:16:30.861866+0000","last_clean":"2023-12-19T16:16:30.861866+0000","last_became_active":"2023-12-19T16:16:30.471639+0000","last_became_peered":"2023-12-19T16:16:30.471639+0000","last_unstale":"2023-12-19T16:16:30.861866+0000","last_undegraded":"2023-12-19T16:16:30.861866+0000","last_fullsized":"2023-12-19T16:16:30.861866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:34:24.754559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.891425+0000","last_change":"2023-12-19T16:16:30.880649+0000","last_active":"2023-12-19T16:16:30.891425+0000","last_peered":"2023-12-19T16:16:30.891425+0000","last_clean":"2023-12-19T16:16:30.891425+0000","last_became_active":"2023-12-19T16:16:30.880341+0000","last_became_peered":"2023-12-19T16:16:30.880341+0000","last_unstale":"2023-12-19T16:16:30.891425+0000","last_undegraded":"2023-12-19T16:16:30.891425+0000","last_fullsized":"2023-12-19T16:16:30.891425+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:01.065995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.861761+0000","last_change":"2023-12-19T16:16:30.472026+0000","last_active":"2023-12-19T16:16:30.861761+0000","last_peered":"2023-12-19T16:16:30.861761+0000","last_clean":"2023-12-19T16:16:30.861761+0000","last_became_active":"2023-12-19T16:16:30.471696+0000","last_became_peered":"2023-12-19T16:16:30.471696+0000","last_unstale":"2023-12-19T16:16:30.861761+0000","last_undegraded":"2023-12-19T16:16:30.861761+0000","last_fullsized":"2023-12-19T16:16:30.861761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:43.011998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.887745+0000","last_change":"2023-12-19T16:16:30.875508+0000","last_active":"2023-12-19T16:16:30.887745+0000","last_peered":"2023-12-19T16:16:30.887745+0000","last_clean":"2023-12-19T16:16:30.887745+0000","last_became_active":"2023-12-19T16:16:30.875076+0000","last_became_peered":"2023-12-19T16:16:30.875076+0000","last_unstale":"2023-12-19T16:16:30.887745+0000","last_undegraded":"2023-12-19T16:16:30.887745+0000","last_fullsized":"2023-12-19T16:16:30.887745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:57:56.993356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.610094+0000","last_change":"2023-12-19T16:16:30.475390+0000","last_active":"2023-12-19T16:16:32.610094+0000","last_peered":"2023-12-19T16:16:32.610094+0000","last_clean":"2023-12-19T16:16:32.610094+0000","last_became_active":"2023-12-19T16:16:30.475117+0000","last_became_peered":"2023-12-19T16:16:30.475117+0000","last_unstale":"2023-12-19T16:16:32.610094+0000","last_undegraded":"2023-12-19T16:16:32.610094+0000","last_fullsized":"2023-12-19T16:16:32.610094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:55:12.589540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804410+0000","last_change":"2023-12-19T16:16:30.854948+0000","last_active":"2023-12-19T16:16:32.804410+0000","last_peered":"2023-12-19T16:16:32.804410+0000","last_clean":"2023-12-19T16:16:32.804410+0000","last_became_active":"2023-12-19T16:16:30.854659+0000","last_became_peered":"2023-12-19T16:16:30.854659+0000","last_unstale":"2023-12-19T16:16:32.804410+0000","last_undegraded":"2023-12-19T16:16:32.804410+0000","last_fullsized":"2023-12-19T16:16:32.804410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:28.861502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.875106+0000","last_change":"2023-12-19T16:16:30.471804+0000","last_active":"2023-12-19T16:16:30.875106+0000","last_peered":"2023-12-19T16:16:30.875106+0000","last_clean":"2023-12-19T16:16:30.875106+0000","last_became_active":"2023-12-19T16:16:30.471064+0000","last_became_peered":"2023-12-19T16:16:30.471064+0000","last_unstale":"2023-12-19T16:16:30.875106+0000","last_undegraded":"2023-12-19T16:16:30.875106+0000","last_fullsized":"2023-12-19T16:16:30.875106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:10:55.600073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804325+0000","last_change":"2023-12-19T16:16:30.862453+0000","last_active":"2023-12-19T16:16:32.804325+0000","last_peered":"2023-12-19T16:16:32.804325+0000","last_clean":"2023-12-19T16:16:32.804325+0000","last_became_active":"2023-12-19T16:16:30.862230+0000","last_became_peered":"2023-12-19T16:16:30.862230+0000","last_unstale":"2023-12-19T16:16:32.804325+0000","last_undegraded":"2023-12-19T16:16:32.804325+0000","last_fullsized":"2023-12-19T16:16:32.804325+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:30.439654+0000","last_clean_scrub_stamp":"2023-12-19T16:16:30.439654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:10.777664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-12-19T16:16:32.804796+0000","last_change":"2023-12-19T16:16:30.470784+0000","last_active":"2023-12-19T16:16:32.804796+0000","last_peered":"2023-12-19T16:16:32.804796+0000","last_clean":"2023-12-19T16:16:32.804796+0000","last_became_active":"2023-12-19T16:16:30.470219+0000","last_became_peered":"2023-12-19T16:16:30.470219+0000","last_unstale":"2023-12-19T16:16:32.804796+0000","last_undegraded":"2023-12-19T16:16:32.804796+0000","last_fullsized":"2023-12-19T16:16:32.804796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:16:29.432170+0000","last_clean_scrub_stamp":"2023-12-19T16:16:29.432170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:59.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-12-19T16:16:30.848540+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:16:30.848540+0000","last_peered":"2023-12-19T16:16:30.848540+0000","last_clean":"2023-12-19T16:16:30.848540+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:16:30.848540+0000","last_undegraded":"2023-12-19T16:16:30.848540+0000","last_fullsized":"2023-12-19T16:16:30.848540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":155189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42399999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51000000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80500000000000005}]}]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":154447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57899999999999996}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.999}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.0209999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476753,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":744851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.38800000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.79500000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.76000000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476752,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":148203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53800000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.83999999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.82399999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.876}]}]},{"osd":7,"up_from":15,"seq":64424509457,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":154435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.69999999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55600000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.629}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":149677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.749},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.67600000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.627},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72699999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":983040,"data_stored":739063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.629}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.60499999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.56799999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.432},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73599999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.69899999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":149699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.70899999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.68000000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.81599999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:16:35.292 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:16:35.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T16:16:35.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 Processor -- start 2023-12-19T16:16:35.480 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 -- start start 2023-12-19T16:16:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 0x7f530c15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f530c0b4060 0x7f530c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c06c7f0 con 0x7f530c071160 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c070920 con 0x7f530c0b4060 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f5311dbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c070c00 con 0x7f530c15c8e0 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f530c0b4060 0x7f530c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f530c071160 0x7f530c06c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53202/0 (socket says 172.21.15.73:53202) 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f530c0b4060 0x7f530c160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33824/0 (socket says 172.21.15.73:33824) 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530affd640 1 -- 172.21.15.73:0/3649037014 learned_addr learned my addr 172.21.15.73:0/3649037014 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530b7fe640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 0x7f530c15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 -- 172.21.15.73:0/3649037014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 msgr2=0x7f530c15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 0x7f530c15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 -- 172.21.15.73:0/3649037014 >> v1:172.21.15.73:6789/0 conn(0x7f530c071160 legacy=0x7f530c06c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530a7fc640 1 -- 172.21.15.73:0/3649037014 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127680508 0 0) 0x7f530c06c7f0 con 0x7f530c071160 2023-12-19T16:16:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530bfff640 1 -- 172.21.15.73:0/3649037014 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c070ee0 con 0x7f530c0b4060 2023-12-19T16:16:35.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.475+0000 7f530b7fe640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 0x7f530c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f530bfff640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c0b4060 0x7f530c160c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f530401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4740ca6b4050939d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f530a7fc640 1 -- 172.21.15.73:0/3649037014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040a58b0 con 0x7f530c0b4060 2023-12-19T16:16:35.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f530a7fc640 1 -- 172.21.15.73:0/3649037014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040a5a10 con 0x7f530c0b4060 2023-12-19T16:16:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f530a7fc640 1 -- 172.21.15.73:0/3649037014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040a5da0 con 0x7f530c0b4060 2023-12-19T16:16:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 -- 172.21.15.73:0/3649037014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c0b4060 msgr2=0x7f530c160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c0b4060 0x7f530c160c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f530401c860 comp rx=0 tx=0).stop 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 -- 172.21.15.73:0/3649037014 shutdown_connections 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c0b4060 0x7f530c160c70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 --2- 172.21.15.73:0/3649037014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c15c8e0 0x7f530c15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 -- 172.21.15.73:0/3649037014 >> 172.21.15.73:0/3649037014 conn(0x7f530c0b0490 msgr2=0x7f530c0b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 -- 172.21.15.73:0/3649037014 shutdown_connections 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 -- 172.21.15.73:0/3649037014 wait complete. 2023-12-19T16:16:35.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.479+0000 7f5311dbc640 1 Processor -- start 2023-12-19T16:16:35.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- start start 2023-12-19T16:16:35.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 0x7f530c158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 0x7f530c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c15f2a0 con 0x7f530c15c8e0 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1594d0 con 0x7f530c071160 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c23e0 con 0x7f530c0b4060 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33838/0 (socket says 172.21.15.73:33838) 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 -- 172.21.15.73:0/4083210727 learned_addr learned my addr 172.21.15.73:0/4083210727 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530affd640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 0x7f530c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530b7fe640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 0x7f530c158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 -- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 msgr2=0x7f530c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 0x7f530c0ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 -- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 msgr2=0x7f530c158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 0x7f530c158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 -- 172.21.15.73:0/4083210727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304009a70 con 0x7f530c15c8e0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530affd640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 0x7f530c0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530b7fe640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 0x7f530c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f530bfff640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f5304019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040b9860 con 0x7f530c15c8e0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040b99c0 con 0x7f530c15c8e0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c0c26c0 con 0x7f530c15c8e0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53040b9d70 con 0x7f530c15c8e0 2023-12-19T16:16:35.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c0c2c80 con 0x7f530c15c8e0 2023-12-19T16:16:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.483+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c0738a0 con 0x7f530c15c8e0 2023-12-19T16:16:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.487+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53040ad440 con 0x7f530c15c8e0 2023-12-19T16:16:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.487+0000 7f52f3fff640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 0x7f52f8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.487+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f530411e760 con 0x7f530c15c8e0 2023-12-19T16:16:35.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.487+0000 7f530b7fe640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 0x7f52f8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.487+0000 7f530b7fe640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 0x7f52f8067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52fc008930 tx=0x7f52fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.491+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53040ec080 con 0x7f530c15c8e0 2023-12-19T16:16:35.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.695+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f530c06e9a0 con 0x7f530c15c8e0 2023-12-19T16:16:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f52f3fff640 1 -- 172.21.15.73:0/4083210727 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f53040ef6a0 con 0x7f530c15c8e0 2023-12-19T16:16:35.705 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 msgr2=0x7f52f8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 0x7f52f8067f20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52fc008930 tx=0x7f52fc008040 comp rx=0 tx=0).stop 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 msgr2=0x7f530c0cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5304009d90 tx=0x7f5304019660 comp rx=0 tx=0).stop 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 shutdown_connections 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f52f8065a60 0x7f52f8067f20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f530c15c8e0 0x7f530c0cec30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f530c0b4060 0x7f530c0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 --2- 172.21.15.73:0/4083210727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f530c071160 0x7f530c158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.699+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 >> 172.21.15.73:0/4083210727 conn(0x7f530c0b0490 msgr2=0x7f530c073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.703+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 shutdown_connections 2023-12-19T16:16:35.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.703+0000 7f5311dbc640 1 -- 172.21.15.73:0/4083210727 wait complete. 2023-12-19T16:16:35.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:35.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 Processor -- start 2023-12-19T16:16:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 -- start start 2023-12-19T16:16:35.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdccc0d1cb0 0x7fdccc15c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0b7250 con 0x7fdccc0b47f0 2023-12-19T16:16:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0b7530 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd248c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b7810 con 0x7fdccc0b4bd0 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd0a29640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccb7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdccc0d1cb0 0x7fdccc15c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd0a29640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:36236/0 (socket says 172.21.15.73:36236) 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd0a29640 1 -- 172.21.15.73:0/3233052552 learned_addr learned my addr 172.21.15.73:0/3233052552 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccbfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fdccc0b47f0 0x7fdccc0b8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:32858/0 (socket says 172.21.15.73:32858) 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccaffd640 1 -- 172.21.15.73:0/3233052552 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768982002 0 0) 0x7fdccc0b7250 con 0x7fdccc0b47f0 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccaffd640 1 -- 172.21.15.73:0/3233052552 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb4003530 con 0x7fdccc0b47f0 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccb7fe640 1 -- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 msgr2=0x7fdccc15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccb7fe640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccb7fe640 1 -- 172.21.15.73:0/3233052552 >> v1:172.21.15.162:6789/0 conn(0x7fdccc0b47f0 legacy=0x7fdccc0b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdccb7fe640 1 -- 172.21.15.73:0/3233052552 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0b7af0 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.859+0000 7fdcd0a29640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:35.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdccb7fe640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15c8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097c0 tx=0x7fdcc001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=add6228cd396e343 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdccaffd640 1 -- 172.21.15.73:0/3233052552 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00a6040 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdccaffd640 1 -- 172.21.15.73:0/3233052552 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00aa600 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdccaffd640 1 -- 172.21.15.73:0/3233052552 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00aa970 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 -- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0d1cb0 msgr2=0x7fdccc15c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15c8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdcc00097c0 tx=0x7fdcc001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 -- 172.21.15.73:0/3233052552 shutdown_connections 2023-12-19T16:16:35.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b4bd0 0x7fdccc15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 --2- 172.21.15.73:0/3233052552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15c8e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 -- 172.21.15.73:0/3233052552 >> 172.21.15.73:0/3233052552 conn(0x7fdccc065ce0 msgr2=0x7fdccc0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 -- 172.21.15.73:0/3233052552 shutdown_connections 2023-12-19T16:16:35.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.863+0000 7fdcd248c640 1 -- 172.21.15.73:0/3233052552 wait complete. 2023-12-19T16:16:35.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 Processor -- start 2023-12-19T16:16:35.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- start start 2023-12-19T16:16:35.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b47f0 0x7fdccc155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 0x7fdccc0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc14fdf0 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc1558d0 con 0x7fdccc0b4bd0 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc15d480 con 0x7fdccc0b47f0 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33840/0 (socket says 172.21.15.73:33840) 2023-12-19T16:16:35.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 -- 172.21.15.73:0/1626484990 learned_addr learned my addr 172.21.15.73:0/1626484990 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdccbfff640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b47f0 0x7fdccc155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdccb7fe640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 0x7fdccc0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 -- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b47f0 msgr2=0x7fdccc155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b47f0 0x7fdccc155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 -- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 msgr2=0x7fdccc0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:35.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 0x7fdccc0c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 -- 172.21.15.73:0/1626484990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4009b30 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdccb7fe640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 0x7fdccc0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd0a29640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400efc0 tx=0x7fdcc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4018070 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400f040 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc0009420 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400ce00 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.867+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc15d6d0 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc074050 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdcc4014480 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdcc8ff9640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 0x7fdcb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:35.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc40834e0 con 0x7fdccc0d1cb0 2023-12-19T16:16:35.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdccbfff640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 0x7fdcb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:35.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.871+0000 7fdccbfff640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 0x7fdcb8067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007fd0 tx=0x7fdcbc007b20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:35.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:35.875+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdcc4050e90 con 0x7fdccc0d1cb0 2023-12-19T16:16:36.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.055+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdccc1556b0 con 0x7fdccc0d1cb0 2023-12-19T16:16:36.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.055+0000 7fdcc8ff9640 1 -- 172.21.15.73:0/1626484990 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fdcc40544b0 con 0x7fdccc0d1cb0 2023-12-19T16:16:36.065 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:36.065 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4992,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/573250328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6833","nonce":573250328},{"type":"v1","addr":"172.21.15.162:6835","nonce":573250328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/145189161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":145189161},{"type":"v1","addr":"172.21.15.73:6835","nonce":145189161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4998,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1808628358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":1808628358},{"type":"v1","addr":"172.21.15.73:6837","nonce":1808628358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:33.854063+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5035},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5035":{"gid":5035,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6834/1495159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1495159950},{"type":"v1","addr":"172.21.15.162:6834","nonce":1495159950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 16 2023-12-19T16:16:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 msgr2=0x7fdcb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 0x7fdcb8067f20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007fd0 tx=0x7fdcbc007b20 comp rx=0 tx=0).stop 2023-12-19T16:16:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 msgr2=0x7fdccc15fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400efc0 tx=0x7fdcc400c490 comp rx=0 tx=0).stop 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 shutdown_connections 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdcb8065a60 0x7fdcb8067f20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdccc0d1cb0 0x7fdccc15fd60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdccc0b4bd0 0x7fdccc0c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 --2- 172.21.15.73:0/1626484990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdccc0b47f0 0x7fdccc155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 >> 172.21.15.73:0/1626484990 conn(0x7fdccc065ce0 msgr2=0x7fdccc0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 shutdown_connections 2023-12-19T16:16:36.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.059+0000 7fdcd248c640 1 -- 172.21.15.73:0/1626484990 wait complete. 2023-12-19T16:16:36.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:30.837561+0000', 'modified': '2023-12-19T16:16:33.854063+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5035}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5035': {'gid': 5035, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6834/1495159950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1495159950}, {'type': 'v1', 'addr': '172.21.15.162:6834', 'nonce': 1495159950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:36.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:16:36.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T16:16:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.619+0000 7f3be4e66640 1 Processor -- start 2023-12-19T16:16:36.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.619+0000 7f3be4e66640 1 -- start start 2023-12-19T16:16:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3be4e66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3be015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3be4e66640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be015ad00 con 0x7f3be0159830 2023-12-19T16:16:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3be4e66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00ce2d0 con 0x7f3be00b40b0 2023-12-19T16:16:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3be4e66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be015e110 con 0x7f3be00cdc40 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bde59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3be0159830 0x7f3be00cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53206/0 (socket says 172.21.15.73:53206) 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bde59c640 1 -- 172.21.15.73:0/4032961178 learned_addr learned my addr 172.21.15.73:0/4032961178 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3be015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674151869 0 0) 0x7f3be015ad00 con 0x7f3be0159830 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bcc003530 con 0x7f3be0159830 2023-12-19T16:16:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735599013 0 0) 0x7f3bcc003530 con 0x7f3be0159830 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 msgr2=0x7f3be015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3be015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 >> v1:172.21.15.162:6789/0 conn(0x7f3be00b40b0 legacy=0x7f3be00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be015d490 con 0x7f3be0159830 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f3bd0001680 con 0x7f3be0159830 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 >> v1:172.21.15.73:6789/0 conn(0x7f3be0159830 legacy=0x7f3be00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3bcc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bcc003fe0 0x7f3bcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc004d10 0x7f3bcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be015e110 con 0x7f3bcc003fe0 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc00dde0 con 0x7f3bcc004d10 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc00dfa0 con 0x7f3be00cdc40 2023-12-19T16:16:36.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bcc003fe0 0x7f3bcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bde59c640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3bcc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bded9d640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc004d10 0x7f3bcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 msgr2=0x7f3bcc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00cdc40 0x7f3bcc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc004d10 msgr2=0x7f3bcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc004d10 0x7f3bcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4032961178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc003530 con 0x7f3bcc003fe0 2023-12-19T16:16:36.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.623+0000 7f3bded9d640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc004d10 0x7f3bcc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:36.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bcc003fe0 0x7f3bcc0047d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007360 tx=0x7f3bc801cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb9177fa48b935 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80a5cf0 con 0x7f3bcc003fe0 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80a5e50 con 0x7f3bcc003fe0 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3bddd9b640 1 -- 172.21.15.73:0/4032961178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80ad660 con 0x7f3bcc003fe0 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- 172.21.15.73:0/4032961178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bcc003fe0 msgr2=0x7f3bcc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4032961178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bcc003fe0 0x7f3bcc0047d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007360 tx=0x7f3bc801cdf0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3bded9d640 1 -- 172.21.15.73:0/4032961178 reap_dead start 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- 172.21.15.73:0/4032961178 shutdown_connections 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- 172.21.15.73:0/4032961178 >> 172.21.15.73:0/4032961178 conn(0x7f3be00b0270 msgr2=0x7f3be00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- 172.21.15.73:0/4032961178 shutdown_connections 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- 172.21.15.73:0/4032961178 wait complete. 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 Processor -- start 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.627+0000 7f3be4e66640 1 -- start start 2023-12-19T16:16:36.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc003fe0 0x7f3be0149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 0x7f3be00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00ad2f0 con 0x7f3be00ac930 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0158950 con 0x7f3bcc003fe0 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00c5060 con 0x7f3be00c4310 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33850/0 (socket says 172.21.15.73:33850) 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4275837958 learned_addr learned my addr 172.21.15.73:0/4275837958 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bde59c640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc003fe0 0x7f3be0149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bded9d640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 0x7f3be00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 msgr2=0x7f3be00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 0x7f3be00c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc003fe0 msgr2=0x7f3be0149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc003fe0 0x7f3be0149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 -- 172.21.15.73:0/4275837958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be00b12a0 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bded9d640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 0x7f3be00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801c860 tx=0x7f3bcc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd77fe640 1 -- 172.21.15.73:0/4275837958 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80be070 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd77fe640 1 -- 172.21.15.73:0/4275837958 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc80a5af0 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be00b1580 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3bd77fe640 1 -- 172.21.15.73:0/4275837958 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80adc60 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.631+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be00b1b40 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bd77fe640 1 -- 172.21.15.73:0/4275837958 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3bc80b4040 con 0x7f3be00ac930 2023-12-19T16:16:36.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bd77fe640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 0x7f3bc0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bd77fe640 1 -- 172.21.15.73:0/4275837958 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bc811ccd0 con 0x7f3be00ac930 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bde59c640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 0x7f3bc0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bde59c640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 0x7f3bc0067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0001210 tx=0x7f3bd0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 Processor -- start 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 -- start start 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad17450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17990 0x563f5acccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5aaf0c90 con 0x563f5accd1c0 2023-12-19T16:16:36.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab22220 con 0x563f5ad17070 2023-12-19T16:16:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab1f7f0 con 0x563f5ad17990 2023-12-19T16:16:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33860/0 (socket says 172.21.15.73:33860) 2023-12-19T16:16:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 -- 172.21.15.73:0/2820823480 learned_addr learned my addr 172.21.15.73:0/2820823480 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bde59c640 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad17450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17990 0x563f5acccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 -- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17990 msgr2=0x563f5acccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17990 0x563f5acccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 -- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 msgr2=0x563f5ad17450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad17450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 -- 172.21.15.73:0/2820823480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f5a817890 con 0x563f5accd1c0 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.635+0000 7f3bded9d640 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3be006c060 tx=0x7f3bd8001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d1c4e488659592 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bbffff640 1 -- 172.21.15.73:0/2820823480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8005320 con 0x563f5accd1c0 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bbffff640 1 -- 172.21.15.73:0/2820823480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800d070 con 0x563f5accd1c0 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bbffff640 1 -- 172.21.15.73:0/2820823480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8003820 con 0x563f5accd1c0 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- 172.21.15.73:0/2820823480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 msgr2=0x563f5accd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3be006c060 tx=0x7f3bd8001870 comp rx=0 tx=0).stop 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- 172.21.15.73:0/2820823480 shutdown_connections 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5accd5a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17990 0x563f5acccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2820823480 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad17450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- 172.21.15.73:0/2820823480 >> 172.21.15.73:0/2820823480 conn(0x563f5acd3950 msgr2=0x563f5accb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- 172.21.15.73:0/2820823480 shutdown_connections 2023-12-19T16:16:36.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- 172.21.15.73:0/2820823480 wait complete. 2023-12-19T16:16:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- start start 2023-12-19T16:16:36.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 Processor -- start 2023-12-19T16:16:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5acd9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17990 0x563f5acd95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab1b0e0 con 0x563f5accd1c0 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5aaba310 con 0x563f5ad17990 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f5aad8770 con 0x563f5ad17070 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3be81d1000 10 client.0 _ll_register_callbacks cb 0x563f5acb8b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33864/0 (socket says 172.21.15.73:33864) 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 -- 172.21.15.73:0/2294972106 learned_addr learned my addr 172.21.15.73:0/2294972106 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bded9d640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17990 0x563f5acd95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5acd9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 -- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 msgr2=0x563f5acd9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5acd9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 -- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17990 msgr2=0x563f5acd95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17990 0x563f5acd95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.639+0000 7f3bde59c640 1 -- 172.21.15.73:0/2294972106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be00ce2d0 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bde59c640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00159e0 tx=0x7f3be00ce460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a6549de16258fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0014ae0 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd001a040 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f5aaeac10 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bd0014c40 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 10 client.5166 fetch_fsmap learned FSMap version 16 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563f5aae0260 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f5aaeac10 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3bd0022400 con 0x563f5accd1c0 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 10 client.5166 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 10 client.5166 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 20 client.5166 populate_metadata read hostname 'smithi073' 2023-12-19T16:16:36.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad1e8d0 0x563f5ad1ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 4 client.5166 mds_command: new command op to 5035 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 --> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f5ab19a30 con 0x563f5ad1e8d0 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad1e8d0 0x563f5ad1ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 10 client.5166 ms_handle_connect on v2:172.21.15.162:6832/1495159950 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad1e8d0 0x563f5ad1ecb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2059f1476077b801 server_cookie=b4fc0417c6f43dc6 in_seq=0 out_seq=0 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/2294972106 <== mds.0 v2:172.21.15.162:6832/1495159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563f5ab19a30 con 0x563f5ad1e8d0 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 10 client.5166 handle_command_reply: tid=0 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 client.5166 shutdown 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 msgr2=0x563f5acd2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00159e0 tx=0x7f3be00ce460 comp rx=0 tx=0).stop 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 shutdown_connections 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17990 0x563f5acd95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5acd9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad1e8d0 0x563f5ad1ecb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 --2- 172.21.15.73:0/2294972106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5acd2780 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 >> 172.21.15.73:0/2294972106 conn(0x563f5acd3950 msgr2=0x563f5accbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3bbd7fa640 0 client.5166 ms_handle_reset on v2:172.21.15.162:6832/1495159950 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 shutdown_connections 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 1 -- 172.21.15.73:0/2294972106 wait complete. 2023-12-19T16:16:36.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.643+0000 7f3be81d1000 20 client.5166 trim_cache size 0 max 16384 2023-12-19T16:16:36.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 Processor -- start 2023-12-19T16:16:36.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 -- start start 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 0x563f5ad6f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5ad6f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5a7d8940 con 0x563f5acd3950 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab101f0 con 0x563f5accd1c0 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab1dc40 con 0x563f5ad17070 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33874/0 (socket says 172.21.15.73:33874) 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 -- 172.21.15.73:0/3554095243 learned_addr learned my addr 172.21.15.73:0/3554095243 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 0x563f5ad6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bded9d640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5ad6f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 -- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 msgr2=0x563f5ad6f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5ad6f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 -- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 msgr2=0x563f5ad6f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 0x563f5ad6f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bde59c640 1 -- 172.21.15.73:0/3554095243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f5aac63b0 con 0x563f5acd3950 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 0x563f5ad6f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.659+0000 7f3bded9d640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5ad6f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007430 tx=0x7f3bd001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f256e3cf03b4918d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bd4d99640 1 -- 172.21.15.73:0/3554095243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0022960 con 0x563f5acd3950 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bd4d99640 1 -- 172.21.15.73:0/3554095243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd0022400 con 0x563f5acd3950 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bd4d99640 1 -- 172.21.15.73:0/3554095243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0022da0 con 0x563f5acd3950 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- 172.21.15.73:0/3554095243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 msgr2=0x563f5ad6eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007430 tx=0x7f3bd001d000 comp rx=0 tx=0).stop 2023-12-19T16:16:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- 172.21.15.73:0/3554095243 shutdown_connections 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5ad17070 0x563f5ad6f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5accd1c0 0x563f5ad6f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- 172.21.15.73:0/3554095243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5acd3950 0x563f5ad6eed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- 172.21.15.73:0/3554095243 >> 172.21.15.73:0/3554095243 conn(0x563f5acd2d90 msgr2=0x563f5acd8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- 172.21.15.73:0/3554095243 shutdown_connections 2023-12-19T16:16:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- 172.21.15.73:0/3554095243 wait complete. 2023-12-19T16:16:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- start start 2023-12-19T16:16:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 Processor -- start 2023-12-19T16:16:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5acd3950 0x563f5ad74a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad57d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5abebb30 con 0x563f5accd1c0 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f5acc49d0 con 0x563f5ad17070 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f5ab234b0 con 0x563f5acd3950 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3be81d1000 10 client.0 _ll_register_callbacks cb 0x563f5aac9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33890/0 (socket says 172.21.15.73:33890) 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 -- 172.21.15.73:0/542030555 learned_addr learned my addr 172.21.15.73:0/542030555 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5acd3950 0x563f5ad74a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bded9d640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad57d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 -- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5acd3950 msgr2=0x563f5ad74a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5acd3950 0x563f5ad74a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 -- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 msgr2=0x563f5ad57d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad57d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 -- 172.21.15.73:0/542030555 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f5aae0260 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bde59c640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007430 tx=0x7f3bd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d308c5027fbc25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.663+0000 7f3bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0022570 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bd001a040 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f5accfe30 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bd0014ae0 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 10 client.5172 fetch_fsmap learned FSMap version 16 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563f5a817cc0 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f5accfe30 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3bd003d040 con 0x563f5accd1c0 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 10 client.5172 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 10 client.5172 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 20 client.5172 populate_metadata read hostname 'smithi073' 2023-12-19T16:16:36.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad17990 0x563f5ad582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 4 client.5172 mds_command: new command op to 5035 tid=0[{"prefix": "status"}] 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 --> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f5aae0e00 con 0x563f5ad17990 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad17990 0x563f5ad582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bd5d9b640 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad17990 0x563f5ad582a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c8138877d496536 server_cookie=35270383d41449fa in_seq=0 out_seq=0 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 10 client.5172 ms_handle_connect on v2:172.21.15.162:6832/1495159950 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 1 -- 172.21.15.73:0/542030555 <== mds.0 v2:172.21.15.162:6832/1495159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x563f5aae0e00 con 0x563f5ad17990 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 10 client.5172 handle_command_reply: tid=0 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 client.5172 shutdown 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 msgr2=0x563f5ad74520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0007430 tx=0x7f3bd0017000 comp rx=0 tx=0).stop 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 shutdown_connections 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f5ad17070 0x563f5ad57d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x563f5acd3950 0x563f5ad74a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.162:6832/1495159950,v1:172.21.15.162:6834/1495159950] conn(0x563f5ad17990 0x563f5ad582a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 --2- 172.21.15.73:0/542030555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563f5accd1c0 0x563f5ad74520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3bbd7fa640 0 client.5172 ms_handle_reset on v2:172.21.15.162:6832/1495159950 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 >> 172.21.15.73:0/542030555 conn(0x563f5acd2d90 msgr2=0x563f5ad14000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 shutdown_connections 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 1 -- 172.21.15.73:0/542030555 wait complete. 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be81d1000 20 client.5172 trim_cache size 0 max 16384 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "90ec874a-c348-4a69-99d9-d4bef3b9261d", 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5035, 2023-12-19T16:16:36.678 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 5.8296610429999998, 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 16, 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 36, 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 36, 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 13.078625062 2023-12-19T16:16:36.679 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 msgr2=0x7f3bc0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 0x7f3bc0067f20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0001210 tx=0x7f3bd0009040 comp rx=0 tx=0).stop 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 msgr2=0x7f3be00acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3bc801c860 tx=0x7f3bcc005800 comp rx=0 tx=0).stop 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 shutdown_connections 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3be00c4310 0x7f3be00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3bc0065a60 0x7f3bc0067f20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3be00ac930 0x7f3be00acdb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 --2- 172.21.15.73:0/4275837958 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bcc003fe0 0x7f3be0149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 >> 172.21.15.73:0/4275837958 conn(0x7f3be00b0270 msgr2=0x7f3be00c9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 shutdown_connections 2023-12-19T16:16:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.667+0000 7f3be4e66640 1 -- 172.21.15.73:0/4275837958 wait complete. 2023-12-19T16:16:36.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:16:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.823+0000 7f5b7cbdb640 1 Processor -- start 2023-12-19T16:16:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.823+0000 7f5b7cbdb640 1 -- start start 2023-12-19T16:16:36.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7cbdb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b78159830 0x7f5b7815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7cbdb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b780b40b0 0x7f5b780cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7cbdb640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7815ad00 con 0x7f5b780cda70 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7cbdb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7815e110 con 0x7f5b780b40b0 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7cbdb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780cdf00 con 0x7f5b78159830 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b780b40b0 0x7f5b780cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b7659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b78159830 0x7f5b7815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b780b40b0 0x7f5b780cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:45376/0 (socket says 172.21.15.73:45376) 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 -- 172.21.15.73:0/1064107984 learned_addr learned my addr 172.21.15.73:0/1064107984 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b76d9d640 1 --1- 172.21.15.73:0/1064107984 >> v1:172.21.15.162:6789/0 conn(0x7f5b780cda70 0x7f5b780cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:32862/0 (socket says 172.21.15.73:32862) 2023-12-19T16:16:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 -- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b78159830 msgr2=0x7f5b7815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 --2- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b78159830 0x7f5b7815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 -- 172.21.15.73:0/1064107984 >> v1:172.21.15.162:6789/0 conn(0x7f5b780cda70 legacy=0x7f5b780cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.827+0000 7f5b75d9b640 1 -- 172.21.15.73:0/1064107984 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780ce2d0 con 0x7f5b780b40b0 2023-12-19T16:16:36.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b75d9b640 1 --2- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b780b40b0 0x7f5b780cd530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009870 tx=0x7f5b6c01e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3740233bcad0ae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7559a640 1 -- 172.21.15.73:0/1064107984 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a8660 con 0x7f5b780b40b0 2023-12-19T16:16:36.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7559a640 1 -- 172.21.15.73:0/1064107984 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a87c0 con 0x7f5b780b40b0 2023-12-19T16:16:36.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7559a640 1 -- 172.21.15.73:0/1064107984 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a8b50 con 0x7f5b780b40b0 2023-12-19T16:16:36.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b780b40b0 msgr2=0x7f5b780cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b780b40b0 0x7f5b780cd530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009870 tx=0x7f5b6c01e690 comp rx=0 tx=0).stop 2023-12-19T16:16:36.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/1064107984 shutdown_connections 2023-12-19T16:16:36.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b780b40b0 0x7f5b780cd530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/1064107984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b78159830 0x7f5b7815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/1064107984 >> 172.21.15.73:0/1064107984 conn(0x7f5b780b0270 msgr2=0x7f5b780b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:36.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/1064107984 shutdown_connections 2023-12-19T16:16:36.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/1064107984 wait complete. 2023-12-19T16:16:36.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.831+0000 7f5b7cbdb640 1 Processor -- start 2023-12-19T16:16:36.839 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- start start 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b780b40b0 0x7f5b78150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 0x7f5b780c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c4910 con 0x7f5b780cda70 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c3b20 con 0x7f5b78159830 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780c27b0 con 0x7f5b780b40b0 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33900/0 (socket says 172.21.15.73:33900) 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7659c640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b780b40b0 0x7f5b78150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 -- 172.21.15.73:0/3316947496 learned_addr learned my addr 172.21.15.73:0/3316947496 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:36.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b76d9d640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 0x7f5b780c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 -- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b780b40b0 msgr2=0x7f5b78150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b780b40b0 0x7f5b78150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 -- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 msgr2=0x7f5b780c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 0x7f5b780c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 -- 172.21.15.73:0/3316947496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094d0 con 0x7f5b780cda70 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b76d9d640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 0x7f5b780c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:36.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b75d9b640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01cd40 tx=0x7f5b6c01b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b9070 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0b3450 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b37c0 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b780c2a80 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780c3040 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.835+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78074050 con 0x7f5b780cda70 2023-12-19T16:16:36.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.839+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b6c0b3920 con 0x7f5b780cda70 2023-12-19T16:16:36.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.839+0000 7f5b66ffd640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 0x7f5b58067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:36.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.839+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b6c11ce90 con 0x7f5b780cda70 2023-12-19T16:16:36.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.839+0000 7f5b7659c640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 0x7f5b58067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:36.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.839+0000 7f5b7659c640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 0x7f5b58067f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009b60 tx=0x7f5b68009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:36.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:36.843+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b6c0ea7c0 con 0x7f5b780cda70 2023-12-19T16:16:37.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5b780cbfc0 con 0x7f5b780cda70 2023-12-19T16:16:37.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b66ffd640 1 -- 172.21.15.73:0/3316947496 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5b6c0ae060 con 0x7f5b780cda70 2023-12-19T16:16:37.030 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:16:37.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 msgr2=0x7f5b58067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 0x7f5b58067f50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009b60 tx=0x7f5b68009190 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 msgr2=0x7f5b78150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.023+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c01cd40 tx=0x7f5b6c01b430 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 shutdown_connections 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b78159830 0x7f5b780c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b58065a90 0x7f5b58067f50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b780cda70 0x7f5b78150570 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 --2- 172.21.15.73:0/3316947496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b780b40b0 0x7f5b78150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 >> 172.21.15.73:0/3316947496 conn(0x7f5b780b0270 msgr2=0x7f5b780ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 shutdown_connections 2023-12-19T16:16:37.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:37.027+0000 7f5b7cbdb640 1 -- 172.21.15.73:0/3316947496 wait complete. 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:16:37.050 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:37.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.051 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.061 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:c8:3e:2d:c3 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:16:37.062 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:16:37.063 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:16:37.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.064 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:16:37.125 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T16:16:37.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.127 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:16:37.182 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:16:37.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:16:37.183 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:16:37.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.277 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:16:37.287 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:16:37.287 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:16:37.287 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:37.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-19T16:16:37.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:37.352 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:37.407 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:16:37.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:16:37.408 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:37.458 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:16:37.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:16:37.554 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:16:37.554 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:16:37.554 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:16:37.569 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:16:37.570 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:16:37.570 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:16:37.570 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:16:37.570 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:16:37.579 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:16:37.580 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:16:37.580 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:16:37.582 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:16:37.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:16:37.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:37.604 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:16:37.671 INFO:teuthology.orchestra.run.smithi073.stdout:client5203 2023-12-19T16:16:37.671 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:37.671 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:37.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:16:37.774 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:16:37.814 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.815 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T16:16:37.816 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T16:16:37.817 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:16:37.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:16:37.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T16:16:37.820 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:16:37.821 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T16:16:37.822 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:16:37.823 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T16:16:37.824 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:16:37.825 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi073.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.826 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.827 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.828 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.829 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.830 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2023-12-19T16:16:37.831 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:16:37.832 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-12-19T16:16:37.833 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:16:37.834 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-12-19T16:16:37.835 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:16:37.836 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:16:37.837 INFO:teuthology.orchestra.run.smithi162.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2023-12-19T16:16:37.839 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:16:37.839 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:16:37.840 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:16:37.840 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:37.840 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:16:37.840 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:16:37.840 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:16:37.840 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:37.840 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:16:37.841 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:16:37.841 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:16:37.841 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:37.841 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:16:37.841 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:16:37.841 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:16:37.841 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:16:37.893 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:16:37.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:16:37.894 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:16:37.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:16:37.897 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:16:37.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:16:37.898 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:16:37.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:16:37.938 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:16:37.938 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:37.940 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:16:37.940 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:37.945 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:16:37.945 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:37.947 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:16:37.948 DEBUG:teuthology.parallel:result is None 2023-12-19T16:16:37.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:38.025 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:16:38.025 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-19T16:16:38.035 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:16:38.039 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:16:38.058 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-19T16:16:38.051+0000 7f8e22455640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:16:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 Processor -- start 2023-12-19T16:16:38.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 -- start start 2023-12-19T16:16:38.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda7415ce30 0x7fda740d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740d0830 con 0x7fda740ce2c0 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda740d0b10 con 0x7fda741610b0 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda79e63640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda740d0df0 con 0x7fda7415ce30 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda6bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fda740ce2c0 0x7fda741609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53228/0 (socket says 172.21.15.73:53228) 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda6bfff640 1 -- 172.21.15.73:0/3428072632 learned_addr learned my addr 172.21.15.73:0/3428072632 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:38.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda737fe640 1 --2- 172.21.15.73:0/3428072632 >> v2:172.21.15.162:3300/0 conn(0x7fda7415ce30 0x7fda740d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46632093 0 0) 0x7fda740d0830 con 0x7fda740ce2c0 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda60003530 con 0x7fda740ce2c0 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda737fe640 1 -- 172.21.15.73:0/3428072632 >> v1:172.21.15.162:6789/0 conn(0x7fda741610b0 legacy=0x7fda7406a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762167317 0 0) 0x7fda740d0b10 con 0x7fda741610b0 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda737fe640 1 -- 172.21.15.73:0/3428072632 >> v1:172.21.15.73:6789/0 conn(0x7fda740ce2c0 legacy=0x7fda741609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.099+0000 7fda737fe640 1 -- 172.21.15.73:0/3428072632 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda740d10d0 con 0x7fda7415ce30 2023-12-19T16:16:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda737fe640 1 --2- 172.21.15.73:0/3428072632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda7415ce30 0x7fda740d18d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda640097a0 tx=0x7fda7406b0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a680f6281f488c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640ac620 con 0x7fda7415ce30 2023-12-19T16:16:38.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda640ac780 con 0x7fda7415ce30 2023-12-19T16:16:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda72ffd640 1 -- 172.21.15.73:0/3428072632 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640acaf0 con 0x7fda7415ce30 2023-12-19T16:16:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 -- 172.21.15.73:0/3428072632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda7415ce30 msgr2=0x7fda740d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 --2- 172.21.15.73:0/3428072632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda7415ce30 0x7fda740d18d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda640097a0 tx=0x7fda7406b0f0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 -- 172.21.15.73:0/3428072632 shutdown_connections 2023-12-19T16:16:38.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 --2- 172.21.15.73:0/3428072632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda7415ce30 0x7fda740d18d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 -- 172.21.15.73:0/3428072632 >> 172.21.15.73:0/3428072632 conn(0x7fda740d2bc0 msgr2=0x7fda740d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 -- 172.21.15.73:0/3428072632 shutdown_connections 2023-12-19T16:16:38.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.103+0000 7fda79e63640 1 -- 172.21.15.73:0/3428072632 wait complete. 2023-12-19T16:16:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 Processor -- start 2023-12-19T16:16:38.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- start start 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415ce30 0x7fda740b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda741610b0 0x7fda74155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74159050 con 0x7fda740ce2c0 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74155580 con 0x7fda741610b0 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda741592a0 con 0x7fda7415ce30 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33928/0 (socket says 172.21.15.73:33928) 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 -- 172.21.15.73:0/68421119 learned_addr learned my addr 172.21.15.73:0/68421119 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda6bfff640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415ce30 0x7fda740b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda73fff640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda741610b0 0x7fda74155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 -- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415ce30 msgr2=0x7fda740b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415ce30 0x7fda740b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 -- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda741610b0 msgr2=0x7fda74155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda741610b0 0x7fda74155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 -- 172.21.15.73:0/68421119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640093b0 con 0x7fda740ce2c0 2023-12-19T16:16:38.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda737fe640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda64018fb0 tx=0x7fda64019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640ac620 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda640059a0 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64005d50 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda74159580 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.107+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda740b2c50 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda74155740 con 0x7fda740ce2c0 2023-12-19T16:16:38.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda640b3040 con 0x7fda740ce2c0 2023-12-19T16:16:38.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda70ff9640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 0x7fda54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:38.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fda6411d1a0 con 0x7fda740ce2c0 2023-12-19T16:16:38.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda6bfff640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 0x7fda54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:38.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.111+0000 7fda6bfff640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 0x7fda54067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda740b24d0 tx=0x7fda5c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:38.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.115+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fda640eab10 con 0x7fda740ce2c0 2023-12-19T16:16:38.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.295+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda74072750 con 0x7fda740ce2c0 2023-12-19T16:16:38.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.299+0000 7fda70ff9640 1 -- 172.21.15.73:0/68421119 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fda640ee130 con 0x7fda740ce2c0 2023-12-19T16:16:38.306 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:38.306 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:38.065062+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:38.306 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 18 2023-12-19T16:16:38.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 msgr2=0x7fda54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 0x7fda54067f20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda740b24d0 tx=0x7fda5c009040 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 msgr2=0x7fda740b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fda64018fb0 tx=0x7fda64019140 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 shutdown_connections 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda741610b0 0x7fda74155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda7415ce30 0x7fda740b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fda54065a60 0x7fda54067f20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 --2- 172.21.15.73:0/68421119 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda740ce2c0 0x7fda740b2710 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 >> 172.21.15.73:0/68421119 conn(0x7fda740d2bc0 msgr2=0x7fda740cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 shutdown_connections 2023-12-19T16:16:38.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:38.303+0000 7fda79e63640 1 -- 172.21.15.73:0/68421119 wait complete. 2023-12-19T16:16:38.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:38.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:38.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:30.837561+0000', 'modified': '2023-12-19T16:16:38.065062+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5196}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5196': {'gid': 5196, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.162:6833/1689540958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1689540958}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1689540958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:38.729 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5196:up:replay 2023-12-19T16:16:39.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:39.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 Processor -- start 2023-12-19T16:16:39.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 -- start start 2023-12-19T16:16:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 0x7f49ec15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49ec0ccd10 0x7f49ec0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec1436d0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ec15aef0 con 0x7f49ec0cc930 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f332c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec0b1ad0 con 0x7f49ec0b30b0 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49ec0ccd10 0x7f49ec0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49ec0ccd10 0x7f49ec0b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33940/0 (socket says 172.21.15.73:33940) 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 -- 172.21.15.73:0/2533145233 learned_addr learned my addr 172.21.15.73:0/2533145233 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f18c9640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f10c8640 1 --2- 172.21.15.73:0/2533145233 >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 0x7f49ec15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 -- 172.21.15.73:0/2533145233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 msgr2=0x7f49ec15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 -- 172.21.15.73:0/2533145233 >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 msgr2=0x7f49ec15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 --2- 172.21.15.73:0/2533145233 >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 0x7f49ec15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f08c7640 1 -- 172.21.15.73:0/2533145233 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec0b1db0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.871+0000 7f49f10c8640 1 --2- 172.21.15.73:0/2533145233 >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 0x7f49ec15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:16:39.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f08c7640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec0b2b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f49ec06a900 tx=0x7f49dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ce9a39fea5ef56 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49e3fff640 1 -- 172.21.15.73:0/2533145233 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0aa5f0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49e3fff640 1 -- 172.21.15.73:0/2533145233 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0aa750 con 0x7f49ec0ccd10 2023-12-19T16:16:39.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49e3fff640 1 -- 172.21.15.73:0/2533145233 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0aaae0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 -- 172.21.15.73:0/2533145233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 msgr2=0x7f49ec0b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec0b2b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f49ec06a900 tx=0x7f49dc01c4d0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 -- 172.21.15.73:0/2533145233 shutdown_connections 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 --2- 172.21.15.73:0/2533145233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec0b2b70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 --2- 172.21.15.73:0/2533145233 >> v2:172.21.15.162:3300/0 conn(0x7f49ec0cc930 0x7f49ec15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 -- 172.21.15.73:0/2533145233 >> 172.21.15.73:0/2533145233 conn(0x7f49ec069cc0 msgr2=0x7f49ec06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:39.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 -- 172.21.15.73:0/2533145233 shutdown_connections 2023-12-19T16:16:39.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.875+0000 7f49f332c640 1 -- 172.21.15.73:0/2533145233 wait complete. 2023-12-19T16:16:39.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 Processor -- start 2023-12-19T16:16:39.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- start start 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49ec0cc930 0x7f49ec155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec138d10 con 0x7f49ec0ccd10 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec155780 con 0x7f49ec0cc930 2023-12-19T16:16:39.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec163fe0 con 0x7f49ec0b30b0 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33946/0 (socket says 172.21.15.73:33946) 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 -- 172.21.15.73:0/1939038028 learned_addr learned my addr 172.21.15.73:0/1939038028 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f10c8640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f08c7640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49ec0cc930 0x7f49ec155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 -- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 msgr2=0x7f49ec155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 -- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49ec0cc930 msgr2=0x7f49ec155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49ec0cc930 0x7f49ec155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 -- 172.21.15.73:0/1939038028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0094d0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f18c9640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49e4007e60 tx=0x7f49e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4014420 con 0x7f49ec0ccd10 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4014580 con 0x7f49ec0ccd10 2023-12-19T16:16:39.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4014930 con 0x7f49ec0ccd10 2023-12-19T16:16:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec1386c0 con 0x7f49ec0ccd10 2023-12-19T16:16:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.879+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec163c70 con 0x7f49ec0ccd10 2023-12-19T16:16:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec072750 con 0x7f49ec0ccd10 2023-12-19T16:16:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f49e4014a90 con 0x7f49ec0ccd10 2023-12-19T16:16:39.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49e1ffb640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 0x7f49d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:39.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f49e4083a30 con 0x7f49ec0ccd10 2023-12-19T16:16:39.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49f10c8640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 0x7f49d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:39.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.883+0000 7f49f10c8640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 0x7f49d0067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49ec140670 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:39.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:39.887+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f49e40513a0 con 0x7f49ec0ccd10 2023-12-19T16:16:40.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49ec06b750 con 0x7f49ec0ccd10 2023-12-19T16:16:40.076 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49e1ffb640 1 -- 172.21.15.73:0/1939038028 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f49e4009960 con 0x7f49ec0ccd10 2023-12-19T16:16:40.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:40.076 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:40.069380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:40.077 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 20 2023-12-19T16:16:40.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 msgr2=0x7f49d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 0x7f49d0067f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f49ec140670 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2023-12-19T16:16:40.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 msgr2=0x7f49ec155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f49e4007e60 tx=0x7f49e400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 shutdown_connections 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f49d0065a60 0x7f49d0067f20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49ec0ccd10 0x7f49ec155e90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49ec0cc930 0x7f49ec155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 --2- 172.21.15.73:0/1939038028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49ec0b30b0 0x7f49ec155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 >> 172.21.15.73:0/1939038028 conn(0x7f49ec069cc0 msgr2=0x7f49ec06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 shutdown_connections 2023-12-19T16:16:40.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:40.071+0000 7f49f332c640 1 -- 172.21.15.73:0/1939038028 wait complete. 2023-12-19T16:16:40.500 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:30.837561+0000', 'modified': '2023-12-19T16:16:40.069380+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5196}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5196': {'gid': 5196, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.162:6833/1689540958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1689540958}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1689540958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:40.500 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5196:up:rejoin 2023-12-19T16:16:41.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:41.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.639+0000 7f98b1a8c640 1 Processor -- start 2023-12-19T16:16:41.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.639+0000 7f98b1a8c640 1 -- start start 2023-12-19T16:16:41.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98b1a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f98ac06b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98b1a8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0ce200 con 0x7f98ac15cd20 2023-12-19T16:16:41.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98b1a8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0b2140 con 0x7f98ac0b3890 2023-12-19T16:16:41.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98b1a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0ce4e0 con 0x7f98ac06b3a0 2023-12-19T16:16:41.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98ab7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98ac15cd20 0x7f98ac0cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53236/0 (socket says 172.21.15.73:53236) 2023-12-19T16:16:41.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98ab7fe640 1 -- 172.21.15.73:0/1156655003 learned_addr learned my addr 172.21.15.73:0/1156655003 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f98ac06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925376619 0 0) 0x7f98ac0ce200 con 0x7f98ac15cd20 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9894003530 con 0x7f98ac15cd20 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768138243 0 0) 0x7f98ac0b2140 con 0x7f98ac0b3890 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac0ce200 con 0x7f98ac0b3890 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687819279 0 0) 0x7f9894003530 con 0x7f98ac15cd20 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 msgr2=0x7f98ac06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f98ac06b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 >> v1:172.21.15.162:6789/0 conn(0x7f98ac0b3890 legacy=0x7f98ac0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0b2420 con 0x7f98ac15cd20 2023-12-19T16:16:41.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f989c001680 con 0x7f98ac15cd20 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 >> v1:172.21.15.73:6789/0 conn(0x7f98ac15cd20 legacy=0x7f98ac0cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f9894003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98940040f0 0x7f98940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9894004d10 0x7f9894005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0ce4e0 con 0x7f9894004d10 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989400bad0 con 0x7f98940040f0 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989400bc90 con 0x7f98ac06b3a0 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9894004d10 0x7f9894005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f9894003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98aaffd640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98940040f0 0x7f98940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 -- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 msgr2=0x7f9894003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f98ac06b3a0 0x7f9894003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 -- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98940040f0 msgr2=0x7f98940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98940040f0 0x7f98940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.652 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.643+0000 7f98abfff640 1 -- 172.21.15.73:0/1156655003 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894003530 con 0x7f9894004d10 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98abfff640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9894004d10 0x7f9894005190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009fc0 tx=0x7f98a401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad62975311f1f608 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40a5b60 con 0x7f9894004d10 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400f040 con 0x7f9894004d10 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1156655003 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40ad440 con 0x7f9894004d10 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- 172.21.15.73:0/1156655003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9894004d10 msgr2=0x7f9894005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/1156655003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9894004d10 0x7f9894005190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009fc0 tx=0x7f98a401cc60 comp rx=0 tx=0).stop 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98abfff640 1 -- 172.21.15.73:0/1156655003 reap_dead start 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- 172.21.15.73:0/1156655003 shutdown_connections 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- 172.21.15.73:0/1156655003 >> 172.21.15.73:0/1156655003 conn(0x7f98ac069cc0 msgr2=0x7f98ac06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- 172.21.15.73:0/1156655003 shutdown_connections 2023-12-19T16:16:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- 172.21.15.73:0/1156655003 wait complete. 2023-12-19T16:16:41.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 Processor -- start 2023-12-19T16:16:41.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.647+0000 7f98b1a8c640 1 -- start start 2023-12-19T16:16:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9894004d10 0x7f98ac0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98ac1f6440 0x7f98ac1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b3cf0 con 0x7f98ac1f68c0 2023-12-19T16:16:41.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b2800 con 0x7f98ac1f6440 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1e6be0 con 0x7f9894004d10 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33968/0 (socket says 172.21.15.73:33968) 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9894004d10 0x7f98ac0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 -- 172.21.15.73:0/3267911401 learned_addr learned my addr 172.21.15.73:0/3267911401 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98aaffd640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98ac1f6440 0x7f98ac1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 -- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9894004d10 msgr2=0x7f98ac0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9894004d10 0x7f98ac0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 -- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98ac1f6440 msgr2=0x7f98ac1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98ac1f6440 0x7f98ac1f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 -- 172.21.15.73:0/3267911401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac1f6e90 con 0x7f98ac1f68c0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98abfff640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f98a4002240 tx=0x7f98a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a40039a0 con 0x7f98ac1f68c0 2023-12-19T16:16:41.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a4003b00 con 0x7f98ac1f68c0 2023-12-19T16:16:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4003e90 con 0x7f98ac1f68c0 2023-12-19T16:16:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac1f7170 con 0x7f98ac1f68c0 2023-12-19T16:16:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac151560 con 0x7f98ac1f68c0 2023-12-19T16:16:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.651+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac1e6d20 con 0x7f98ac1f68c0 2023-12-19T16:16:41.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.655+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f98a40b4040 con 0x7f98ac1f68c0 2023-12-19T16:16:41.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.655+0000 7f9893fff640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 0x7f9898067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:41.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.655+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f98a411c900 con 0x7f98ac1f68c0 2023-12-19T16:16:41.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.655+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 0x7f9898067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:41.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.655+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 0x7f9898067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c10 tx=0x7f989c000ee0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:41.665 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.659+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f98ac1e6d20 con 0x7f98ac1f68c0 2023-12-19T16:16:41.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ac1e6d20 con 0x7f98ac1f68c0 2023-12-19T16:16:41.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f9893fff640 1 -- 172.21.15.73:0/3267911401 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f98ac1e6d20 con 0x7f98ac1f68c0 2023-12-19T16:16:41.844 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:41.845 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:41.071263+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:41.845 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 21 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 msgr2=0x7f9898067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 0x7f9898067f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c10 tx=0x7f989c000ee0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 msgr2=0x7f98ac1f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f98a4002240 tx=0x7f98a4009750 comp rx=0 tx=0).stop 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 shutdown_connections 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9898065a60 0x7f9898067f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac1f68c0 0x7f98ac1f44a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98ac1f6440 0x7f98ac1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 --2- 172.21.15.73:0/3267911401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9894004d10 0x7f98ac0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 >> 172.21.15.73:0/3267911401 conn(0x7f98ac069cc0 msgr2=0x7f98ac0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 shutdown_connections 2023-12-19T16:16:41.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:41.839+0000 7f98b1a8c640 1 -- 172.21.15.73:0/3267911401 wait complete. 2023-12-19T16:16:42.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:30.837561+0000', 'modified': '2023-12-19T16:16:41.071263+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5196}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5196': {'gid': 5196, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.162:6833/1689540958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1689540958}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1689540958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:42.269 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5196:up:clientreplay 2023-12-19T16:16:43.074 INFO:tasks.ceph.mds.d.smithi162.stderr:2023-12-19T16:16:43.067+0000 7f99acad9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:16:43.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:16:43.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.407+0000 7fc976d8f640 1 Processor -- start 2023-12-19T16:16:43.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.407+0000 7fc976d8f640 1 -- start start 2023-12-19T16:16:43.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc976d8f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 0x7fc9700cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc976d8f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9700cc660 0x7fc9700b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc976d8f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9700ce020 con 0x7fc9700b0c70 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc976d8f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700b1100 con 0x7fc9700cc660 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc976d8f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700cb130 con 0x7fc97015a8d0 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9700cc660 0x7fc9700b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9700cc660 0x7fc9700b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33972/0 (socket says 172.21.15.73:33972) 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 -- 172.21.15.73:0/1525938480 learned_addr learned my addr 172.21.15.73:0/1525938480 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc974b2b640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 0x7fc9700cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 -- 172.21.15.73:0/1525938480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 msgr2=0x7fc9700cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 0x7fc9700cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 -- 172.21.15.73:0/1525938480 >> v1:172.21.15.162:6789/0 conn(0x7fc9700b0c70 legacy=0x7fc97015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.417 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc967fff640 1 -- 172.21.15.73:0/1525938480 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700cd410 con 0x7fc9700cc660 2023-12-19T16:16:43.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.411+0000 7fc974b2b640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 0x7fc9700cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:43.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc967fff640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700cc660 0x7fc9700b0730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc960009870 tx=0x7fc96001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a8be6fe43e1e30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc9677fe640 1 -- 172.21.15.73:0/1525938480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600ac600 con 0x7fc9700cc660 2023-12-19T16:16:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc9677fe640 1 -- 172.21.15.73:0/1525938480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9600a8050 con 0x7fc9700cc660 2023-12-19T16:16:43.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc9677fe640 1 -- 172.21.15.73:0/1525938480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600ac980 con 0x7fc9700cc660 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- 172.21.15.73:0/1525938480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700cc660 msgr2=0x7fc9700b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700cc660 0x7fc9700b0730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc960009870 tx=0x7fc96001c480 comp rx=0 tx=0).stop 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- 172.21.15.73:0/1525938480 shutdown_connections 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700cc660 0x7fc9700b0730 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1525938480 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc97015a8d0 0x7fc9700cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- 172.21.15.73:0/1525938480 >> 172.21.15.73:0/1525938480 conn(0x7fc970069cc0 msgr2=0x7fc97006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- 172.21.15.73:0/1525938480 shutdown_connections 2023-12-19T16:16:43.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- 172.21.15.73:0/1525938480 wait complete. 2023-12-19T16:16:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 Processor -- start 2023-12-19T16:16:43.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.415+0000 7fc976d8f640 1 -- start start 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9700cc660 0x7fc97006f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc97015a8d0 0x7fc97006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9701f9750 con 0x7fc9700b0c70 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970163e60 con 0x7fc97015a8d0 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc970164140 con 0x7fc9700cc660 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33978/0 (socket says 172.21.15.73:33978) 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 -- 172.21.15.73:0/1830134801 learned_addr learned my addr 172.21.15.73:0/1830134801 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc967fff640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9700cc660 0x7fc97006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc97532c640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc97015a8d0 0x7fc97006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 -- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9700cc660 msgr2=0x7fc97006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9700cc660 0x7fc97006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 -- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc97015a8d0 msgr2=0x7fc97006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc97015a8d0 0x7fc97006f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 -- 172.21.15.73:0/1830134801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600094d0 con 0x7fc9700b0c70 2023-12-19T16:16:43.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc974b2b640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e810 tx=0x7fc96c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00c8d0 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96c00ca30 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00cdc0 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc970164420 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9701649e0 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc970072750 con 0x7fc9700b0c70 2023-12-19T16:16:43.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.419+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc96c013410 con 0x7fc9700b0c70 2023-12-19T16:16:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.423+0000 7fc9657fa640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 0x7fc95c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.423+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc96c083070 con 0x7fc9700b0c70 2023-12-19T16:16:43.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.423+0000 7fc967fff640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 0x7fc95c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:43.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.423+0000 7fc967fff640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 0x7fc95c067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ae000 tx=0x7fc9600a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:43.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.427+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc96c0b40a0 con 0x7fc9700b0c70 2023-12-19T16:16:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.607+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9700b1580 con 0x7fc9700b0c70 2023-12-19T16:16:43.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.607+0000 7fc9657fa640 1 -- 172.21.15.73:0/1830134801 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fc96c0509e0 con 0x7fc9700b0c70 2023-12-19T16:16:43.614 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:16:43.614 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:42.078261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:16:43.614 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2023-12-19T16:16:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 msgr2=0x7fc95c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 0x7fc95c067f20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc9600ae000 tx=0x7fc9600a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 msgr2=0x7fc9701f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e810 tx=0x7fc96c00ecd0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 shutdown_connections 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc97015a8d0 0x7fc97006f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9700cc660 0x7fc97006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc95c065a60 0x7fc95c067f20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 --2- 172.21.15.73:0/1830134801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9700b0c70 0x7fc9701f9210 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 >> 172.21.15.73:0/1830134801 conn(0x7fc970069cc0 msgr2=0x7fc9700ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 shutdown_connections 2023-12-19T16:16:43.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:43.611+0000 7fc976d8f640 1 -- 172.21.15.73:0/1830134801 wait complete. 2023-12-19T16:16:44.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:16:30.837561+0000', 'modified': '2023-12-19T16:16:42.078261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5196}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5196': {'gid': 5196, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6833/1689540958', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 1689540958}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 1689540958}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:16:44.037 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:16:44.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T16:16:44.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.171+0000 7f0ec0ec4640 1 Processor -- start 2023-12-19T16:16:44.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.171+0000 7f0ec0ec4640 1 -- start start 2023-12-19T16:16:44.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.171+0000 7f0ec0ec4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.171+0000 7f0ec0ec4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 0x7f0ebc0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0ec0ec4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc06d050 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0ec0ec4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b0f00 con 0x7f0ebc0ae0f0 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0ec0ec4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc15e670 con 0x7f0ebc15aa70 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0ebad9d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0ebc0b0a70 0x7f0ebc06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:32904/0 (socket says 172.21.15.73:32904) 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0ebad9d640 1 -- 172.21.15.73:0/97654577 learned_addr learned my addr 172.21.15.73:0/97654577 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/97654577 >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 0x7f0ebc0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eb9d9b640 1 -- 172.21.15.73:0/97654577 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683296238 0 0) 0x7f0ebc06d050 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 -- 172.21.15.73:0/97654577 >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 msgr2=0x7f0ebc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 --2- 172.21.15.73:0/97654577 >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 0x7f0ebc0b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 -- 172.21.15.73:0/97654577 >> v1:172.21.15.162:6789/0 conn(0x7f0ebc0b0a70 legacy=0x7f0ebc06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 -- 172.21.15.73:0/97654577 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc15e880 con 0x7f0ebc15aa70 2023-12-19T16:16:44.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/97654577 >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 0x7f0ebc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:16:44.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.175+0000 7f0eba59c640 1 --2- 172.21.15.73:0/97654577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc0adbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7fbc57264d36419 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0eb9d9b640 1 -- 172.21.15.73:0/97654577 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0ab650 con 0x7f0ebc15aa70 2023-12-19T16:16:44.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0eb9d9b640 1 -- 172.21.15.73:0/97654577 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac0ab7b0 con 0x7f0ebc15aa70 2023-12-19T16:16:44.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0eb9d9b640 1 -- 172.21.15.73:0/97654577 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0abb40 con 0x7f0ebc15aa70 2023-12-19T16:16:44.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/97654577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 msgr2=0x7f0ebc0adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/97654577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc0adbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac01c450 comp rx=0 tx=0).stop 2023-12-19T16:16:44.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/97654577 shutdown_connections 2023-12-19T16:16:44.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/97654577 >> v2:172.21.15.162:3300/0 conn(0x7f0ebc0ae0f0 0x7f0ebc0b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/97654577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc0adbb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/97654577 >> 172.21.15.73:0/97654577 conn(0x7f0ebc0ce950 msgr2=0x7f0ebc0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/97654577 shutdown_connections 2023-12-19T16:16:44.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/97654577 wait complete. 2023-12-19T16:16:44.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 Processor -- start 2023-12-19T16:16:44.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.179+0000 7f0ec0ec4640 1 -- start start 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc0ae0f0 0x7f0ebc155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc15c180 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc15b120 con 0x7f0ebc0ae0f0 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc15b3c0 con 0x7f0ebc15aa70 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33990/0 (socket says 172.21.15.73:33990) 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/2877366253 learned_addr learned my addr 172.21.15.73:0/2877366253 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eba59c640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc0ae0f0 0x7f0ebc155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 msgr2=0x7f0ebc150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc0ae0f0 msgr2=0x7f0ebc155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc0ae0f0 0x7f0ebc155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/2877366253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009a70 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400efc0 tx=0x7f0ea400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb37fe640 1 -- 172.21.15.73:0/2877366253 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4014680 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb37fe640 1 -- 172.21.15.73:0/2877366253 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400f040 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb37fe640 1 -- 172.21.15.73:0/2877366253 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4014a00 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac009420 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc15b980 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.190 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.183+0000 7f0eb37fe640 1 -- 172.21.15.73:0/2877366253 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0ea4014b60 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eb37fe640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 0x7f0e9c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eb37fe640 1 -- 172.21.15.73:0/2877366253 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0ea4084130 con 0x7f0ebc0b0a70 2023-12-19T16:16:44.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 Processor -- start 2023-12-19T16:16:44.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 0x7f0e9c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 -- start start 2023-12-19T16:16:44.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 0x7f0e9c067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0af000 tx=0x7f0eac0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43cbcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cbd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43ae0c90 con 0x561d43d07070 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43b12220 con 0x561d43cbd1c0 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d43b0f7f0 con 0x561d43d07990 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:33996/0 (socket says 172.21.15.73:33996) 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 -- 172.21.15.73:0/3016403597 learned_addr learned my addr 172.21.15.73:0/3016403597 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43cbcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cbd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 -- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 msgr2=0x561d43cbcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43cbcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 -- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 msgr2=0x561d43cbd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cbd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 -- 172.21.15.73:0/3016403597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d43807890 con 0x561d43d07070 2023-12-19T16:16:44.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d6a3751db3d89c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0e9bfff640 1 -- 172.21.15.73:0/3016403597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0b6750 con 0x561d43d07070 2023-12-19T16:16:44.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0e9bfff640 1 -- 172.21.15.73:0/3016403597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac0c6070 con 0x561d43d07070 2023-12-19T16:16:44.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.187+0000 7f0e9bfff640 1 -- 172.21.15.73:0/3016403597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0b6ab0 con 0x561d43d07070 2023-12-19T16:16:44.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3016403597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 msgr2=0x561d43d07450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac004740 comp rx=0 tx=0).stop 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3016403597 shutdown_connections 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cbd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43cbcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3016403597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d07450 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3016403597 >> 172.21.15.73:0/3016403597 conn(0x561d43cc3950 msgr2=0x561d43cbb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3016403597 shutdown_connections 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3016403597 wait complete. 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- start start 2023-12-19T16:16:44.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 Processor -- start 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cc2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43cc9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43b0b0e0 con 0x561d43d07990 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43aaa310 con 0x561d43cbd1c0 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d43ac8770 con 0x561d43d07070 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 10 client.0 _ll_register_callbacks cb 0x561d43ca8b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34012/0 (socket says 172.21.15.73:34012) 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 -- 172.21.15.73:0/3078161399 learned_addr learned my addr 172.21.15.73:0/3078161399 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cc2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43cc9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 -- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 msgr2=0x561d43cc9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43cc9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 -- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 msgr2=0x561d43cc2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cc2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 -- 172.21.15.73:0/3078161399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0bc070 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4004f20 tx=0x7f0eb4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac057d008891ece server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0e997fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4015650 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d43adac10 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.191+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0eb4019880 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb4019a40 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 10 client.5232 fetch_fsmap learned FSMap version 22 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561d43ad0260 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d43adac10 con 0x561d43d07990 2023-12-19T16:16:44.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0eb4012050 con 0x561d43d07990 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 10 client.5232 fetch_fsmap finished waiting for FSMap version 22 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 10 client.5232 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 20 client.5232 populate_metadata read hostname 'smithi073' 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d0e8d0 0x561d43d0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 4 client.5232 mds_command: new command op to 5196 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 --> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d43b09a30 con 0x561d43d0e8d0 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d0e8d0 0x561d43d0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 10 client.5232 ms_handle_connect on v2:172.21.15.162:6832/1689540958 2023-12-19T16:16:44.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d0e8d0 0x561d43d0ecb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e338148260b82ec8 server_cookie=5db733b3d66b74c2 in_seq=0 out_seq=0 2023-12-19T16:16:44.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 1 -- 172.21.15.73:0/3078161399 <== mds.0 v2:172.21.15.162:6832/1689540958 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561d43b09a30 con 0x561d43d0e8d0 2023-12-19T16:16:44.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 10 client.5232 handle_command_reply: tid=0 2023-12-19T16:16:44.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 client.5232 shutdown 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 msgr2=0x561d43cc95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4004f20 tx=0x7f0eb4001690 comp rx=0 tx=0).stop 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 shutdown_connections 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d0e8d0 0x561d43d0ecb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07990 0x561d43cc95c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43cc9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0e997fa640 0 client.5232 ms_handle_reset on v2:172.21.15.162:6832/1689540958 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3078161399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43cc2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 >> 172.21.15.73:0/3078161399 conn(0x561d43cc3950 msgr2=0x561d43cbbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 shutdown_connections 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 1 -- 172.21.15.73:0/3078161399 wait complete. 2023-12-19T16:16:44.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.195+0000 7f0ec4224000 20 client.5232 trim_cache size 0 max 16384 2023-12-19T16:16:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 Processor -- start 2023-12-19T16:16:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 -- start start 2023-12-19T16:16:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43d5f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43d07990 0x561d43d5f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d437c8940 con 0x561d43cbd1c0 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43ab0570 con 0x561d43d07990 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d43ab3860 con 0x561d43d07070 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34018/0 (socket says 172.21.15.73:34018) 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 -- 172.21.15.73:0/795582517 learned_addr learned my addr 172.21.15.73:0/795582517 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43d07990 0x561d43d5f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43d5f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 -- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 msgr2=0x561d43d5f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43d5f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 -- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43d07990 msgr2=0x561d43d5f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43d07990 0x561d43d5f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 -- 172.21.15.73:0/795582517 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d43ab63b0 con 0x561d43cbd1c0 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43d5f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eba59c640 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01c930 tx=0x7f0eac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8438dc55513182bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eb0d99640 1 -- 172.21.15.73:0/795582517 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0d8110 con 0x561d43cbd1c0 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eb0d99640 1 -- 172.21.15.73:0/795582517 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac0c6040 con 0x561d43cbd1c0 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.211+0000 7f0eb0d99640 1 -- 172.21.15.73:0/795582517 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0d88a0 con 0x561d43cbd1c0 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/795582517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 msgr2=0x561d43d5eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eac01c930 tx=0x7f0eac008040 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/795582517 shutdown_connections 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43d07990 0x561d43d5f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07070 0x561d43d5f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- 172.21.15.73:0/795582517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43cbd1c0 0x561d43d5eed0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/795582517 >> 172.21.15.73:0/795582517 conn(0x561d43cc3950 msgr2=0x561d43cc8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/795582517 shutdown_connections 2023-12-19T16:16:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/795582517 wait complete. 2023-12-19T16:16:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- start start 2023-12-19T16:16:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 Processor -- start 2023-12-19T16:16:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43d48150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43d48bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43b0f0e0 con 0x561d43d07070 2023-12-19T16:16:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d43b134b0 con 0x561d43cbd1c0 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d43b4ece0 con 0x561d43d07990 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 10 client.0 _ll_register_callbacks cb 0x561d43ab9640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34026/0 (socket says 172.21.15.73:34026) 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/3820076963 learned_addr learned my addr 172.21.15.73:0/3820076963 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ebad9d640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43d48bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43d48150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 msgr2=0x561d43d48bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43d48bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 msgr2=0x561d43d48150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43d48150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 -- 172.21.15.73:0/3820076963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0cf040 con 0x561d43d07070 2023-12-19T16:16:44.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0eb1d9b640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400c990 tx=0x7f0ea4051aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e655a06665e1cae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40592c0 con 0x561d43d07070 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0ea405d200 con 0x561d43d07070 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d43cc2a60 con 0x561d43d07070 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea405d3c0 con 0x561d43d07070 2023-12-19T16:16:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 10 client.5238 fetch_fsmap learned FSMap version 22 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x561d43807cc0 con 0x561d43d07070 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea4077080 con 0x561d43d07070 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f0ea4024020 con 0x561d43d07070 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 10 client.5238 fetch_fsmap finished waiting for FSMap version 22 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 10 client.5238 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 20 client.5238 populate_metadata read hostname 'smithi073' 2023-12-19T16:16:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d49110 0x561d43d6c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 4 client.5238 mds_command: new command op to 5196 tid=0[{"prefix": "status"}] 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.215+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 --> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d43ad0e00 con 0x561d43d49110 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d49110 0x561d43d6c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0eba59c640 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d49110 0x561d43d6c170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201708668ff58558 server_cookie=84f2fe83c67d306d in_seq=0 out_seq=0 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0e997fa640 10 client.5238 ms_handle_connect on v2:172.21.15.162:6832/1689540958 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0e997fa640 1 -- 172.21.15.73:0/3820076963 <== mds.0 v2:172.21.15.162:6832/1689540958 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561d43ad0e00 con 0x561d43d49110 2023-12-19T16:16:44.231 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0e997fa640 10 client.5238 handle_command_reply: tid=0 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 client.5238 shutdown 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 msgr2=0x561d43d48690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400c990 tx=0x7f0ea4051aa0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 shutdown_connections 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:6832/1689540958,v1:172.21.15.162:6833/1689540958] conn(0x561d43d49110 0x561d43d6c170 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561d43d07990 0x561d43d48bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561d43d07070 0x561d43d48690 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 --2- 172.21.15.73:0/3820076963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561d43cbd1c0 0x561d43d48150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 >> 172.21.15.73:0/3820076963 conn(0x561d43cc3950 msgr2=0x561d43d04060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0e997fa640 0 client.5238 ms_handle_reset on v2:172.21.15.162:6832/1689540958 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 shutdown_connections 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 1 -- 172.21.15.73:0/3820076963 wait complete. 2023-12-19T16:16:44.232 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec4224000 20 client.5238 trim_cache size 0 max 16384 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "90ec874a-c348-4a69-99d9-d4bef3b9261d", 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5196, 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-19T16:16:44.233 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 6.1527376470000004, 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 22, 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 40, 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 40, 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 6.1837938069999998 2023-12-19T16:16:44.234 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 msgr2=0x7f0e9c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 0x7f0e9c067f20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0af000 tx=0x7f0eac0a7000 comp rx=0 tx=0).stop 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 msgr2=0x7f0ebc15cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400efc0 tx=0x7f0ea400c490 comp rx=0 tx=0).stop 2023-12-19T16:16:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 shutdown_connections 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ebc15aa70 0x7f0ebc150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0e9c065a60 0x7f0e9c067f20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ebc0b0a70 0x7f0ebc15cdb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 --2- 172.21.15.73:0/2877366253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ebc0ae0f0 0x7f0ebc155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 >> 172.21.15.73:0/2877366253 conn(0x7f0ebc0ce950 msgr2=0x7f0ebc0af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 shutdown_connections 2023-12-19T16:16:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:16:44.219+0000 7f0ec0ec4640 1 -- 172.21.15.73:0/2877366253 wait complete. 2023-12-19T16:16:44.245 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:44.245 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file0", '"'"'w'"'"') as f: 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:44.255 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:44.302 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2023-12-19T16:16:44.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:44.311 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file0': No such file or directory 2023-12-19T16:16:45.312 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2023-12-19T16:16:45.322 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:45.323 INFO:tasks.cephfs.mount:File open_file0 became visible with size 7 from 0 after 1s 2023-12-19T16:16:45.323 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:45.323 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:45.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:45.377 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file0 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:45.455 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:45.455 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:45.455 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210693 s, 49.8 MB/s 2023-12-19T16:16:45.456 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:45.456 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file1", '"'"'w'"'"') as f: 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:45.510 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:45.511 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:45.511 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:45.554 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2023-12-19T16:16:45.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:45.565 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file1': No such file or directory 2023-12-19T16:16:46.566 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2023-12-19T16:16:46.577 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:46.577 INFO:tasks.cephfs.mount:File open_file1 became visible with size 7 from 0 after 1s 2023-12-19T16:16:46.577 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:46.577 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:46.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:46.628 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file1 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:46.707 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205486 s, 51.0 MB/s 2023-12-19T16:16:46.708 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:46.708 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:46.760 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:46.760 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:46.760 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file2", '"'"'w'"'"') as f: 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:46.761 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:46.806 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2023-12-19T16:16:46.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:46.816 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file2': No such file or directory 2023-12-19T16:16:47.817 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2023-12-19T16:16:47.828 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:47.828 INFO:tasks.cephfs.mount:File open_file2 became visible with size 7 from 0 after 1s 2023-12-19T16:16:47.828 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:47.828 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:47.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:47.880 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file2 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:47.960 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:47.960 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:47.960 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021269 s, 49.3 MB/s 2023-12-19T16:16:47.961 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:47.961 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file3", '"'"'w'"'"') as f: 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:48.012 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:48.058 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2023-12-19T16:16:48.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:48.068 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file3': No such file or directory 2023-12-19T16:16:49.069 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2023-12-19T16:16:49.079 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:49.080 INFO:tasks.cephfs.mount:File open_file3 became visible with size 7 from 0 after 1s 2023-12-19T16:16:49.080 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:49.080 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:49.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:49.137 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file3 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:49.217 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221084 s, 47.4 MB/s 2023-12-19T16:16:49.218 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:49.218 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:49.268 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:49.268 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:49.268 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:49.268 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file4", '"'"'w'"'"') as f: 2023-12-19T16:16:49.269 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:49.269 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:49.269 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:49.269 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:49.269 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:49.314 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2023-12-19T16:16:49.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:49.324 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file4': No such file or directory 2023-12-19T16:16:50.325 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2023-12-19T16:16:50.336 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:50.336 INFO:tasks.cephfs.mount:File open_file4 became visible with size 7 from 0 after 1s 2023-12-19T16:16:50.336 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:50.336 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:50.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:50.392 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file4 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:50.479 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:50.479 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:50.479 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027187 s, 38.6 MB/s 2023-12-19T16:16:50.480 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:50.481 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file5", '"'"'w'"'"') as f: 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:50.533 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:50.578 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2023-12-19T16:16:50.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:50.589 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file5': No such file or directory 2023-12-19T16:16:51.589 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2023-12-19T16:16:51.600 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:51.600 INFO:tasks.cephfs.mount:File open_file5 became visible with size 7 from 0 after 1s 2023-12-19T16:16:51.600 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:51.600 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:51.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:51.657 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file5 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:51.739 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239006 s, 43.9 MB/s 2023-12-19T16:16:51.740 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:51.740 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:51.797 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:51.797 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:51.797 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:51.797 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file6", '"'"'w'"'"') as f: 2023-12-19T16:16:51.797 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:51.798 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:51.798 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:51.798 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:51.798 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:51.846 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2023-12-19T16:16:51.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:51.857 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file6': No such file or directory 2023-12-19T16:16:52.858 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2023-12-19T16:16:52.868 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:52.869 INFO:tasks.cephfs.mount:File open_file6 became visible with size 7 from 0 after 1s 2023-12-19T16:16:52.869 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:52.869 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:52.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:52.920 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file6 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:53.000 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175723 s, 59.7 MB/s 2023-12-19T16:16:53.001 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:53.001 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:53.056 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/open_file7", '"'"'w'"'"') as f: 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:16:53.057 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:16:53.106 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2023-12-19T16:16:53.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:16:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file7': No such file or directory 2023-12-19T16:16:54.117 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2023-12-19T16:16:54.127 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:16:54.128 INFO:tasks.cephfs.mount:File open_file7 became visible with size 7 from 0 after 1s 2023-12-19T16:16:54.128 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:16:54.128 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:16:54.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:16:54.180 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file7 bs=1M conv=fdatasync count=1 seek=0) 2023-12-19T16:16:54.258 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T16:16:54.259 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T16:16:54.259 INFO:teuthology.orchestra.run.smithi073.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206428 s, 50.8 MB/s 2023-12-19T16:17:04.261 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.1 2023-12-19T16:17:04.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 Processor -- start 2023-12-19T16:17:04.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- start start 2023-12-19T16:17:04.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba755ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 0x561ba75e4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba74564d0 con 0x561ba75e6b20 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba74561d0 con 0x561ba75e7440 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba744ce40 con 0x561ba755b4a0 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53718/0 (socket says 172.21.15.73:53718) 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 -- 172.21.15.73:0/3232427631 learned_addr learned my addr 172.21.15.73:0/3232427631 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137840c640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 0x561ba75e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f1377c0b640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba755ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 -- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 msgr2=0x561ba755ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba755ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 -- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 msgr2=0x561ba75e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:04.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 0x561ba75e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 -- 172.21.15.73:0/3232427631 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c005d30 con 0x561ba75e6b20 2023-12-19T16:17:04.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137840c640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 0x561ba75e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:04.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137740a640 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f136c017f80 tx=0x7f136c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572de5462f98b9e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f1376408640 1 -- 172.21.15.73:0/3232427631 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0aa800 con 0x561ba75e6b20 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f1376408640 1 -- 172.21.15.73:0/3232427631 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0aa980 con 0x561ba75e6b20 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f1376408640 1 -- 172.21.15.73:0/3232427631 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0aad30 con 0x561ba75e6b20 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- 172.21.15.73:0/3232427631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 msgr2=0x561ba75e3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f136c017f80 tx=0x7f136c003030 comp rx=0 tx=0).stop 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- 172.21.15.73:0/3232427631 shutdown_connections 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e7440 0x561ba75e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e6b20 0x561ba75e3b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 --2- 172.21.15.73:0/3232427631 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba755ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- 172.21.15.73:0/3232427631 >> 172.21.15.73:0/3232427631 conn(0x561ba753e280 msgr2=0x561ba75e9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- 172.21.15.73:0/3232427631 shutdown_connections 2023-12-19T16:17:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.307+0000 7f137a0ef080 1 -- 172.21.15.73:0/3232427631 wait complete. 2023-12-19T16:17:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 Processor -- start 2023-12-19T16:17:04.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- start start 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba75e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e6b20 0x561ba75e1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 0x561ba76830f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba75e0190 con 0x561ba75e7440 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ba7685ea0 con 0x561ba75e6b20 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ba7686140 con 0x561ba755b4a0 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 0x561ba76830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 0x561ba76830f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53732/0 (socket says 172.21.15.73:53732) 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 -- 172.21.15.73:0/557923009 learned_addr learned my addr 172.21.15.73:0/557923009 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137740a640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e6b20 0x561ba75e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f1377c0b640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba75e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 -- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 msgr2=0x561ba75e0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba75e0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 -- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e6b20 msgr2=0x561ba75e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e6b20 0x561ba75e1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 -- 172.21.15.73:0/557923009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ba747f210 con 0x561ba75e7440 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137740a640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ba75e6b20 0x561ba75e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f1377c0b640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561ba755b4a0 0x561ba75e0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137840c640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 0x561ba76830f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1370004e00 tx=0x7f13700018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f1375406640 1 -- 172.21.15.73:0/557923009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700102e0 con 0x561ba75e7440 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f1375406640 1 -- 172.21.15.73:0/557923009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370010440 con 0x561ba75e7440 2023-12-19T16:17:04.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f1375406640 1 -- 172.21.15.73:0/557923009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700107d0 con 0x561ba75e7440 2023-12-19T16:17:04.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ba7465070 con 0x561ba75e7440 2023-12-19T16:17:04.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.311+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ba74584b0 con 0x561ba75e7440 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f1375406640 1 -- 172.21.15.73:0/557923009 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1370010930 con 0x561ba75e7440 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f1375406640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1364064440 0x7f1364066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f1375406640 1 -- 172.21.15.73:0/557923009 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1370081560 con 0x561ba75e7440 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f1377c0b640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1364064440 0x7f1364066900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x561ba7684ae0 0x561ba7684ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 --> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] -- osd_op(unknown.0.0:1 4.13 4:c9647462:::mds0_openfiles.1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) v8 -- 0x561ba7685430 con 0x561ba7684ae0 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137740a640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x561ba7684ae0 0x561ba7684ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:04.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f1377c0b640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1364064440 0x7f1364066900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1368009670 tx=0x7f1368005c50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:04.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137740a640 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x561ba7684ae0 0x561ba7684ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:04.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137740a640 1 -- 172.21.15.73:0/557923009 <== osd.2 v2:172.21.15.73:6800/38197 1 ==== osd_op_reply(1 mds0_openfiles.1 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x7f136c0abb00 con 0x561ba7684ae0 2023-12-19T16:17:04.323 INFO:teuthology.orchestra.run.smithi073.stdout:cephfs_metadata/mds0_openfiles.1 mtime 2023-12-19T16:16:58.000000+0000, size 0 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x561ba7684ae0 msgr2=0x561ba7684ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x561ba7684ae0 0x561ba7684ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1364064440 msgr2=0x7f1364066900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1364064440 0x7f1364066900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1368009670 tx=0x7f1368005c50 comp rx=0 tx=0).stop 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 msgr2=0x561ba76830f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137a0ef080 1 --2- 172.21.15.73:0/557923009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561ba75e7440 0x561ba76830f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1370004e00 tx=0x7f13700018b0 comp rx=0 tx=0).stop 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.315+0000 7f137840c640 1 -- 172.21.15.73:0/557923009 reap_dead start 2023-12-19T16:17:04.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.319+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 shutdown_connections 2023-12-19T16:17:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.319+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 >> 172.21.15.73:0/557923009 conn(0x561ba753e280 msgr2=0x561ba75f1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.319+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 shutdown_connections 2023-12-19T16:17:04.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:04.319+0000 7f137a0ef080 1 -- 172.21.15.73:0/557923009 wait complete. 2023-12-19T16:17:04.337 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:17:04.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:04.474 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:04.557 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:17:04.558 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.567 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.620 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.672 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.728 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.779 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.832 INFO:tasks.cephfs.mount:Terminating background process 2023-12-19T16:17:04.884 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:04.884 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:04.936 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:04.936 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:04.988 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:05.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.163+0000 7f08b636d640 1 Processor -- start 2023-12-19T16:17:05.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.163+0000 7f08b636d640 1 -- start start 2023-12-19T16:17:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b636d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f08b015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b636d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b01436d0 con 0x7f08b015b0f0 2023-12-19T16:17:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b636d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b015aef0 con 0x7f08b00ccd10 2023-12-19T16:17:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b636d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00b3280 con 0x7f08b00cc930 2023-12-19T16:17:05.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f08b015b0f0 0x7f08b015b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35530/0 (socket says 172.21.15.73:35530) 2023-12-19T16:17:05.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 -- 172.21.15.73:0/61721626 learned_addr learned my addr 172.21.15.73:0/61721626 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:05.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08affff640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f08b015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108775416 0 0) 0x7f08b01436d0 con 0x7f08b015b0f0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0898005740 con 0x7f08b015b0f0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701730259 0 0) 0x7f08b015aef0 con 0x7f08b00ccd10 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b01436d0 con 0x7f08b00ccd10 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198985406 0 0) 0x7f0898005740 con 0x7f08b015b0f0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 msgr2=0x7f08b015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f08b015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 >> v1:172.21.15.162:6789/0 conn(0x7f08b00ccd10 legacy=0x7f08b00b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00b1ad0 con 0x7f08b015b0f0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f08a8001a00 con 0x7f08b015b0f0 2023-12-19T16:17:05.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 >> v1:172.21.15.73:6789/0 conn(0x7f08b015b0f0 legacy=0x7f08b015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f0898005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0898006300 0x7f08980069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0898006f20 0x7f08980073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b00b3280 con 0x7f0898006f20 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089800dce0 con 0x7f0898006300 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089800dea0 con 0x7f08b00cc930 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0898006f20 0x7f08980073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08affff640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f0898005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08af7fe640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0898006300 0x7f08980069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 -- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 msgr2=0x7f0898005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08b00cc930 0x7f0898005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 -- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0898006300 msgr2=0x7f08980069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0898006300 0x7f08980069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.167+0000 7f08b490a640 1 -- 172.21.15.73:0/61721626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898005740 con 0x7f0898006f20 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b490a640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0898006f20 0x7f08980073a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08a800a700 tx=0x7f08a801f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad1432855dc86f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80ac5f0 con 0x7f0898006f20 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a80ac750 con 0x7f0898006f20 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08aeffd640 1 -- 172.21.15.73:0/61721626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80acb60 con 0x7f0898006f20 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 -- 172.21.15.73:0/61721626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0898006f20 msgr2=0x7f08980073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 --2- 172.21.15.73:0/61721626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0898006f20 0x7f08980073a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08a800a700 tx=0x7f08a801f940 comp rx=0 tx=0).stop 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b490a640 1 -- 172.21.15.73:0/61721626 reap_dead start 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 -- 172.21.15.73:0/61721626 shutdown_connections 2023-12-19T16:17:05.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 -- 172.21.15.73:0/61721626 >> 172.21.15.73:0/61721626 conn(0x7f08b0069cc0 msgr2=0x7f08b006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 -- 172.21.15.73:0/61721626 shutdown_connections 2023-12-19T16:17:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.171+0000 7f08b636d640 1 -- 172.21.15.73:0/61721626 wait complete. 2023-12-19T16:17:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 Processor -- start 2023-12-19T16:17:05.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- start start 2023-12-19T16:17:05.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0898006f20 0x7f08b01e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 0x7f08b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0138ae0 con 0x7f08b0148f80 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b014c070 con 0x7f08b0137990 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0137e60 con 0x7f0898006f20 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52036/0 (socket says 172.21.15.73:52036) 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 -- 172.21.15.73:0/3315882515 learned_addr learned my addr 172.21.15.73:0/3315882515 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08affff640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0898006f20 0x7f08b01e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b490a640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 0x7f08b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 -- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0898006f20 msgr2=0x7f08b01e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0898006f20 0x7f08b01e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 -- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 msgr2=0x7f08b00706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 0x7f08b00706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 -- 172.21.15.73:0/3315882515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0138140 con 0x7f08b0148f80 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b490a640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 0x7f08b00706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08af7fe640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f08a400e7b0 tx=0x7f08a400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40050d0 con 0x7f08b0148f80 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4005230 con 0x7f08b0148f80 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4007030 con 0x7f08b0148f80 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b0138420 con 0x7f08b0148f80 2023-12-19T16:17:05.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b01f1510 con 0x7f08b0148f80 2023-12-19T16:17:05.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.175+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0072750 con 0x7f08b0148f80 2023-12-19T16:17:05.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.179+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f08a4007190 con 0x7f08b0148f80 2023-12-19T16:17:05.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.179+0000 7f08acff9640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.179+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f08a4082da0 con 0x7f08b0148f80 2023-12-19T16:17:05.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.179+0000 7f08affff640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.179+0000 7f08affff640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009ae0 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.183+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f08a40506f0 con 0x7f08b0148f80 2023-12-19T16:17:05.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.335+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b0072750 con 0x7f08b0148f80 2023-12-19T16:17:05.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.335+0000 7f08acff9640 1 -- 172.21.15.73:0/3315882515 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16172 (secure 0 0 0) 0x7f08a4053d10 con 0x7f08b0148f80 2023-12-19T16:17:05.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:05.343 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:38.056689+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6834/1495159950":"2023-12-20T16:16:38.056671+0000","172.21.15.162:6832/1495159950":"2023-12-20T16:16:38.056671+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:05.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 msgr2=0x7f089c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009ae0 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 msgr2=0x7f08b01f0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f08a400e7b0 tx=0x7f08a400ec70 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 shutdown_connections 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08b0137990 0x7f08b00706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08b0148f80 0x7f08b01f0fd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 --2- 172.21.15.73:0/3315882515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0898006f20 0x7f08b01e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 >> 172.21.15.73:0/3315882515 conn(0x7f08b0069cc0 msgr2=0x7f08b013fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 shutdown_connections 2023-12-19T16:17:05.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.339+0000 7f08b636d640 1 -- 172.21.15.73:0/3315882515 wait complete. 2023-12-19T16:17:05.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:28.706414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:29.833606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:05.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:05.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.499+0000 7fcf2de8c640 1 Processor -- start 2023-12-19T16:17:05.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.499+0000 7fcf2de8c640 1 -- start start 2023-12-19T16:17:05.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf2de8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf280c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf2de8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2806c810 con 0x7fcf28070af0 2023-12-19T16:17:05.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf2de8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf28070fa0 con 0x7fcf280ad700 2023-12-19T16:17:05.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf2de8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28071280 con 0x7fcf2815ab60 2023-12-19T16:17:05.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf26ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcf28070af0 0x7fcf2806c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35534/0 (socket says 172.21.15.73:35534) 2023-12-19T16:17:05.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf26ffd640 1 -- 172.21.15.73:0/1089700105 learned_addr learned my addr 172.21.15.73:0/1089700105 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:05.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf277fe640 1 --2- 172.21.15.73:0/1089700105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf280c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf267fc640 1 -- 172.21.15.73:0/1089700105 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355642932 0 0) 0x7fcf2806c810 con 0x7fcf28070af0 2023-12-19T16:17:05.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf267fc640 1 -- 172.21.15.73:0/1089700105 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003530 con 0x7fcf28070af0 2023-12-19T16:17:05.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf277fe640 1 -- 172.21.15.73:0/1089700105 >> v1:172.21.15.162:6789/0 conn(0x7fcf280ad700 legacy=0x7fcf280cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf277fe640 1 -- 172.21.15.73:0/1089700105 >> v1:172.21.15.73:6789/0 conn(0x7fcf28070af0 legacy=0x7fcf2806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.503+0000 7fcf277fe640 1 -- 172.21.15.73:0/1089700105 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28071560 con 0x7fcf2815ab60 2023-12-19T16:17:05.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf277fe640 1 --2- 172.21.15.73:0/1089700105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf280c8f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097f0 tx=0x7fcf1801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2959e188f264fa51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf267fc640 1 -- 172.21.15.73:0/1089700105 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180aa610 con 0x7fcf2815ab60 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf267fc640 1 -- 172.21.15.73:0/1089700105 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180a6040 con 0x7fcf2815ab60 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf267fc640 1 -- 172.21.15.73:0/1089700105 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180aa990 con 0x7fcf2815ab60 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1089700105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 msgr2=0x7fcf280c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1089700105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf280c8f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097f0 tx=0x7fcf1801c490 comp rx=0 tx=0).stop 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1089700105 shutdown_connections 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1089700105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf280c8f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1089700105 >> 172.21.15.73:0/1089700105 conn(0x7fcf280b05a0 msgr2=0x7fcf280b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:05.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1089700105 shutdown_connections 2023-12-19T16:17:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1089700105 wait complete. 2023-12-19T16:17:05.513 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 Processor -- start 2023-12-19T16:17:05.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- start start 2023-12-19T16:17:05.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf28070af0 0x7fcf28145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf2815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28142c90 con 0x7fcf280ad700 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2815c160 con 0x7fcf28070af0 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.507+0000 7fcf2de8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2815c440 con 0x7fcf2815ab60 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52052/0 (socket says 172.21.15.73:52052) 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 -- 172.21.15.73:0/1289363587 learned_addr learned my addr 172.21.15.73:0/1289363587 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf277fe640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf28070af0 0x7fcf28145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf27fff640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf2815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 -- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 msgr2=0x7fcf2815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf2815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 -- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf28070af0 msgr2=0x7fcf28145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf28070af0 0x7fcf28145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 -- 172.21.15.73:0/1289363587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009420 con 0x7fcf280ad700 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf26ffd640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c400 tx=0x7fcf1c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c005cf0 con 0x7fcf280ad700 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c005e50 con 0x7fcf280ad700 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0072d0 con 0x7fcf280ad700 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280ae0a0 con 0x7fcf280ad700 2023-12-19T16:17:05.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2815ca00 con 0x7fcf280ad700 2023-12-19T16:17:05.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28072750 con 0x7fcf280ad700 2023-12-19T16:17:05.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.511+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf1c007430 con 0x7fcf280ad700 2023-12-19T16:17:05.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.515+0000 7fcf0ffff640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 0x7fcf14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.515+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fcf1c0826d0 con 0x7fcf280ad700 2023-12-19T16:17:05.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.515+0000 7fcf277fe640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 0x7fcf14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.520 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.515+0000 7fcf277fe640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 0x7fcf14067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf180b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.519+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcf1c050190 con 0x7fcf280ad700 2023-12-19T16:17:05.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.667+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf280cbf30 con 0x7fcf280ad700 2023-12-19T16:17:05.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.667+0000 7fcf0ffff640 1 -- 172.21.15.73:0/1289363587 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf1c0537b0 con 0x7fcf280ad700 2023-12-19T16:17:05.674 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:17:05.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 msgr2=0x7fcf14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 0x7fcf14067f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf180b5040 comp rx=0 tx=0).stop 2023-12-19T16:17:05.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 msgr2=0x7fcf28142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c400 tx=0x7fcf1c00c8c0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 shutdown_connections 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf2815ab60 0x7fcf2815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcf14065a60 0x7fcf14067f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf280ad700 0x7fcf28142750 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 --2- 172.21.15.73:0/1289363587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf28070af0 0x7fcf28145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 >> 172.21.15.73:0/1289363587 conn(0x7fcf280b05a0 msgr2=0x7fcf2814f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 shutdown_connections 2023-12-19T16:17:05.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.671+0000 7fcf2de8c640 1 -- 172.21.15.73:0/1289363587 wait complete. 2023-12-19T16:17:05.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:05.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 Processor -- start 2023-12-19T16:17:05.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 -- start start 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b740c8f00 0x7f6b740c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740ae090 con 0x7f6b74156d40 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740cb9f0 con 0x7f6b7406b440 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b796b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740c98d0 con 0x7f6b740c8f00 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b740c8f00 0x7f6b740c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b740c8f00 0x7f6b740c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52064/0 (socket says 172.21.15.73:52064) 2023-12-19T16:17:05.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 -- 172.21.15.73:0/1155631611 learned_addr learned my addr 172.21.15.73:0/1155631611 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:05.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 -- 172.21.15.73:0/1155631611 >> v1:172.21.15.162:6789/0 conn(0x7f6b7406b440 legacy=0x7f6b7415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:05.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 -- 172.21.15.73:0/1155631611 >> v1:172.21.15.73:6789/0 conn(0x7f6b74156d40 legacy=0x7f6b740cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b737fe640 1 -- 172.21.15.73:0/1155631611 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7406b8e0 con 0x7f6b740c8f00 2023-12-19T16:17:05.838 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.831+0000 7f6b727fc640 1 -- 172.21.15.73:0/1155631611 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517981957 0 0) 0x7f6b740ae090 con 0x7f6b74156d40 2023-12-19T16:17:05.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b737fe640 1 --2- 172.21.15.73:0/1155631611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740c8f00 0x7f6b740c9390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ca040 tx=0x7f6b6c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d543cfbf58feac3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b727fc640 1 -- 172.21.15.73:0/1155631611 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a56b0 con 0x7f6b740c8f00 2023-12-19T16:17:05.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b727fc640 1 -- 172.21.15.73:0/1155631611 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0a5810 con 0x7f6b740c8f00 2023-12-19T16:17:05.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b727fc640 1 -- 172.21.15.73:0/1155631611 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a5ba0 con 0x7f6b740c8f00 2023-12-19T16:17:05.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 -- 172.21.15.73:0/1155631611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740c8f00 msgr2=0x7f6b740c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 --2- 172.21.15.73:0/1155631611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740c8f00 0x7f6b740c9390 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6b740ca040 tx=0x7f6b6c01c900 comp rx=0 tx=0).stop 2023-12-19T16:17:05.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 -- 172.21.15.73:0/1155631611 shutdown_connections 2023-12-19T16:17:05.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 --2- 172.21.15.73:0/1155631611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b740c8f00 0x7f6b740c9390 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 -- 172.21.15.73:0/1155631611 >> 172.21.15.73:0/1155631611 conn(0x7f6b740b05a0 msgr2=0x7f6b740b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:05.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 -- 172.21.15.73:0/1155631611 shutdown_connections 2023-12-19T16:17:05.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.835+0000 7f6b796b6640 1 -- 172.21.15.73:0/1155631611 wait complete. 2023-12-19T16:17:05.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 Processor -- start 2023-12-19T16:17:05.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- start start 2023-12-19T16:17:05.845 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740c8f00 0x7f6b741469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 0x7f6b74146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b74138710 con 0x7f6b7406b440 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7414a6f0 con 0x7f6b74156d40 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7414a9d0 con 0x7f6b740c8f00 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52068/0 (socket says 172.21.15.73:52068) 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 -- 172.21.15.73:0/552353554 learned_addr learned my addr 172.21.15.73:0/552353554 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b6bfff640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740c8f00 0x7f6b741469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b737fe640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 0x7f6b74146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 -- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740c8f00 msgr2=0x7f6b741469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740c8f00 0x7f6b741469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 -- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 msgr2=0x7f6b74146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:05.846 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 0x7f6b74146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 -- 172.21.15.73:0/552353554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009b30 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b737fe640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 0x7f6b74146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b72ffd640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b410 tx=0x7f6b6400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64004020 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64004180 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7414acb0 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64011630 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7414b270 con 0x7f6b7406b440 2023-12-19T16:17:05.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.839+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7406f270 con 0x7f6b7406b440 2023-12-19T16:17:05.848 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.843+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b64011790 con 0x7f6b7406b440 2023-12-19T16:17:05.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.843+0000 7f6b6b7fe640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 0x7f6b54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:05.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.843+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6b64082ed0 con 0x7f6b7406b440 2023-12-19T16:17:05.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.843+0000 7f6b6bfff640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 0x7f6b54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:05.849 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.843+0000 7f6b6bfff640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 0x7f6b54067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b74157220 tx=0x7f6b5c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:05.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.847+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b7406f270 con 0x7f6b7406b440 2023-12-19T16:17:06.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b740cd510 con 0x7f6b7406b440 2023-12-19T16:17:06.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b6b7fe640 1 -- 172.21.15.73:0/552353554 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b64015020 con 0x7f6b7406b440 2023-12-19T16:17:06.001 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 msgr2=0x7f6b54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 0x7f6b54067f20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6b74157220 tx=0x7f6b5c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 msgr2=0x7f6b741381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b410 tx=0x7f6b6400b8d0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 shutdown_connections 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b74156d40 0x7f6b74146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b740c8f00 0x7f6b741469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b54065a60 0x7f6b54067f20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 --2- 172.21.15.73:0/552353554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b7406b440 0x7f6b741381d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 >> 172.21.15.73:0/552353554 conn(0x7f6b740b05a0 msgr2=0x7f6b740ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:06.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 shutdown_connections 2023-12-19T16:17:06.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:05.995+0000 7f6b796b6640 1 -- 172.21.15.73:0/552353554 wait complete. 2023-12-19T16:17:06.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:06.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 Processor -- start 2023-12-19T16:17:06.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 -- start start 2023-12-19T16:17:06.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 0x7ff63c06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff63c06b310 0x7ff63c15f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c070090 con 0x7ff63c06fb40 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c070370 con 0x7ff63c06b310 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff6412e5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c070650 con 0x7ff63c06af30 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff63c06b310 0x7ff63c15f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff63c06b310 0x7ff63c15f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52074/0 (socket says 172.21.15.73:52074) 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 -- 172.21.15.73:0/1163376519 learned_addr learned my addr 172.21.15.73:0/1163376519 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff63c06fb40 0x7ff63c071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35554/0 (socket says 172.21.15.73:35554) 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 -- 172.21.15.73:0/1163376519 >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 msgr2=0x7ff63c06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63affd640 1 --2- 172.21.15.73:0/1163376519 >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 0x7ff63c06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 --2- 172.21.15.73:0/1163376519 >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 0x7ff63c06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 -- 172.21.15.73:0/1163376519 >> v1:172.21.15.73:6789/0 conn(0x7ff63c06fb40 legacy=0x7ff63c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff639ffb640 1 -- 172.21.15.73:0/1163376519 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400870853 0 0) 0x7ff63c070090 con 0x7ff63c06fb40 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63b7fe640 1 -- 172.21.15.73:0/1163376519 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c070930 con 0x7ff63c06b310 2023-12-19T16:17:06.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.159+0000 7ff63affd640 1 --2- 172.21.15.73:0/1163376519 >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 0x7ff63c06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:06.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff63b7fe640 1 --2- 172.21.15.73:0/1163376519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06b310 0x7ff63c15f080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0cffc0 tx=0x7ff63401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19286a10f3f5b75f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff639ffb640 1 -- 172.21.15.73:0/1163376519 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340aa650 con 0x7ff63c06b310 2023-12-19T16:17:06.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff639ffb640 1 -- 172.21.15.73:0/1163376519 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6340aa7b0 con 0x7ff63c06b310 2023-12-19T16:17:06.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff639ffb640 1 -- 172.21.15.73:0/1163376519 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340aab40 con 0x7ff63c06b310 2023-12-19T16:17:06.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 -- 172.21.15.73:0/1163376519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06b310 msgr2=0x7ff63c15f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1163376519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06b310 0x7ff63c15f080 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0cffc0 tx=0x7ff63401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 -- 172.21.15.73:0/1163376519 shutdown_connections 2023-12-19T16:17:06.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1163376519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06b310 0x7ff63c15f080 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1163376519 >> v2:172.21.15.162:3300/0 conn(0x7ff63c06af30 0x7ff63c06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 -- 172.21.15.73:0/1163376519 >> 172.21.15.73:0/1163376519 conn(0x7ff63c0b0aa0 msgr2=0x7ff63c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:06.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 -- 172.21.15.73:0/1163376519 shutdown_connections 2023-12-19T16:17:06.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.163+0000 7ff6412e5640 1 -- 172.21.15.73:0/1163376519 wait complete. 2023-12-19T16:17:06.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 Processor -- start 2023-12-19T16:17:06.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- start start 2023-12-19T16:17:06.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff63c06b310 0x7ff63c09c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff63c06fb40 0x7ff63c15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c156690 con 0x7ff63c06af30 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0c4080 con 0x7ff63c06b310 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0c2fe0 con 0x7ff63c06fb40 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52088/0 (socket says 172.21.15.73:52088) 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 -- 172.21.15.73:0/1921260609 learned_addr learned my addr 172.21.15.73:0/1921260609 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63a7fc640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff63c06b310 0x7ff63c09c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63b7fe640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff63c06fb40 0x7ff63c15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 -- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff63c06fb40 msgr2=0x7ff63c15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff63c06fb40 0x7ff63c15a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 -- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff63c06b310 msgr2=0x7ff63c09c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff63c06b310 0x7ff63c09c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 -- 172.21.15.73:0/1921260609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340094d0 con 0x7ff63c06af30 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff63affd640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00cf60 tx=0x7ff62c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00d840 con 0x7ff63c06af30 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c00d9a0 con 0x7ff63c06af30 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c0c32c0 con 0x7ff63c06af30 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00dd30 con 0x7ff63c06af30 2023-12-19T16:17:06.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.167+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c0c3880 con 0x7ff63c06af30 2023-12-19T16:17:06.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c072750 con 0x7ff63c06af30 2023-12-19T16:17:06.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff62c015440 con 0x7ff63c06af30 2023-12-19T16:17:06.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff6337fe640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 0x7ff61c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff62c083c90 con 0x7ff63c06af30 2023-12-19T16:17:06.177 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff63a7fc640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 0x7ff61c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.171+0000 7ff63a7fc640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 0x7ff61c067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0cdc00 tx=0x7ff624007c10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.175+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff62c051600 con 0x7ff63c06af30 2023-12-19T16:17:06.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff63c0659e0 con 0x7ff63c06af30 2023-12-19T16:17:06.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6337fe640 1 -- 172.21.15.73:0/1921260609 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff62c01a020 con 0x7ff63c06af30 2023-12-19T16:17:06.332 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 msgr2=0x7ff61c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 0x7ff61c067f20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0cdc00 tx=0x7ff624007c10 comp rx=0 tx=0).stop 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 msgr2=0x7ff63c156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00cf60 tx=0x7ff62c00cf90 comp rx=0 tx=0).stop 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 shutdown_connections 2023-12-19T16:17:06.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff63c06fb40 0x7ff63c15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff63c06b310 0x7ff63c09c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff61c065a60 0x7ff61c067f20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 --2- 172.21.15.73:0/1921260609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff63c06af30 0x7ff63c156150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 >> 172.21.15.73:0/1921260609 conn(0x7ff63c0b0aa0 msgr2=0x7ff63c0ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 shutdown_connections 2023-12-19T16:17:06.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.327+0000 7ff6412e5640 1 -- 172.21.15.73:0/1921260609 wait complete. 2023-12-19T16:17:06.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:17:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 Processor -- start 2023-12-19T16:17:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 -- start start 2023-12-19T16:17:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 0x7f1c700cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 0x7f1c7006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c700d3b10 con 0x7f1c7015ce50 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7006a1d0 con 0x7f1c700d3700 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c77709640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700d0b60 con 0x7f1c700d18d0 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c754a5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1c7015ce50 0x7f1c700d11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35558/0 (socket says 172.21.15.73:35558) 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c754a5640 1 -- 172.21.15.73:0/188380053 learned_addr learned my addr 172.21.15.73:0/188380053 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c74ca4640 1 --2- 172.21.15.73:0/188380053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 0x7f1c700cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c75ca6640 1 --2- 172.21.15.73:0/188380053 >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 0x7f1c7006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c67fff640 1 -- 172.21.15.73:0/188380053 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853552449 0 0) 0x7f1c700d3b10 con 0x7f1c7015ce50 2023-12-19T16:17:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.487+0000 7f1c67fff640 1 -- 172.21.15.73:0/188380053 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c5c003530 con 0x7f1c7015ce50 2023-12-19T16:17:06.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c74ca4640 1 -- 172.21.15.73:0/188380053 >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 msgr2=0x7f1c7006ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:06.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c74ca4640 1 --2- 172.21.15.73:0/188380053 >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 0x7f1c7006ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c74ca4640 1 -- 172.21.15.73:0/188380053 >> v1:172.21.15.73:6789/0 conn(0x7f1c7015ce50 legacy=0x7f1c700d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c74ca4640 1 -- 172.21.15.73:0/188380053 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700d0e40 con 0x7f1c700d18d0 2023-12-19T16:17:06.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c75ca6640 1 --2- 172.21.15.73:0/188380053 >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 0x7f1c7006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c74ca4640 1 --2- 172.21.15.73:0/188380053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 0x7f1c700cfc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c600097c0 tx=0x7f1c6001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae4b20a0d375499 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c67fff640 1 -- 172.21.15.73:0/188380053 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600ac620 con 0x7f1c700d18d0 2023-12-19T16:17:06.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c67fff640 1 -- 172.21.15.73:0/188380053 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c600ac780 con 0x7f1c700d18d0 2023-12-19T16:17:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c67fff640 1 -- 172.21.15.73:0/188380053 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600acb10 con 0x7f1c700d18d0 2023-12-19T16:17:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 -- 172.21.15.73:0/188380053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 msgr2=0x7f1c700cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 --2- 172.21.15.73:0/188380053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 0x7f1c700cfc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c600097c0 tx=0x7f1c6001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.499 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 -- 172.21.15.73:0/188380053 shutdown_connections 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 --2- 172.21.15.73:0/188380053 >> v2:172.21.15.162:3300/0 conn(0x7f1c700d3700 0x7f1c7006ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 --2- 172.21.15.73:0/188380053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d18d0 0x7f1c700cfc20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.491+0000 7f1c77709640 1 -- 172.21.15.73:0/188380053 >> 172.21.15.73:0/188380053 conn(0x7f1c700d2be0 msgr2=0x7f1c700d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- 172.21.15.73:0/188380053 shutdown_connections 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- 172.21.15.73:0/188380053 wait complete. 2023-12-19T16:17:06.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 Processor -- start 2023-12-19T16:17:06.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- start start 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c700d18d0 0x7f1c700b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d3700 0x7f1c700cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015eb90 con 0x7f1c7015ce50 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015e3b0 con 0x7f1c700d18d0 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c77709640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7015e690 con 0x7f1c700d3700 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52098/0 (socket says 172.21.15.73:52098) 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 -- 172.21.15.73:0/2380594082 learned_addr learned my addr 172.21.15.73:0/2380594082 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c74ca4640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d3700 0x7f1c700cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c754a5640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c700d18d0 0x7f1c700b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 -- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d3700 msgr2=0x7f1c700cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d3700 0x7f1c700cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 -- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c700d18d0 msgr2=0x7f1c700b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c700d18d0 0x7f1c700b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 -- 172.21.15.73:0/2380594082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009a70 con 0x7f1c7015ce50 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.495+0000 7f1c75ca6640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800efc0 tx=0x7f1c68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68009d70 con 0x7f1c7015ce50 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800f040 con 0x7f1c7015ce50 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c680039a0 con 0x7f1c7015ce50 2023-12-19T16:17:06.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c60009420 con 0x7f1c7015ce50 2023-12-19T16:17:06.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7015f050 con 0x7f1c7015ce50 2023-12-19T16:17:06.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7015f240 con 0x7f1c7015ce50 2023-12-19T16:17:06.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c680144a0 con 0x7f1c7015ce50 2023-12-19T16:17:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 0x7f1c54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1c68083f20 con 0x7f1c7015ce50 2023-12-19T16:17:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.499+0000 7f1c754a5640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 0x7f1c54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.503+0000 7f1c754a5640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 0x7f1c54067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0011f0 tx=0x7f1c6c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:06.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.503+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1c680517e0 con 0x7f1c7015ce50 2023-12-19T16:17:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c70072750 con 0x7f1c7015ce50 2023-12-19T16:17:06.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c65ffb640 1 -- 172.21.15.73:0/2380594082 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) v1 ==== 80+0+124 (secure 0 0 0) 0x7f1c68018080 con 0x7f1c7015ce50 2023-12-19T16:17:06.672 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.162:6834/1495159950 2023-12-20T16:16:38.056671+0000 2023-12-19T16:17:06.672 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.162:6832/1495159950 2023-12-20T16:16:38.056671+0000 2023-12-19T16:17:06.672 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 msgr2=0x7f1c54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 0x7f1c54067f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0011f0 tx=0x7f1c6c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 msgr2=0x7f1c70157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800efc0 tx=0x7f1c68009f90 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 shutdown_connections 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1c54065a60 0x7f1c54067f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c7015ce50 0x7f1c70157ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c700d3700 0x7f1c700cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 --2- 172.21.15.73:0/2380594082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c700d18d0 0x7f1c700b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:06.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 >> 172.21.15.73:0/2380594082 conn(0x7f1c700d2be0 msgr2=0x7f1c700b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 shutdown_connections 2023-12-19T16:17:06.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.667+0000 7f1c77709640 1 -- 172.21.15.73:0/2380594082 wait complete. 2023-12-19T16:17:06.692 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T16:17:06.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:06.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:06.754 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:17:06.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:06.754 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:17:06.771 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:17:06.771 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:06.788 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:06.788 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:06.788 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:06.824 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:06.824 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:17:06.824 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:06.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:06.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:07.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 Processor -- start 2023-12-19T16:17:07.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 -- start start 2023-12-19T16:17:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae0c15cae0 0x7fae0c0d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0d2ff0 0x7fae0c0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0d3450 con 0x7fae0c0cd8c0 2023-12-19T16:17:07.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0d14e0 con 0x7fae0c15cae0 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae115bc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0ce390 con 0x7fae0c0d2ff0 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae0c15cae0 0x7fae0c0d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fae0c0cd8c0 0x7fae0c0b45a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35570/0 (socket says 172.21.15.73:35570) 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0b7fe640 1 -- 172.21.15.73:0/365076223 learned_addr learned my addr 172.21.15.73:0/365076223 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0a7fc640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0d2ff0 0x7fae0c0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0affd640 1 -- 172.21.15.73:0/365076223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0d2ff0 msgr2=0x7fae0c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0affd640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0d2ff0 0x7fae0c0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0affd640 1 -- 172.21.15.73:0/365076223 >> v1:172.21.15.73:6789/0 conn(0x7fae0c0cd8c0 legacy=0x7fae0c0b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae0affd640 1 -- 172.21.15.73:0/365076223 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0ce0b0 con 0x7fae0c15cae0 2023-12-19T16:17:07.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:06.999+0000 7fae09ffb640 1 -- 172.21.15.73:0/365076223 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287930724 0 0) 0x7fae0c0d3450 con 0x7fae0c0cd8c0 2023-12-19T16:17:07.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae0affd640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c0d2ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0097c0 tx=0x7fadfc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1e9b3d084a6e63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae09ffb640 1 -- 172.21.15.73:0/365076223 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0ac640 con 0x7fae0c15cae0 2023-12-19T16:17:07.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae09ffb640 1 -- 172.21.15.73:0/365076223 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0ac7a0 con 0x7fae0c15cae0 2023-12-19T16:17:07.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae09ffb640 1 -- 172.21.15.73:0/365076223 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0acb30 con 0x7fae0c15cae0 2023-12-19T16:17:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 -- 172.21.15.73:0/365076223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 msgr2=0x7fae0c0d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c0d2ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0097c0 tx=0x7fadfc01c3f0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 -- 172.21.15.73:0/365076223 shutdown_connections 2023-12-19T16:17:07.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0d2ff0 0x7fae0c0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 --2- 172.21.15.73:0/365076223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c0d2ab0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 -- 172.21.15.73:0/365076223 >> 172.21.15.73:0/365076223 conn(0x7fae0c06a590 msgr2=0x7fae0c06a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 -- 172.21.15.73:0/365076223 shutdown_connections 2023-12-19T16:17:07.010 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 -- 172.21.15.73:0/365076223 wait complete. 2023-12-19T16:17:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.003+0000 7fae115bc640 1 Processor -- start 2023-12-19T16:17:07.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- start start 2023-12-19T16:17:07.013 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0cd8c0 0x7fae0c0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 0x7fae0c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0c83f0 con 0x7fae0c15cae0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0b6290 con 0x7fae0c0d2ff0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c152610 con 0x7fae0c0cd8c0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0cd8c0 0x7fae0c0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52116/0 (socket says 172.21.15.73:52116) 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 -- 172.21.15.73:0/1753256220 learned_addr learned my addr 172.21.15.73:0/1753256220 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0a7fc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 0x7fae0c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 -- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0cd8c0 msgr2=0x7fae0c0b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0cd8c0 0x7fae0c0b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 -- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 msgr2=0x7fae0c142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.014 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 0x7fae0c142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 -- 172.21.15.73:0/1753256220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc009420 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0a7fc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 0x7fae0c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae0b7fe640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c700 tx=0x7fae0400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400ce10 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0400a640 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0400aa30 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c0c7770 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0c7d30 con 0x7fae0c15cae0 2023-12-19T16:17:07.015 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.007+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c0c8530 con 0x7fae0c15cae0 2023-12-19T16:17:07.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.011+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae0400ab90 con 0x7fae0c15cae0 2023-12-19T16:17:07.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.011+0000 7fadf37fe640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 0x7fadf8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.011+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fae04082690 con 0x7fae0c15cae0 2023-12-19T16:17:07.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.011+0000 7fae0affd640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 0x7fadf8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.011+0000 7fae0affd640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 0x7fadf8067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0ae000 tx=0x7fadfc0a6070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.015+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae0c0c8530 con 0x7fae0c15cae0 2023-12-19T16:17:07.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae0c0c8530 con 0x7fae0c15cae0 2023-12-19T16:17:07.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fadf37fe640 1 -- 172.21.15.73:0/1753256220 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fae0c0c8530 con 0x7fae0c15cae0 2023-12-19T16:17:07.200 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:07.200 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:42.078261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:07.201 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2023-12-19T16:17:07.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 msgr2=0x7fadf8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 0x7fadf8067f20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0ae000 tx=0x7fadfc0a6070 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 msgr2=0x7fae0c151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c700 tx=0x7fae0400cbc0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 shutdown_connections 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fadf8065a60 0x7fadf8067f20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae0c15cae0 0x7fae0c151790 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae0c0d2ff0 0x7fae0c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 --2- 172.21.15.73:0/1753256220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae0c0cd8c0 0x7fae0c0b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 >> 172.21.15.73:0/1753256220 conn(0x7fae0c06a590 msgr2=0x7fae0c0b8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 shutdown_connections 2023-12-19T16:17:07.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.195+0000 7fae115bc640 1 -- 172.21.15.73:0/1753256220 wait complete. 2023-12-19T16:17:07.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:07.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.351+0000 7f6788df0640 1 Processor -- start 2023-12-19T16:17:07.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.351+0000 7f6788df0640 1 -- start start 2023-12-19T16:17:07.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6788df0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f678415b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6788df0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67841436d0 con 0x7f67840ccd10 2023-12-19T16:17:07.361 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6788df0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840b3280 con 0x7f67840cc930 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6788df0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840b1ad0 con 0x7f678415b0f0 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6779d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f67840ccd10 0x7f67840b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35572/0 (socket says 172.21.15.73:35572) 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6779d9b640 1 -- 172.21.15.73:0/35612268 learned_addr learned my addr 172.21.15.73:0/35612268 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6782d9d640 1 --2- 172.21.15.73:0/35612268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f678415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031964634 0 0) 0x7f67841436d0 con 0x7f67840ccd10 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6770005740 con 0x7f67840ccd10 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501898624 0 0) 0x7f67840b3280 con 0x7f67840cc930 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6782d9d640 1 -- 172.21.15.73:0/35612268 >> v1:172.21.15.162:6789/0 conn(0x7f67840cc930 legacy=0x7f678415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6782d9d640 1 -- 172.21.15.73:0/35612268 >> v1:172.21.15.73:6789/0 conn(0x7f67840ccd10 legacy=0x7f67840b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.362 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.355+0000 7f6782d9d640 1 -- 172.21.15.73:0/35612268 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67840b1db0 con 0x7f678415b0f0 2023-12-19T16:17:07.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6782d9d640 1 --2- 172.21.15.73:0/35612268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f678415b560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f677c009dc0 tx=0x7f677c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b8543cb8644e1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0a5900 con 0x7f678415b0f0 2023-12-19T16:17:07.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0a5a60 con 0x7f678415b0f0 2023-12-19T16:17:07.364 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6781d9b640 1 -- 172.21.15.73:0/35612268 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0a5df0 con 0x7f678415b0f0 2023-12-19T16:17:07.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 -- 172.21.15.73:0/35612268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 msgr2=0x7f678415b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 --2- 172.21.15.73:0/35612268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f678415b560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f677c009dc0 tx=0x7f677c01c940 comp rx=0 tx=0).stop 2023-12-19T16:17:07.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 -- 172.21.15.73:0/35612268 shutdown_connections 2023-12-19T16:17:07.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 --2- 172.21.15.73:0/35612268 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f678415b560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 -- 172.21.15.73:0/35612268 >> 172.21.15.73:0/35612268 conn(0x7f6784069cc0 msgr2=0x7f678406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 -- 172.21.15.73:0/35612268 shutdown_connections 2023-12-19T16:17:07.366 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 -- 172.21.15.73:0/35612268 wait complete. 2023-12-19T16:17:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.359+0000 7f6788df0640 1 Processor -- start 2023-12-19T16:17:07.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- start start 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 0x7f678413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f6784155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840aab70 con 0x7f67840cc930 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784158cb0 con 0x7f67840ccd10 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840a9ef0 con 0x7f678415b0f0 2023-12-19T16:17:07.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52132/0 (socket says 172.21.15.73:52132) 2023-12-19T16:17:07.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 -- 172.21.15.73:0/3656314123 learned_addr learned my addr 172.21.15.73:0/3656314123 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6779d9b640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 0x7f678413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 -- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 msgr2=0x7f6784155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6782d9d640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f6784155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f6784155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.370 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 -- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 msgr2=0x7f678413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 0x7f678413f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 -- 172.21.15.73:0/3656314123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c009a70 con 0x7f67840cc930 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6779d9b640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 0x7f678413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6782d9d640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f6784155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f678259c640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f677400c4d0 tx=0x7f677400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774005480 con 0x7f67840cc930 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774003600 con 0x7f67840cc930 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840aa1d0 con 0x7f67840cc930 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67740039b0 con 0x7f67840cc930 2023-12-19T16:17:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67840aa790 con 0x7f67840cc930 2023-12-19T16:17:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67840aae90 con 0x7f67840cc930 2023-12-19T16:17:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.363+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6774003b10 con 0x7f67840cc930 2023-12-19T16:17:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.367+0000 7f677b7fe640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 0x7f6764067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.367+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f67740827d0 con 0x7f67840cc930 2023-12-19T16:17:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.367+0000 7f6779d9b640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 0x7f6764067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.367+0000 7f6779d9b640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 0x7f6764067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f67840cdb00 tx=0x7f676c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.371+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f67740501f0 con 0x7f67840cc930 2023-12-19T16:17:07.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.519+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67840aacb0 con 0x7f67840cc930 2023-12-19T16:17:07.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f677b7fe640 1 -- 172.21.15.73:0/3656314123 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16172 (secure 0 0 0) 0x7f67840aacb0 con 0x7f67840cc930 2023-12-19T16:17:07.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:07.527 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:38.056689+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6834/1495159950":"2023-12-20T16:16:38.056671+0000","172.21.15.162:6832/1495159950":"2023-12-20T16:16:38.056671+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 msgr2=0x7f6764067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 0x7f6764067f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f67840cdb00 tx=0x7f676c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 msgr2=0x7f6784157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f677400c4d0 tx=0x7f677400c990 comp rx=0 tx=0).stop 2023-12-19T16:17:07.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 shutdown_connections 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678415b0f0 0x7f6784155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67840ccd10 0x7f678413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6764065a60 0x7f6764067f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 --2- 172.21.15.73:0/3656314123 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67840cc930 0x7f6784157c40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 >> 172.21.15.73:0/3656314123 conn(0x7f6784069cc0 msgr2=0x7f678415a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 shutdown_connections 2023-12-19T16:17:07.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.523+0000 7f6788df0640 1 -- 172.21.15.73:0/3656314123 wait complete. 2023-12-19T16:17:07.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:16:28.706414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:16:29.833606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:07.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:07.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.683+0000 7f24db396640 1 Processor -- start 2023-12-19T16:17:07.690 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.683+0000 7f24db396640 1 -- start start 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24db396640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 0x7f24d40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24db396640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24d40ad700 0x7f24d40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24db396640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d40ae090 con 0x7f24d4070af0 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24db396640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d406c810 con 0x7f24d40ad700 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24db396640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d4070fa0 con 0x7f24d415ab60 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24d40ad700 0x7f24d40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d8931640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f24d4070af0 0x7f24d406c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35588/0 (socket says 172.21.15.73:35588) 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d8931640 1 -- 172.21.15.73:0/3814505812 learned_addr learned my addr 172.21.15.73:0/3814505812 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9132640 1 --2- 172.21.15.73:0/3814505812 >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 0x7f24d40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 -- 172.21.15.73:0/3814505812 >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 msgr2=0x7f24d40c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:07.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 --2- 172.21.15.73:0/3814505812 >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 0x7f24d40c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 -- 172.21.15.73:0/3814505812 >> v1:172.21.15.73:6789/0 conn(0x7f24d4070af0 legacy=0x7f24d406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 -- 172.21.15.73:0/3814505812 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4071280 con 0x7f24d40ad700 2023-12-19T16:17:07.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9132640 1 --2- 172.21.15.73:0/3814505812 >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 0x7f24d40c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:07.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24d9933640 1 --2- 172.21.15.73:0/3814505812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d40ad700 0x7f24d40adb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f24d40b1250 tx=0x7f24cc01f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1109ca08ef720e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24cbfff640 1 -- 172.21.15.73:0/3814505812 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0b0440 con 0x7f24d40ad700 2023-12-19T16:17:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24cbfff640 1 -- 172.21.15.73:0/3814505812 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc0b05a0 con 0x7f24d40ad700 2023-12-19T16:17:07.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.687+0000 7f24cbfff640 1 -- 172.21.15.73:0/3814505812 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc0b0930 con 0x7f24d40ad700 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- 172.21.15.73:0/3814505812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d40ad700 msgr2=0x7f24d40adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- 172.21.15.73:0/3814505812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d40ad700 0x7f24d40adb50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f24d40b1250 tx=0x7f24cc01f0f0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- 172.21.15.73:0/3814505812 shutdown_connections 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- 172.21.15.73:0/3814505812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d40ad700 0x7f24d40adb50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- 172.21.15.73:0/3814505812 >> v2:172.21.15.162:3300/0 conn(0x7f24d415ab60 0x7f24d40c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- 172.21.15.73:0/3814505812 >> 172.21.15.73:0/3814505812 conn(0x7f24d40b05a0 msgr2=0x7f24d40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- 172.21.15.73:0/3814505812 shutdown_connections 2023-12-19T16:17:07.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- 172.21.15.73:0/3814505812 wait complete. 2023-12-19T16:17:07.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 Processor -- start 2023-12-19T16:17:07.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- start start 2023-12-19T16:17:07.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d40ad700 0x7f24d415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 0x7f24d40aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d41f0240 con 0x7f24d4070af0 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415b750 con 0x7f24d40ad700 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24db396640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d415b480 con 0x7f24d415ab60 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24d9132640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24d9132640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52144/0 (socket says 172.21.15.73:52144) 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24d9132640 1 -- 172.21.15.73:0/1625660189 learned_addr learned my addr 172.21.15.73:0/1625660189 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24d8931640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d40ad700 0x7f24d415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.691+0000 7f24d9933640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 0x7f24d40aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 -- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 msgr2=0x7f24d40aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 0x7f24d40aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 -- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d40ad700 msgr2=0x7f24d415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d40ad700 0x7f24d415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 -- 172.21.15.73:0/1625660189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc009a70 con 0x7f24d4070af0 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9933640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 0x7f24d40aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d9132640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f24d000c7f0 tx=0x7f24d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0007820 con 0x7f24d4070af0 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d0007980 con 0x7f24d4070af0 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0007d30 con 0x7f24d4070af0 2023-12-19T16:17:07.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d415ce50 con 0x7f24d4070af0 2023-12-19T16:17:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d415d410 con 0x7f24d4070af0 2023-12-19T16:17:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4072750 con 0x7f24d4070af0 2023-12-19T16:17:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24d00113f0 con 0x7f24d4070af0 2023-12-19T16:17:07.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 0x7f24b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:07.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f24d00834a0 con 0x7f24d4070af0 2023-12-19T16:17:07.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.695+0000 7f24d8931640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 0x7f24b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:07.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.699+0000 7f24d8931640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 0x7f24b8067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24d415a380 tx=0x7f24c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:07.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.699+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f24d0050eb0 con 0x7f24d4070af0 2023-12-19T16:17:07.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24d40cbf30 con 0x7f24d4070af0 2023-12-19T16:17:07.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24c9ffb640 1 -- 172.21.15.73:0/1625660189 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24d00544d0 con 0x7f24d4070af0 2023-12-19T16:17:07.857 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 msgr2=0x7f24b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 0x7f24b8067f20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f24d415a380 tx=0x7f24c4009040 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 msgr2=0x7f24d415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f24d000c7f0 tx=0x7f24d000ccb0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 shutdown_connections 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24d415ab60 0x7f24d40aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d40ad700 0x7f24d415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f24b8065a60 0x7f24b8067f20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 --2- 172.21.15.73:0/1625660189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24d4070af0 0x7f24d415dc10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:07.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 >> 172.21.15.73:0/1625660189 conn(0x7f24d40b05a0 msgr2=0x7f24d415f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 shutdown_connections 2023-12-19T16:17:07.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:07.851+0000 7f24db396640 1 -- 172.21.15.73:0/1625660189 wait complete. 2023-12-19T16:17:07.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:17:08.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.011+0000 7f7ce882d640 1 Processor -- start 2023-12-19T16:17:08.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.011+0000 7f7ce882d640 1 -- start start 2023-12-19T16:17:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce882d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7ce406b440 0x7f7ce40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce882d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce40ae090 con 0x7f7ce40c9440 2023-12-19T16:17:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce882d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce406b8e0 con 0x7f7ce4156d40 2023-12-19T16:17:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce882d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce40c98f0 con 0x7f7ce406b440 2023-12-19T16:17:08.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce2d9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ce40c9440 0x7f7ce40cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35598/0 (socket says 172.21.15.73:35598) 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce2d9d640 1 -- 172.21.15.73:0/901517900 learned_addr learned my addr 172.21.15.73:0/901517900 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/901517900 >> v2:172.21.15.162:3300/0 conn(0x7f7ce406b440 0x7f7ce40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce1d9b640 1 -- 172.21.15.73:0/901517900 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736982292 0 0) 0x7f7ce40ae090 con 0x7f7ce40c9440 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7ce1d9b640 1 -- 172.21.15.73:0/901517900 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0003530 con 0x7f7ce40c9440 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7cdbfff640 1 -- 172.21.15.73:0/901517900 >> v1:172.21.15.162:6789/0 conn(0x7f7ce4156d40 legacy=0x7f7ce415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7cdbfff640 1 -- 172.21.15.73:0/901517900 >> v1:172.21.15.73:6789/0 conn(0x7f7ce40c9440 legacy=0x7f7ce40cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7cdbfff640 1 -- 172.21.15.73:0/901517900 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce406bbc0 con 0x7f7ce406b440 2023-12-19T16:17:08.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.015+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/901517900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce406b440 0x7f7ce40c8f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097c0 tx=0x7f7ccc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=410945798b3c8aee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce1d9b640 1 -- 172.21.15.73:0/901517900 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0ab600 con 0x7f7ce406b440 2023-12-19T16:17:08.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce1d9b640 1 -- 172.21.15.73:0/901517900 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc0a7050 con 0x7f7ce406b440 2023-12-19T16:17:08.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce1d9b640 1 -- 172.21.15.73:0/901517900 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0ab980 con 0x7f7ce406b440 2023-12-19T16:17:08.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- 172.21.15.73:0/901517900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce406b440 msgr2=0x7f7ce40c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 --2- 172.21.15.73:0/901517900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce406b440 0x7f7ce40c8f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097c0 tx=0x7f7ccc01c3f0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- 172.21.15.73:0/901517900 shutdown_connections 2023-12-19T16:17:08.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 --2- 172.21.15.73:0/901517900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce406b440 0x7f7ce40c8f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- 172.21.15.73:0/901517900 >> 172.21.15.73:0/901517900 conn(0x7f7ce40b05a0 msgr2=0x7f7ce40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- 172.21.15.73:0/901517900 shutdown_connections 2023-12-19T16:17:08.025 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- 172.21.15.73:0/901517900 wait complete. 2023-12-19T16:17:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 Processor -- start 2023-12-19T16:17:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- start start 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 0x7f7ce4148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ce4156d40 0x7f7ce40b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce406fcf0 con 0x7f7ce406b440 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce413ff40 con 0x7f7ce40c9440 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce882d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce414b160 con 0x7f7ce4156d40 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.019+0000 7f7ce259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52148/0 (socket says 172.21.15.73:52148) 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 -- 172.21.15.73:0/1536772028 learned_addr learned my addr 172.21.15.73:0/1536772028 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:08.028 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 0x7f7ce4148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce2d9d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ce4156d40 0x7f7ce40b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 -- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ce4156d40 msgr2=0x7f7ce40b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ce4156d40 0x7f7ce40b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 -- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 msgr2=0x7f7ce4148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 0x7f7ce4148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 -- 172.21.15.73:0/1536772028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc009420 con 0x7f7ce406b440 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 0x7f7ce4148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce259c640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c3c0 tx=0x7f7cd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40052d0 con 0x7f7ce406b440 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4005430 con 0x7f7ce406b440 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce414b440 con 0x7f7ce406b440 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4003840 con 0x7f7ce406b440 2023-12-19T16:17:08.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce406ff20 con 0x7f7ce406b440 2023-12-19T16:17:08.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce41582a0 con 0x7f7ce406b440 2023-12-19T16:17:08.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7cd40039a0 con 0x7f7ce406b440 2023-12-19T16:17:08.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 0x7f7cc4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.023+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7cd4082780 con 0x7f7ce406b440 2023-12-19T16:17:08.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.027+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 0x7f7cc4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.027+0000 7f7cdbfff640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 0x7f7cc4067f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0ad000 tx=0x7f7ccc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.027+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7cd4050040 con 0x7f7ce406b440 2023-12-19T16:17:08.184 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ce4072750 con 0x7f7ce406b440 2023-12-19T16:17:08.185 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7cdaffd640 1 -- 172.21.15.73:0/1536772028 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cd4053660 con 0x7f7ce406b440 2023-12-19T16:17:08.185 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 msgr2=0x7f7cc4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 0x7f7cc4067f50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0ad000 tx=0x7f7ccc008040 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 msgr2=0x7f7ce413fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c3c0 tx=0x7f7cd400c880 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 shutdown_connections 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7ce4156d40 0x7f7ce40b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ce40c9440 0x7f7ce4148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7cc4065a90 0x7f7cc4067f50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 --2- 172.21.15.73:0/1536772028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce406b440 0x7f7ce413fa00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 >> 172.21.15.73:0/1536772028 conn(0x7f7ce40b05a0 msgr2=0x7f7ce40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 shutdown_connections 2023-12-19T16:17:08.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.179+0000 7f7ce882d640 1 -- 172.21.15.73:0/1536772028 wait complete. 2023-12-19T16:17:08.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:17:08.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.339+0000 7f6e720c4640 1 Processor -- start 2023-12-19T16:17:08.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 -- start start 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6e6c070af0 0x7f6e6c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c06c640 0x7f6e6c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c070fa0 con 0x7f6e6c15ab60 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c071280 con 0x7f6e6c070af0 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e720c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c071560 con 0x7f6e6c06c640 2023-12-19T16:17:08.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52160/0 (socket says 172.21.15.73:52160) 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/3166483282 learned_addr learned my addr 172.21.15.73:0/3166483282 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6affd640 1 --2- 172.21.15.73:0/3166483282 >> v2:172.21.15.162:3300/0 conn(0x7f6e6c070af0 0x7f6e6c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6bfff640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c06c640 0x7f6e6c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/3166483282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c06c640 msgr2=0x7f6e6c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c06c640 0x7f6e6c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/3166483282 >> v2:172.21.15.162:3300/0 conn(0x7f6e6c070af0 msgr2=0x7f6e6c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/3166483282 >> v2:172.21.15.162:3300/0 conn(0x7f6e6c070af0 0x7f6e6c06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.350 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.343+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/3166483282 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0caaf0 con 0x7f6e6c15ab60 2023-12-19T16:17:08.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c06eb70 tx=0x7f6e5c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86483415c38863ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e6a7fc640 1 -- 172.21.15.73:0/3166483282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0ac630 con 0x7f6e6c15ab60 2023-12-19T16:17:08.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e6a7fc640 1 -- 172.21.15.73:0/3166483282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0ac790 con 0x7f6e6c15ab60 2023-12-19T16:17:08.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e6a7fc640 1 -- 172.21.15.73:0/3166483282 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0acb20 con 0x7f6e6c15ab60 2023-12-19T16:17:08.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- 172.21.15.73:0/3166483282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c15ab60 msgr2=0x7f6e6c0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c06eb70 tx=0x7f6e5c01c500 comp rx=0 tx=0).stop 2023-12-19T16:17:08.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- 172.21.15.73:0/3166483282 shutdown_connections 2023-12-19T16:17:08.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c06c640 0x7f6e6c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.353 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 --2- 172.21.15.73:0/3166483282 >> v2:172.21.15.162:3300/0 conn(0x7f6e6c070af0 0x7f6e6c06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 --2- 172.21.15.73:0/3166483282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c15ab60 0x7f6e6c0c8f00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- 172.21.15.73:0/3166483282 >> 172.21.15.73:0/3166483282 conn(0x7f6e6c0b05a0 msgr2=0x7f6e6c0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- 172.21.15.73:0/3166483282 shutdown_connections 2023-12-19T16:17:08.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- 172.21.15.73:0/3166483282 wait complete. 2023-12-19T16:17:08.354 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 Processor -- start 2023-12-19T16:17:08.355 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.347+0000 7f6e720c4640 1 -- start start 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 0x7f6e6c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 0x7f6e6c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0ce4b0 con 0x7f6e6c070af0 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cced0 con 0x7f6e6c0cc480 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cd1b0 con 0x7f6e6c15ab60 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.357 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52166/0 (socket says 172.21.15.73:52166) 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/4171104204 learned_addr learned my addr 172.21.15.73:0/4171104204 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6affd640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 0x7f6e6c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6bfff640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 0x7f6e6c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 msgr2=0x7f6e6c14c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 0x7f6e6c14c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 msgr2=0x7f6e6c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 0x7f6e6c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 -- 172.21.15.73:0/4171104204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0094d0 con 0x7f6e6c070af0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6affd640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 0x7f6e6c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6bfff640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 0x7f6e6c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e6b7fe640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c01a130 tx=0x7f6e5c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0b6640 con 0x7f6e6c070af0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c0b67c0 con 0x7f6e6c070af0 2023-12-19T16:17:08.358 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c0cd490 con 0x7f6e6c070af0 2023-12-19T16:17:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0b6b70 con 0x7f6e6c070af0 2023-12-19T16:17:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c0cda50 con 0x7f6e6c070af0 2023-12-19T16:17:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c072750 con 0x7f6e6c070af0 2023-12-19T16:17:08.359 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.351+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e5c0b6cd0 con 0x7f6e6c070af0 2023-12-19T16:17:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.355+0000 7f6e53fff640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 0x7f6e58067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.355+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6e5c11d540 con 0x7f6e6c070af0 2023-12-19T16:17:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.355+0000 7f6e6affd640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 0x7f6e58067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.355+0000 7f6e6affd640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 0x7f6e58067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c14f920 tx=0x7f6e60008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.363 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.359+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e5c0eaea0 con 0x7f6e6c070af0 2023-12-19T16:17:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.507+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e6c0cbf30 con 0x7f6e6c070af0 2023-12-19T16:17:08.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.507+0000 7f6e53fff640 1 -- 172.21.15.73:0/4171104204 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e5c0b10a0 con 0x7f6e6c070af0 2023-12-19T16:17:08.515 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:17:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 msgr2=0x7f6e58067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 0x7f6e58067f50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c14f920 tx=0x7f6e60008040 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 msgr2=0x7f6e6c0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c01a130 tx=0x7f6e5c0192a0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 shutdown_connections 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e6c0cc480 0x7f6e6c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e6c15ab60 0x7f6e6c14c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6e58065a90 0x7f6e58067f50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 --2- 172.21.15.73:0/4171104204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e6c070af0 0x7f6e6c0cdf70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 >> 172.21.15.73:0/4171104204 conn(0x7f6e6c0b05a0 msgr2=0x7f6e6c15eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 shutdown_connections 2023-12-19T16:17:08.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.511+0000 7f6e720c4640 1 -- 172.21.15.73:0/4171104204 wait complete. 2023-12-19T16:17:08.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:08.532 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:08.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.743+0000 7fed59d8f640 1 Processor -- start 2023-12-19T16:17:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.743+0000 7fed59d8f640 1 -- start start 2023-12-19T16:17:08.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed59d8f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed54144040 0x7fed5406b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed59d8f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 0x7fed540ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed59d8f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed540ce560 con 0x7fed5406b8e0 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed59d8f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540cd740 con 0x7fed54144040 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed59d8f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cd150 con 0x7fed540cdbd0 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed54144040 0x7fed5406b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed54144040 0x7fed5406b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52180/0 (socket says 172.21.15.73:52180) 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 -- 172.21.15.73:0/1172632881 learned_addr learned my addr 172.21.15.73:0/1172632881 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed53fff640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 0x7fed540ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 -- 172.21.15.73:0/1172632881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 msgr2=0x7fed540ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 0x7fed540ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 -- 172.21.15.73:0/1172632881 >> v1:172.21.15.162:6789/0 conn(0x7fed5406b8e0 legacy=0x7fed541615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed537fe640 1 -- 172.21.15.73:0/1172632881 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54162070 con 0x7fed54144040 2023-12-19T16:17:08.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.747+0000 7fed53fff640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 0x7fed540ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed537fe640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54144040 0x7fed5406b3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fed44009870 tx=0x7fed4401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2431e90900ada007 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed52ffd640 1 -- 172.21.15.73:0/1172632881 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440a9400 con 0x7fed54144040 2023-12-19T16:17:08.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed52ffd640 1 -- 172.21.15.73:0/1172632881 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440a9560 con 0x7fed54144040 2023-12-19T16:17:08.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed52ffd640 1 -- 172.21.15.73:0/1172632881 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440a98f0 con 0x7fed54144040 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- 172.21.15.73:0/1172632881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54144040 msgr2=0x7fed5406b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54144040 0x7fed5406b3a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fed44009870 tx=0x7fed4401c540 comp rx=0 tx=0).stop 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- 172.21.15.73:0/1172632881 shutdown_connections 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed540cdbd0 0x7fed540ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 --2- 172.21.15.73:0/1172632881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54144040 0x7fed5406b3a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- 172.21.15.73:0/1172632881 >> 172.21.15.73:0/1172632881 conn(0x7fed54069cc0 msgr2=0x7fed5406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- 172.21.15.73:0/1172632881 shutdown_connections 2023-12-19T16:17:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- 172.21.15.73:0/1172632881 wait complete. 2023-12-19T16:17:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 Processor -- start 2023-12-19T16:17:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.751+0000 7fed59d8f640 1 -- start start 2023-12-19T16:17:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 0x7fed5413d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed54144040 0x7fed54139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54139d70 con 0x7fed540cdbd0 2023-12-19T16:17:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5413a050 con 0x7fed5406b8e0 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5413a330 con 0x7fed54144040 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52194/0 (socket says 172.21.15.73:52194) 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 -- 172.21.15.73:0/662373804 learned_addr learned my addr 172.21.15.73:0/662373804 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed53fff640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed54144040 0x7fed54139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed537fe640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 0x7fed5413d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 -- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed54144040 msgr2=0x7fed54139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed54144040 0x7fed54139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 -- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 msgr2=0x7fed5413d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 0x7fed5413d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 -- 172.21.15.73:0/662373804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed440094d0 con 0x7fed540cdbd0 2023-12-19T16:17:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed537fe640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 0x7fed5413d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed4bfff640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00c500 tx=0x7fed3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c005220 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c005380 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54161e40 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c007270 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5413a8f0 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5413aae0 con 0x7fed540cdbd0 2023-12-19T16:17:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.755+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed3c0073d0 con 0x7fed540cdbd0 2023-12-19T16:17:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.759+0000 7fed50ff9640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 0x7fed34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.759+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fed3c082bb0 con 0x7fed540cdbd0 2023-12-19T16:17:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.759+0000 7fed537fe640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 0x7fed34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:08.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.759+0000 7fed537fe640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 0x7fed34067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed440b3040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:08.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.763+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed3c050480 con 0x7fed540cdbd0 2023-12-19T16:17:08.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed54072750 con 0x7fed540cdbd0 2023-12-19T16:17:08.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed50ff9640 1 -- 172.21.15.73:0/662373804 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fed3c053aa0 con 0x7fed540cdbd0 2023-12-19T16:17:08.948 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:08.948 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:42.078261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:08.948 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 msgr2=0x7fed34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 0x7fed34067f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed440b3040 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 msgr2=0x7fed5416b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00c500 tx=0x7fed3c00c9c0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 shutdown_connections 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed54144040 0x7fed54139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fed34065a60 0x7fed34067f20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed540cdbd0 0x7fed5416b930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 --2- 172.21.15.73:0/662373804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed5406b8e0 0x7fed5413d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 >> 172.21.15.73:0/662373804 conn(0x7fed54069cc0 msgr2=0x7fed5406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 shutdown_connections 2023-12-19T16:17:08.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:08.943+0000 7fed59d8f640 1 -- 172.21.15.73:0/662373804 wait complete. 2023-12-19T16:17:08.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.099+0000 7f8011695640 1 Processor -- start 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.099+0000 7f8011695640 1 -- start start 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f8011695640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f800c0c56d0 0x7f800c0c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f8011695640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f800c065bd0 0x7f800c0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f8011695640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c0c30b0 con 0x7f800c0cdc00 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f8011695640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0ad1f0 con 0x7f800c065bd0 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f8011695640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06fd70 con 0x7f800c0c56d0 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f800c065bd0 0x7f800c0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f800c065bd0 0x7f800c0accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52196/0 (socket says 172.21.15.73:52196) 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 -- 172.21.15.73:0/290563898 learned_addr learned my addr 172.21.15.73:0/290563898 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f800affd640 1 --2- 172.21.15.73:0/290563898 >> v2:172.21.15.162:3300/0 conn(0x7f800c0c56d0 0x7f800c0c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 -- 172.21.15.73:0/290563898 >> v2:172.21.15.162:3300/0 conn(0x7f800c0c56d0 msgr2=0x7f800c0c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 --2- 172.21.15.73:0/290563898 >> v2:172.21.15.162:3300/0 conn(0x7f800c0c56d0 0x7f800c0c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 -- 172.21.15.73:0/290563898 >> v1:172.21.15.162:6789/0 conn(0x7f800c0cdc00 legacy=0x7f800c070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.103+0000 7f80027fc640 1 -- 172.21.15.73:0/290563898 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c070050 con 0x7f800c065bd0 2023-12-19T16:17:09.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f80027fc640 1 --2- 172.21.15.73:0/290563898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c065bd0 0x7f800c0accb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f800c04e6d0 tx=0x7f7ffc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b50c8d0bc58584 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f800a7fc640 1 -- 172.21.15.73:0/290563898 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0aa620 con 0x7f800c065bd0 2023-12-19T16:17:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f800a7fc640 1 -- 172.21.15.73:0/290563898 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc0aa780 con 0x7f800c065bd0 2023-12-19T16:17:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f800a7fc640 1 -- 172.21.15.73:0/290563898 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc0aab10 con 0x7f800c065bd0 2023-12-19T16:17:09.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- 172.21.15.73:0/290563898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c065bd0 msgr2=0x7f800c0accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 --2- 172.21.15.73:0/290563898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c065bd0 0x7f800c0accb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f800c04e6d0 tx=0x7f7ffc01c4c0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- 172.21.15.73:0/290563898 shutdown_connections 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 --2- 172.21.15.73:0/290563898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c065bd0 0x7f800c0accb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 --2- 172.21.15.73:0/290563898 >> v2:172.21.15.162:3300/0 conn(0x7f800c0c56d0 0x7f800c0c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- 172.21.15.73:0/290563898 >> 172.21.15.73:0/290563898 conn(0x7f800c0b0b10 msgr2=0x7f800c0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- 172.21.15.73:0/290563898 shutdown_connections 2023-12-19T16:17:09.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- 172.21.15.73:0/290563898 wait complete. 2023-12-19T16:17:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 Processor -- start 2023-12-19T16:17:09.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.107+0000 7f8011695640 1 -- start start 2023-12-19T16:17:09.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c065bd0 0x7f800c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0c56d0 0x7f800c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0ca4d0 con 0x7f800c0cdc00 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0c9670 con 0x7f800c065bd0 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0c98c0 con 0x7f800c0c56d0 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52208/0 (socket says 172.21.15.73:52208) 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 -- 172.21.15.73:0/452005695 learned_addr learned my addr 172.21.15.73:0/452005695 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800affd640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c065bd0 0x7f800c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f80027fc640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0c56d0 0x7f800c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 -- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0c56d0 msgr2=0x7f800c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0c56d0 0x7f800c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 -- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c065bd0 msgr2=0x7f800c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c065bd0 0x7f800c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 -- 172.21.15.73:0/452005695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0094d0 con 0x7f800c0cdc00 2023-12-19T16:17:09.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f800b7fe640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f800400c780 tx=0x7f800400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004004b70 con 0x7f800c0cdc00 2023-12-19T16:17:09.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400ce90 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400a850 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c0c9ba0 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c0ca160 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c15cc30 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.111+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f800400a9b0 con 0x7f800c0cdc00 2023-12-19T16:17:09.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.115+0000 7f8003fff640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 0x7f7fec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.115+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8004083320 con 0x7f800c0cdc00 2023-12-19T16:17:09.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.115+0000 7f800affd640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 0x7f7fec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.115+0000 7f800affd640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 0x7f7fec067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4007a60 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.119+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8004050c90 con 0x7f800c0cdc00 2023-12-19T16:17:09.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.267+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f800c072750 con 0x7f800c0cdc00 2023-12-19T16:17:09.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.267+0000 7f8003fff640 1 -- 172.21.15.73:0/452005695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16172 (secure 0 0 0) 0x7f80040542b0 con 0x7f800c0cdc00 2023-12-19T16:17:09.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:09.274 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:38.056689+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6834/1495159950":"2023-12-20T16:16:38.056671+0000","172.21.15.162:6832/1495159950":"2023-12-20T16:16:38.056671+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 msgr2=0x7f7fec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 0x7f7fec067f20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4007a60 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 msgr2=0x7f800c0cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f800400c780 tx=0x7f800400cc40 comp rx=0 tx=0).stop 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 shutdown_connections 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7fec065a60 0x7f7fec067f20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800c0cdc00 0x7f800c0cb200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f800c0c56d0 0x7f800c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.276 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 --2- 172.21.15.73:0/452005695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f800c065bd0 0x7f800c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 >> 172.21.15.73:0/452005695 conn(0x7f800c0b0b10 msgr2=0x7f800c0ac780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 shutdown_connections 2023-12-19T16:17:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.271+0000 7f8011695640 1 -- 172.21.15.73:0/452005695 wait complete. 2023-12-19T16:17:09.295 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:17:09.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:09.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.427+0000 7f38ceb52640 1 Processor -- start 2023-12-19T16:17:09.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.427+0000 7f38ceb52640 1 -- start start 2023-12-19T16:17:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 0x7f38c80cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38c80cc660 0x7f38c80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 0x7f38c815e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80b1100 con 0x7f38c80cc660 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c80ce020 con 0x7f38c80b0c70 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38ceb52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80cb130 con 0x7f38c815a8d0 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38c80cc660 0x7f38c80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38c80cc660 0x7f38c80b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52210/0 (socket says 172.21.15.73:52210) 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 -- 172.21.15.73:0/2832304799 learned_addr learned my addr 172.21.15.73:0/2832304799 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 -- 172.21.15.73:0/2832304799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 msgr2=0x7f38c80cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38cc8ee640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 0x7f38c80cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38cd0ef640 1 --2- 172.21.15.73:0/2832304799 >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 0x7f38c815e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 0x7f38c80cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 -- 172.21.15.73:0/2832304799 >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 msgr2=0x7f38c815e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 --2- 172.21.15.73:0/2832304799 >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 0x7f38c815e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38bffff640 1 -- 172.21.15.73:0/2832304799 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80cd410 con 0x7f38c80cc660 2023-12-19T16:17:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38cd0ef640 1 --2- 172.21.15.73:0/2832304799 >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 0x7f38c815e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:09.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.431+0000 7f38cc8ee640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 0x7f38c80cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38bffff640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c80cc660 0x7f38c80b0730 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f38c80b3d60 tx=0x7f38b801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5aec3e872c76242 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38bf7fe640 1 -- 172.21.15.73:0/2832304799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80ab600 con 0x7f38c80cc660 2023-12-19T16:17:09.439 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38bf7fe640 1 -- 172.21.15.73:0/2832304799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b80a7050 con 0x7f38c80cc660 2023-12-19T16:17:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38bf7fe640 1 -- 172.21.15.73:0/2832304799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80ab980 con 0x7f38c80cc660 2023-12-19T16:17:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- 172.21.15.73:0/2832304799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c80cc660 msgr2=0x7f38c80b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c80cc660 0x7f38c80b0730 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f38c80b3d60 tx=0x7f38b801c180 comp rx=0 tx=0).stop 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- 172.21.15.73:0/2832304799 shutdown_connections 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 --2- 172.21.15.73:0/2832304799 >> v2:172.21.15.162:3300/0 conn(0x7f38c80b0c70 0x7f38c815e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c80cc660 0x7f38c80b0730 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 --2- 172.21.15.73:0/2832304799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c815a8d0 0x7f38c80cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- 172.21.15.73:0/2832304799 >> 172.21.15.73:0/2832304799 conn(0x7f38c8069cc0 msgr2=0x7f38c806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- 172.21.15.73:0/2832304799 shutdown_connections 2023-12-19T16:17:09.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- 172.21.15.73:0/2832304799 wait complete. 2023-12-19T16:17:09.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 Processor -- start 2023-12-19T16:17:09.442 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.435+0000 7f38ceb52640 1 -- start start 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c80b0c70 0x7f38c8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38c80cc660 0x7f38c80b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81f8630 con 0x7f38c815a8d0 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81f88d0 con 0x7f38c80cc660 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c81f8bb0 con 0x7f38c80b0c70 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52222/0 (socket says 172.21.15.73:52222) 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 -- 172.21.15.73:0/4013333390 learned_addr learned my addr 172.21.15.73:0/4013333390 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38bffff640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38c80cc660 0x7f38c80b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cc8ee640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c80b0c70 0x7f38c8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 -- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c80b0c70 msgr2=0x7f38c8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c80b0c70 0x7f38c8153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 -- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38c80cc660 msgr2=0x7f38c80b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38c80cc660 0x7f38c80b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 -- 172.21.15.73:0/4013333390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80094d0 con 0x7f38c815a8d0 2023-12-19T16:17:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38cd0ef640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38c000cd10 tx=0x7f38c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000f680 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000f800 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c81f8e90 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000fbb0 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c80b1d70 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8072750 con 0x7f38c815a8d0 2023-12-19T16:17:09.446 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.439+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f38c000b040 con 0x7f38c815a8d0 2023-12-19T16:17:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.443+0000 7f38bd7fa640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 0x7f38b4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.443+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f38c0083aa0 con 0x7f38c815a8d0 2023-12-19T16:17:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.443+0000 7f38cc8ee640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 0x7f38b4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.443+0000 7f38cc8ee640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 0x7f38b4067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38c400ab60 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.447+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f38c0051410 con 0x7f38c815a8d0 2023-12-19T16:17:09.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.627+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38c81f9340 con 0x7f38c815a8d0 2023-12-19T16:17:09.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.627+0000 7f38bd7fa640 1 -- 172.21.15.73:0/4013333390 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4710 (secure 0 0 0) 0x7f38c0054a30 con 0x7f38c815a8d0 2023-12-19T16:17:09.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:09.634 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:42.078261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:09.634 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2023-12-19T16:17:09.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 msgr2=0x7f38b4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 0x7f38b4067f20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f38c400ab60 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 msgr2=0x7f38c80c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f38c000cd10 tx=0x7f38c000a650 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 shutdown_connections 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f38b4065a60 0x7f38b4067f20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38c815a8d0 0x7f38c80c8f00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38c80cc660 0x7f38c80b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 --2- 172.21.15.73:0/4013333390 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38c80b0c70 0x7f38c8153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 >> 172.21.15.73:0/4013333390 conn(0x7f38c8069cc0 msgr2=0x7f38c80cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 shutdown_connections 2023-12-19T16:17:09.636 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.631+0000 7f38ceb52640 1 -- 172.21.15.73:0/4013333390 wait complete. 2023-12-19T16:17:09.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:09.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 Processor -- start 2023-12-19T16:17:09.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 -- start start 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4580b3890 0x7fb4580b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4580b3160 0x7fb45806b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580ce200 con 0x7fb45815cd20 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580ce4e0 con 0x7fb4580b3160 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb460798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b3cf0 con 0x7fb4580b3890 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4580b3160 0x7fb45806b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb4580b3160 0x7fb45806b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52228/0 (socket says 172.21.15.73:52228) 2023-12-19T16:17:09.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45e534640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb45815cd20 0x7fb4580cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35612/0 (socket says 172.21.15.73:35612) 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 -- 172.21.15.73:0/179922448 learned_addr learned my addr 172.21.15.73:0/179922448 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45dd33640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4580b3890 0x7fb4580b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 -- 172.21.15.73:0/179922448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4580b3890 msgr2=0x7fb4580b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4580b3890 0x7fb4580b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 -- 172.21.15.73:0/179922448 >> v1:172.21.15.73:6789/0 conn(0x7fb45815cd20 legacy=0x7fb4580cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.787+0000 7fb45ed35640 1 -- 172.21.15.73:0/179922448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580b2140 con 0x7fb4580b3160 2023-12-19T16:17:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb45ed35640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3160 0x7fb45806b3a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb450009e50 tx=0x7fb45001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c600e731b6273d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb45d532640 1 -- 172.21.15.73:0/179922448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500a5750 con 0x7fb4580b3160 2023-12-19T16:17:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb45d532640 1 -- 172.21.15.73:0/179922448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4500a58b0 con 0x7fb4580b3160 2023-12-19T16:17:09.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb45d532640 1 -- 172.21.15.73:0/179922448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4500a5c40 con 0x7fb4580b3160 2023-12-19T16:17:09.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 -- 172.21.15.73:0/179922448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3160 msgr2=0x7fb45806b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3160 0x7fb45806b3a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb450009e50 tx=0x7fb45001c980 comp rx=0 tx=0).stop 2023-12-19T16:17:09.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 -- 172.21.15.73:0/179922448 shutdown_connections 2023-12-19T16:17:09.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4580b3890 0x7fb4580b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 --2- 172.21.15.73:0/179922448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3160 0x7fb45806b3a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 -- 172.21.15.73:0/179922448 >> 172.21.15.73:0/179922448 conn(0x7fb458069cc0 msgr2=0x7fb45806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 -- 172.21.15.73:0/179922448 shutdown_connections 2023-12-19T16:17:09.799 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.791+0000 7fb460798640 1 -- 172.21.15.73:0/179922448 wait complete. 2023-12-19T16:17:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 Processor -- start 2023-12-19T16:17:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- start start 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4580b3160 0x7fb45815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb45815cd20 0x7fb458154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b2800 con 0x7fb4580b3890 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458158260 con 0x7fb4580b3160 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a290 con 0x7fb45815cd20 2023-12-19T16:17:09.802 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52234/0 (socket says 172.21.15.73:52234) 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 -- 172.21.15.73:0/4127160 learned_addr learned my addr 172.21.15.73:0/4127160 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45e534640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4580b3160 0x7fb45815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45ed35640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb45815cd20 0x7fb458154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 -- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb45815cd20 msgr2=0x7fb458154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb45815cd20 0x7fb458154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 -- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4580b3160 msgr2=0x7fb45815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4580b3160 0x7fb45815efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 -- 172.21.15.73:0/4127160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450009b30 con 0x7fb4580b3890 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb45dd33640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d830 tx=0x7fb44800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800b6c0 con 0x7fb4580b3890 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800b820 con 0x7fb4580b3890 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458159c60 con 0x7fb4580b3890 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800bb90 con 0x7fb4580b3890 2023-12-19T16:17:09.803 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.795+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45815f9a0 con 0x7fb4580b3890 2023-12-19T16:17:09.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45815a420 con 0x7fb4580b3890 2023-12-19T16:17:09.804 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb44800bcf0 con 0x7fb4580b3890 2023-12-19T16:17:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb44effd640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 0x7fb43c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb4480837f0 con 0x7fb4580b3890 2023-12-19T16:17:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb45e534640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 0x7fb43c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:09.805 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.799+0000 7fb45e534640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 0x7fb43c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb454000f70 tx=0x7fb454007c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:09.808 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.803+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb4480510b0 con 0x7fb4580b3890 2023-12-19T16:17:09.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4580b1d80 con 0x7fb4580b3890 2023-12-19T16:17:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb44effd640 1 -- 172.21.15.73:0/4127160 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4710 (secure 0 0 0) 0x7fb4480546d0 con 0x7fb4580b3890 2023-12-19T16:17:09.989 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:09.989 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:16:30.837561+0000","modified":"2023-12-19T16:16:42.078261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5196},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5196":{"gid":5196,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6833/1689540958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1689540958},{"type":"v1","addr":"172.21.15.162:6833","nonce":1689540958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T16:17:09.989 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 22 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 msgr2=0x7fb43c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 0x7fb43c067f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb454000f70 tx=0x7fb454007c90 comp rx=0 tx=0).stop 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 msgr2=0x7fb458157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d830 tx=0x7fb44800dcf0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 shutdown_connections 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb45815cd20 0x7fb458154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb43c065a60 0x7fb43c067f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4580b3890 0x7fb458157d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 --2- 172.21.15.73:0/4127160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4580b3160 0x7fb45815efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:09.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.983+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 >> 172.21.15.73:0/4127160 conn(0x7fb458069cc0 msgr2=0x7fb458158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:09.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.987+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 shutdown_connections 2023-12-19T16:17:09.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:09.987+0000 7fb460798640 1 -- 172.21.15.73:0/4127160 wait complete. 2023-12-19T16:17:10.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 Processor -- start 2023-12-19T16:17:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 -- start start 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f57300cc930 0x7f573015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f573015b0f0 0x7f573015b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57301436d0 con 0x7f57300ccd10 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573015aef0 con 0x7f573015b0f0 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f573868c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57300b3280 con 0x7f57300cc930 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.143+0000 7f5736c29640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f573015b0f0 0x7f573015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f573015b0f0 0x7f573015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52246/0 (socket says 172.21.15.73:52246) 2023-12-19T16:17:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 -- 172.21.15.73:0/3340074349 learned_addr learned my addr 172.21.15.73:0/3340074349 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736428640 1 --2- 172.21.15.73:0/3340074349 >> v2:172.21.15.162:3300/0 conn(0x7f57300cc930 0x7f573015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 -- 172.21.15.73:0/3340074349 >> v2:172.21.15.162:3300/0 conn(0x7f57300cc930 msgr2=0x7f573015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 --2- 172.21.15.73:0/3340074349 >> v2:172.21.15.162:3300/0 conn(0x7f57300cc930 0x7f573015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 -- 172.21.15.73:0/3340074349 >> v1:172.21.15.162:6789/0 conn(0x7f57300ccd10 legacy=0x7f57300b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 -- 172.21.15.73:0/3340074349 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57300b1ad0 con 0x7f573015b0f0 2023-12-19T16:17:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5736c29640 1 --2- 172.21.15.73:0/3340074349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f573015b0f0 0x7f573015b520 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f573006a900 tx=0x7f572801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746ac071475774f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5735426640 1 -- 172.21.15.73:0/3340074349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280a5860 con 0x7f573015b0f0 2023-12-19T16:17:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5735426640 1 -- 172.21.15.73:0/3340074349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280a59c0 con 0x7f573015b0f0 2023-12-19T16:17:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.147+0000 7f5735426640 1 -- 172.21.15.73:0/3340074349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280a5d50 con 0x7f573015b0f0 2023-12-19T16:17:10.155 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- 172.21.15.73:0/3340074349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f573015b0f0 msgr2=0x7f573015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- 172.21.15.73:0/3340074349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f573015b0f0 0x7f573015b520 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f573006a900 tx=0x7f572801c9a0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- 172.21.15.73:0/3340074349 shutdown_connections 2023-12-19T16:17:10.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- 172.21.15.73:0/3340074349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f573015b0f0 0x7f573015b520 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- 172.21.15.73:0/3340074349 >> v2:172.21.15.162:3300/0 conn(0x7f57300cc930 0x7f573015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- 172.21.15.73:0/3340074349 >> 172.21.15.73:0/3340074349 conn(0x7f5730069cc0 msgr2=0x7f573006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- 172.21.15.73:0/3340074349 shutdown_connections 2023-12-19T16:17:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- 172.21.15.73:0/3340074349 wait complete. 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 Processor -- start 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- start start 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57300ccd10 0x7f5730141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573015b0f0 0x7f5730142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.161 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730138bb0 con 0x7f57300cc930 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730138e90 con 0x7f573015b0f0 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f573868c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5730139170 con 0x7f57300ccd10 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52256/0 (socket says 172.21.15.73:52256) 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 -- 172.21.15.73:0/3455493542 learned_addr learned my addr 172.21.15.73:0/3455493542 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736c29640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573015b0f0 0x7f5730142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5735c27640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57300ccd10 0x7f5730141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 -- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57300ccd10 msgr2=0x7f5730141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57300ccd10 0x7f5730141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 -- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573015b0f0 msgr2=0x7f5730142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573015b0f0 0x7f5730142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.151+0000 7f5736428640 1 -- 172.21.15.73:0/3455493542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728009b30 con 0x7f57300cc930 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5736428640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e870 tx=0x7f572c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c009510 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00eec0 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5730139450 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00cb40 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57301599b0 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5730072750 con 0x7f57300cc930 2023-12-19T16:17:10.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f572c00ccc0 con 0x7f57300cc930 2023-12-19T16:17:10.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 0x7f5714067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f572c083260 con 0x7f57300cc930 2023-12-19T16:17:10.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5735c27640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 0x7f5714067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.155+0000 7f5735c27640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 0x7f5714067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f57301f90d0 tx=0x7f5720009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.166 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.159+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f572c050c70 con 0x7f57300cc930 2023-12-19T16:17:10.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.311+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f573013e200 con 0x7f57300cc930 2023-12-19T16:17:10.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.311+0000 7f5726ffd640 1 -- 172.21.15.73:0/3455493542 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16172 (secure 0 0 0) 0x7f572c054290 con 0x7f57300cc930 2023-12-19T16:17:10.319 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:10.320 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":40,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:16:38.056689+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:16:28.706414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T16:16:29.833606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6834/1495159950":"2023-12-20T16:16:38.056671+0000","172.21.15.162:6832/1495159950":"2023-12-20T16:16:38.056671+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 msgr2=0x7f5714067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 0x7f5714067f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f57301f90d0 tx=0x7f5720009040 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 msgr2=0x7f5730159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f572c00e870 tx=0x7f572c00ec70 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 shutdown_connections 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f573015b0f0 0x7f5730142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57300ccd10 0x7f5730141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5714065a60 0x7f5714067f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 --2- 172.21.15.73:0/3455493542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57300cc930 0x7f5730159470 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 >> 172.21.15.73:0/3455493542 conn(0x7f5730069cc0 msgr2=0x7f5730159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 shutdown_connections 2023-12-19T16:17:10.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.315+0000 7f573868c640 1 -- 172.21.15.73:0/3455493542 wait complete. 2023-12-19T16:17:10.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.475+0000 7fbfa4266640 1 Processor -- start 2023-12-19T16:17:10.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.475+0000 7fbfa4266640 1 -- start start 2023-12-19T16:17:10.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa4266640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbf9c0d1790 0x7fbf9c0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa4266640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0d39e0 con 0x7fbf9c0d13b0 2023-12-19T16:17:10.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa4266640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c06a1d0 con 0x7fbf9c15d190 2023-12-19T16:17:10.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa4266640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c06a470 con 0x7fbf9c0d1790 2023-12-19T16:17:10.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2002640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbf9c0d13b0 0x7fbf9c15ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35622/0 (socket says 172.21.15.73:35622) 2023-12-19T16:17:10.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2002640 1 -- 172.21.15.73:0/2948938530 learned_addr learned my addr 172.21.15.73:0/2948938530 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:10.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2803640 1 --2- 172.21.15.73:0/2948938530 >> v2:172.21.15.162:3300/0 conn(0x7fbf9c0d1790 0x7fbf9c0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681950877 0 0) 0x7fbf9c06a1d0 con 0x7fbf9c15d190 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf88003530 con 0x7fbf9c15d190 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711831097 0 0) 0x7fbf9c0d39e0 con 0x7fbf9c0d13b0 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c06a1d0 con 0x7fbf9c0d13b0 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2803640 1 -- 172.21.15.73:0/2948938530 >> v1:172.21.15.162:6789/0 conn(0x7fbf9c15d190 legacy=0x7fbf9c06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2803640 1 -- 172.21.15.73:0/2948938530 >> v1:172.21.15.73:6789/0 conn(0x7fbf9c0d13b0 legacy=0x7fbf9c15ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.479+0000 7fbfa2803640 1 -- 172.21.15.73:0/2948938530 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c06a750 con 0x7fbf9c0d1790 2023-12-19T16:17:10.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa2803640 1 --2- 172.21.15.73:0/2948938530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0d0950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009d90 tx=0x7fbf9401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6cee84558adcf5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf940af600 con 0x7fbf9c0d1790 2023-12-19T16:17:10.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf940ab050 con 0x7fbf9c0d1790 2023-12-19T16:17:10.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa1000640 1 -- 172.21.15.73:0/2948938530 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf940af960 con 0x7fbf9c0d1790 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 -- 172.21.15.73:0/2948938530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d1790 msgr2=0x7fbf9c0d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 --2- 172.21.15.73:0/2948938530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0d0950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf94009d90 tx=0x7fbf9401f130 comp rx=0 tx=0).stop 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 -- 172.21.15.73:0/2948938530 shutdown_connections 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 --2- 172.21.15.73:0/2948938530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0d0950 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 -- 172.21.15.73:0/2948938530 >> 172.21.15.73:0/2948938530 conn(0x7fbf9c0d2b70 msgr2=0x7fbf9c0d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 -- 172.21.15.73:0/2948938530 shutdown_connections 2023-12-19T16:17:10.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 -- 172.21.15.73:0/2948938530 wait complete. 2023-12-19T16:17:10.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.483+0000 7fbfa4266640 1 Processor -- start 2023-12-19T16:17:10.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- start start 2023-12-19T16:17:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 0x7fbf9c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf9c15d190 0x7fbf9c1f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c09e070 con 0x7fbf9c0d1790 2023-12-19T16:17:10.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c9310 con 0x7fbf9c0d13b0 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c09d7d0 con 0x7fbf9c15d190 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52264/0 (socket says 172.21.15.73:52264) 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 -- 172.21.15.73:0/3779394764 learned_addr learned my addr 172.21.15.73:0/3779394764 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa2002640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 0x7fbf9c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa2803640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf9c15d190 0x7fbf9c1f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 -- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf9c15d190 msgr2=0x7fbf9c1f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf9c15d190 0x7fbf9c1f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 -- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 msgr2=0x7fbf9c15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 0x7fbf9c15b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 -- 172.21.15.73:0/3779394764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009a70 con 0x7fbf9c0d1790 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa2002640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 0x7fbf9c15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa1801640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0010f0 tx=0x7fbf8c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0052d0 con 0x7fbf9c0d1790 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c005430 con 0x7fbf9c0d1790 2023-12-19T16:17:10.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c003820 con 0x7fbf9c0d1790 2023-12-19T16:17:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c09dab0 con 0x7fbf9c0d1790 2023-12-19T16:17:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c1f5710 con 0x7fbf9c0d1790 2023-12-19T16:17:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.487+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c1f5570 con 0x7fbf9c0d1790 2023-12-19T16:17:10.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.491+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbf8c003980 con 0x7fbf9c0d1790 2023-12-19T16:17:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.491+0000 7fbf927fc640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 0x7fbf80067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.491+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbf8c0827a0 con 0x7fbf9c0d1790 2023-12-19T16:17:10.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.491+0000 7fbfa2002640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 0x7fbf80067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.491+0000 7fbfa2002640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 0x7fbf80067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf98005890 tx=0x7fbf98009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.495+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbf9c1f5570 con 0x7fbf9c0d1790 2023-12-19T16:17:10.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.679+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbf9c1f5570 con 0x7fbf9c0d1790 2023-12-19T16:17:10.684 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-19T16:17:10.679+0000 7f8e22455640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:17:10.696 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbf927fc640 1 -- 172.21.15.73:0/3779394764 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbf9c1f5570 con 0x7fbf9c0d1790 2023-12-19T16:17:10.696 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:17:10.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 msgr2=0x7fbf80067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 0x7fbf80067f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf98005890 tx=0x7fbf98009040 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 msgr2=0x7fbf9c0cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0010f0 tx=0x7fbf8c00c8b0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 shutdown_connections 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf9c15d190 0x7fbf9c1f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fbf80065a60 0x7fbf80067f20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf9c0d1790 0x7fbf9c0cd9d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 --2- 172.21.15.73:0/3779394764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf9c0d13b0 0x7fbf9c15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 >> 172.21.15.73:0/3779394764 conn(0x7fbf9c0d2b70 msgr2=0x7fbf9c15d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 shutdown_connections 2023-12-19T16:17:10.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.691+0000 7fbfa4266640 1 -- 172.21.15.73:0/3779394764 wait complete. 2023-12-19T16:17:10.709 INFO:tasks.ceph.mds.d.smithi162.stderr: -8771> 2023-12-19T16:16:43.067+0000 7f99acad9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:17:10.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:17:10.763 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:17:10.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.851+0000 7eff87666640 1 Processor -- start 2023-12-19T16:17:10.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.851+0000 7eff87666640 1 -- start start 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff87666640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff801609e0 0x7eff80160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff87666640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8006a1d0 0x7eff8006a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff87666640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8015d2c0 con 0x7eff8015cee0 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff87666640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff801613b0 con 0x7eff801609e0 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff87666640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800d07d0 con 0x7eff8006a1d0 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff85402640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7eff8015cee0 0x7eff800ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:54616/0 (socket says 172.21.15.73:54616) 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff85402640 1 -- 172.21.15.73:0/2755949428 learned_addr learned my addr 172.21.15.73:0/2755949428 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff85c03640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8006a1d0 0x7eff8006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff84c01640 1 --2- 172.21.15.73:0/2755949428 >> v2:172.21.15.73:3300/0 conn(0x7eff801609e0 0x7eff80160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff77fff640 1 -- 172.21.15.73:0/2755949428 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512867110 0 0) 0x7eff8015d2c0 con 0x7eff8015cee0 2023-12-19T16:17:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff84c01640 1 -- 172.21.15.73:0/2755949428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8006a1d0 msgr2=0x7eff8006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff84c01640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8006a1d0 0x7eff8006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff84c01640 1 -- 172.21.15.73:0/2755949428 >> v1:172.21.15.162:6789/0 conn(0x7eff8015cee0 legacy=0x7eff800ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.855+0000 7eff84c01640 1 -- 172.21.15.73:0/2755949428 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800d0ab0 con 0x7eff801609e0 2023-12-19T16:17:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff84c01640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff801609e0 0x7eff80160e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7eff700097c0 tx=0x7eff7001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29469dd11167bd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff77fff640 1 -- 172.21.15.73:0/2755949428 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700ac620 con 0x7eff801609e0 2023-12-19T16:17:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff77fff640 1 -- 172.21.15.73:0/2755949428 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff700ac780 con 0x7eff801609e0 2023-12-19T16:17:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff77fff640 1 -- 172.21.15.73:0/2755949428 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff700acb10 con 0x7eff801609e0 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- 172.21.15.73:0/2755949428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff801609e0 msgr2=0x7eff80160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff801609e0 0x7eff80160e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7eff700097c0 tx=0x7eff7001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- 172.21.15.73:0/2755949428 shutdown_connections 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff8006a1d0 0x7eff8006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 --2- 172.21.15.73:0/2755949428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff801609e0 0x7eff80160e70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- 172.21.15.73:0/2755949428 >> 172.21.15.73:0/2755949428 conn(0x7eff800d2c00 msgr2=0x7eff800d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- 172.21.15.73:0/2755949428 shutdown_connections 2023-12-19T16:17:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- 172.21.15.73:0/2755949428 wait complete. 2023-12-19T16:17:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 Processor -- start 2023-12-19T16:17:10.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.859+0000 7eff87666640 1 -- start start 2023-12-19T16:17:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8015cee0 0x7eff80155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff801609e0 0x7eff8015d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800c64e0 con 0x7eff8006a1d0 2023-12-19T16:17:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff800c67c0 con 0x7eff8015cee0 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff800c6aa0 con 0x7eff801609e0 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52280/0 (socket says 172.21.15.73:52280) 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 -- 172.21.15.73:0/4027682019 learned_addr learned my addr 172.21.15.73:0/4027682019 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff84c01640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8015cee0 0x7eff80155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85c03640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff801609e0 0x7eff8015d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 -- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff801609e0 msgr2=0x7eff8015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff801609e0 0x7eff8015d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 -- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8015cee0 msgr2=0x7eff80155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8015cee0 0x7eff80155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 -- 172.21.15.73:0/4027682019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009420 con 0x7eff8006a1d0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff85402640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c480 tx=0x7eff7c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0074e0 con 0x7eff8006a1d0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c007660 con 0x7eff8006a1d0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c004a30 con 0x7eff8006a1d0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff800c6d80 con 0x7eff8006a1d0 2023-12-19T16:17:10.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff800b4d90 con 0x7eff8006a1d0 2023-12-19T16:17:10.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.863+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800d2550 con 0x7eff8006a1d0 2023-12-19T16:17:10.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.867+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff7c004b90 con 0x7eff8006a1d0 2023-12-19T16:17:10.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.867+0000 7eff75ffb640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:10.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.867+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5881+0+0 (secure 0 0 0) 0x7eff7c0823f0 con 0x7eff8006a1d0 2023-12-19T16:17:10.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.867+0000 7eff84c01640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:10.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.867+0000 7eff84c01640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 0x7eff64067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff700ae000 tx=0x7eff700a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:10.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:10.871+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff7c04fda0 con 0x7eff8006a1d0 2023-12-19T16:17:11.061 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.055+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff800d1330 con 0x7eff8006a1d0 2023-12-19T16:17:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff75ffb640 1 -- 172.21.15.73:0/4027682019 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff800d1330 con 0x7eff8006a1d0 2023-12-19T16:17:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 msgr2=0x7eff64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 0x7eff64067f20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7eff700ae000 tx=0x7eff700a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 msgr2=0x7eff800b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00c480 tx=0x7eff7c00c940 comp rx=0 tx=0).stop 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 shutdown_connections 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff801609e0 0x7eff8015d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff8015cee0 0x7eff80155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff64065a60 0x7eff64067f20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 --2- 172.21.15.73:0/4027682019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff8006a1d0 0x7eff800b4850 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 >> 172.21.15.73:0/4027682019 conn(0x7eff800d2c00 msgr2=0x7eff800d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 shutdown_connections 2023-12-19T16:17:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.695+0000 7eff87666640 1 -- 172.21.15.73:0/4027682019 wait complete. 2023-12-19T16:17:11.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:17:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 Processor -- start 2023-12-19T16:17:11.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 -- start start 2023-12-19T16:17:11.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 0x7f710806c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71080d0230 con 0x7f710815cc50 2023-12-19T16:17:11.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080d07f0 con 0x7f7108161320 2023-12-19T16:17:11.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f710d4f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71080d0020 con 0x7f710815d030 2023-12-19T16:17:11.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f71077fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 0x7f710806c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:34654/0 (socket says 172.21.15.73:34654) 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 -- 172.21.15.73:0/454806000 learned_addr learned my addr 172.21.15.73:0/454806000 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 -- 172.21.15.73:0/454806000 >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 msgr2=0x7f710806c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 --2- 172.21.15.73:0/454806000 >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 0x7f710806c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 -- 172.21.15.73:0/454806000 >> v1:172.21.15.162:6789/0 conn(0x7f710815cc50 legacy=0x7f71080caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f70fe7fc640 1 -- 172.21.15.73:0/454806000 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71080d0510 con 0x7f710815d030 2023-12-19T16:17:11.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.859+0000 7f71077fe640 1 --2- 172.21.15.73:0/454806000 >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 0x7f710806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:11.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f70fe7fc640 1 --2- 172.21.15.73:0/454806000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e50 tx=0x7f70f001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff9183fb56c3223 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f71067fc640 1 -- 172.21.15.73:0/454806000 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00a56e0 con 0x7f710815d030 2023-12-19T16:17:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f71067fc640 1 -- 172.21.15.73:0/454806000 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f00a5840 con 0x7f710815d030 2023-12-19T16:17:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f71067fc640 1 -- 172.21.15.73:0/454806000 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00a5bd0 con 0x7f710815d030 2023-12-19T16:17:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 -- 172.21.15.73:0/454806000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 msgr2=0x7f71080cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 --2- 172.21.15.73:0/454806000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009e50 tx=0x7f70f001ca10 comp rx=0 tx=0).stop 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 -- 172.21.15.73:0/454806000 shutdown_connections 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 --2- 172.21.15.73:0/454806000 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815d030 0x7f71080cfae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 --2- 172.21.15.73:0/454806000 >> v2:172.21.15.162:3300/0 conn(0x7f7108161320 0x7f710806c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 -- 172.21.15.73:0/454806000 >> 172.21.15.73:0/454806000 conn(0x7f710806d620 msgr2=0x7f710806da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 -- 172.21.15.73:0/454806000 shutdown_connections 2023-12-19T16:17:11.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.863+0000 7f710d4f9640 1 -- 172.21.15.73:0/454806000 wait complete. 2023-12-19T16:17:11.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 Processor -- start 2023-12-19T16:17:11.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- start start 2023-12-19T16:17:11.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815cc50 0x7f71081550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7108161320 0x7f71080c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71080c4980 con 0x7f710815d030 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71080c6e20 con 0x7f7108161320 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71080c7100 con 0x7f710815cc50 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f7106ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815cc50 0x7f71081550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52286/0 (socket says 172.21.15.73:52286) 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 -- 172.21.15.73:0/1310353854 learned_addr learned my addr 172.21.15.73:0/1310353854 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:11.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f71077fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7108161320 0x7f71080c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 -- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815cc50 msgr2=0x7f71081550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815cc50 0x7f71081550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 -- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7108161320 msgr2=0x7f71080c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7108161320 0x7f71080c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 -- 172.21.15.73:0/1310353854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100009420 con 0x7f710815d030 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fe7fc640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70f00af040 tx=0x7f70f00197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00bd070 con 0x7f710815d030 2023-12-19T16:17:11.875 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f00b8470 con 0x7f710815d030 2023-12-19T16:17:11.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f0009b30 con 0x7f710815d030 2023-12-19T16:17:11.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00b8820 con 0x7f710815d030 2023-12-19T16:17:11.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.867+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71080c8110 con 0x7f710815d030 2023-12-19T16:17:11.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71080cc180 con 0x7f710815d030 2023-12-19T16:17:11.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70f00b8980 con 0x7f710815d030 2023-12-19T16:17:11.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f70fffff640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 0x7f70e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:11.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f70f011df70 con 0x7f710815d030 2023-12-19T16:17:11.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f7106ffd640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 0x7f70e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:11.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.871+0000 7f7106ffd640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 0x7f70e8067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:11.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:11.875+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f70f00eb7e0 con 0x7f710815d030 2023-12-19T16:17:12.032 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.027+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f71080727c0 con 0x7f710815d030 2023-12-19T16:17:12.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.695+0000 7f70fffff640 1 -- 172.21.15.73:0/1310353854 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7f70f00eee00 con 0x7f710815d030 2023-12-19T16:17:12.704 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:17:12.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 msgr2=0x7f70e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 0x7f70e8067f20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f70f8007fd0 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 msgr2=0x7f71080c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f70f00af040 tx=0x7f70f00197b0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 shutdown_connections 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7108161320 0x7f71080c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70e8065a60 0x7f70e8067f20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f710815d030 0x7f71080c4440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 --2- 172.21.15.73:0/1310353854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f710815cc50 0x7f71081550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 >> 172.21.15.73:0/1310353854 conn(0x7f710806d620 msgr2=0x7f7108156060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 shutdown_connections 2023-12-19T16:17:12.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.699+0000 7f710d4f9640 1 -- 172.21.15.73:0/1310353854 wait complete. 2023-12-19T16:17:12.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:17:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.867+0000 7f11d48f2640 1 Processor -- start 2023-12-19T16:17:12.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.867+0000 7f11d48f2640 1 -- start start 2023-12-19T16:17:12.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11d48f2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11d0159900 0x7f11d015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11d48f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cdc20 0x7f11d00b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11d48f2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d015af70 con 0x7f11d00cd790 2023-12-19T16:17:12.876 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11d48f2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d015e570 con 0x7f11d0159900 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11d48f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d006f940 con 0x7f11d00cdc20 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11d0159900 0x7f11d015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11d0159900 0x7f11d015aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52300/0 (socket says 172.21.15.73:52300) 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 -- 172.21.15.73:0/1814703607 learned_addr learned my addr 172.21.15.73:0/1814703607 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ced9d640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cdc20 0x7f11d00b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 -- 172.21.15.73:0/1814703607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cdc20 msgr2=0x7f11d00b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cdc20 0x7f11d00b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 -- 172.21.15.73:0/1814703607 >> v1:172.21.15.162:6789/0 conn(0x7f11d00cd790 legacy=0x7f11d00b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:12.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.871+0000 7f11ce59c640 1 -- 172.21.15.73:0/1814703607 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d00ce0b0 con 0x7f11d0159900 2023-12-19T16:17:12.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11ce59c640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159900 0x7f11d015aa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009870 tx=0x7f11c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e8ebc4f1fb529d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11cdd9b640 1 -- 172.21.15.73:0/1814703607 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00ab680 con 0x7f11d0159900 2023-12-19T16:17:12.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11cdd9b640 1 -- 172.21.15.73:0/1814703607 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c00ab7e0 con 0x7f11d0159900 2023-12-19T16:17:12.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11cdd9b640 1 -- 172.21.15.73:0/1814703607 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c00abb70 con 0x7f11d0159900 2023-12-19T16:17:12.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- 172.21.15.73:0/1814703607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159900 msgr2=0x7f11d015aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159900 0x7f11d015aa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009870 tx=0x7f11c001c480 comp rx=0 tx=0).stop 2023-12-19T16:17:12.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- 172.21.15.73:0/1814703607 shutdown_connections 2023-12-19T16:17:12.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cdc20 0x7f11d00b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 --2- 172.21.15.73:0/1814703607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d0159900 0x7f11d015aa30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- 172.21.15.73:0/1814703607 >> 172.21.15.73:0/1814703607 conn(0x7f11d00cb800 msgr2=0x7f11d00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:12.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- 172.21.15.73:0/1814703607 shutdown_connections 2023-12-19T16:17:12.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- 172.21.15.73:0/1814703607 wait complete. 2023-12-19T16:17:12.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 Processor -- start 2023-12-19T16:17:12.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 -- start start 2023-12-19T16:17:12.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.875+0000 7f11d48f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cd790 0x7f11d0146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d0159900 0x7f11d01483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d014b600 con 0x7f11d00cdc20 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d01489f0 con 0x7f11d0159900 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d014acd0 con 0x7f11d00cd790 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52316/0 (socket says 172.21.15.73:52316) 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 -- 172.21.15.73:0/205334785 learned_addr learned my addr 172.21.15.73:0/205334785 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11ced9d640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d0159900 0x7f11d01483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11ce59c640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cd790 0x7f11d0146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 -- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cd790 msgr2=0x7f11d0146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cd790 0x7f11d0146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 -- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d0159900 msgr2=0x7f11d01483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d0159900 0x7f11d01483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 -- 172.21.15.73:0/205334785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00094d0 con 0x7f11d00cdc20 2023-12-19T16:17:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c5d9b640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c730 tx=0x7f11b800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003ba0 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8003d00 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8005310 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d014afb0 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d0147820 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d014b770 con 0x7f11d00cdc20 2023-12-19T16:17:12.886 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.879+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11b8005470 con 0x7f11d00cdc20 2023-12-19T16:17:12.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.883+0000 7f11c77fe640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:12.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.883+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f11b8082e50 con 0x7f11d00cdc20 2023-12-19T16:17:12.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.883+0000 7f11ce59c640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:12.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.883+0000 7f11ce59c640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11c00af000 tx=0x7f11c00b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:12.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:12.887+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11b80507e0 con 0x7f11d00cdc20 2023-12-19T16:17:13.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.035+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11d00727c0 con 0x7f11d00cdc20 2023-12-19T16:17:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.699+0000 7f11c77fe640 1 -- 172.21.15.73:0/205334785 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f11b8053e00 con 0x7f11d00cdc20 2023-12-19T16:17:13.706 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-19T16:17:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 msgr2=0x7f11b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11c00af000 tx=0x7f11c00b6040 comp rx=0 tx=0).stop 2023-12-19T16:17:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 msgr2=0x7f11d0147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:13.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c730 tx=0x7f11b800cb30 comp rx=0 tx=0).stop 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 shutdown_connections 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11d0159900 0x7f11d01483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f11b0065a60 0x7f11b0067f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11d00cdc20 0x7f11d0147e80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 --2- 172.21.15.73:0/205334785 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f11d00cd790 0x7f11d0146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 >> 172.21.15.73:0/205334785 conn(0x7f11d00cb800 msgr2=0x7f11d006fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 shutdown_connections 2023-12-19T16:17:13.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.703+0000 7f11d48f2640 1 -- 172.21.15.73:0/205334785 wait complete. 2023-12-19T16:17:13.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:17:13.736 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T16:17:13.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.780 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.781 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.782 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T16:17:13.783 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-12-19T16:17:13.784 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:17:13.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T16:17:13.786 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:17:13.787 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T16:17:13.788 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T16:17:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:17:13.790 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-12-19T16:17:13.791 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:17:13.792 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-12-19T16:17:13.793 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-12-19T16:17:13.794 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.795 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-12-19T16:17:13.796 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:13.798 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:13.799 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-12-19T16:17:13.800 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:17:13.801 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:17:13.802 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:17:13.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T16:17:13.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.987+0000 7f6a954df640 1 Processor -- start 2023-12-19T16:17:13.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.987+0000 7f6a954df640 1 -- start start 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a954df640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a9015cb70 0x7f6a900b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a954df640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9015cf50 0x7f6a900cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a954df640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900cb0b0 con 0x7f6a900b3710 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a954df640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cb390 con 0x7f6a9015cf50 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a954df640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cb670 con 0x7f6a9015cb70 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9015cf50 0x7f6a900cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a9015cf50 0x7f6a900cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52326/0 (socket says 172.21.15.73:52326) 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 -- 172.21.15.73:0/2417907536 learned_addr learned my addr 172.21.15.73:0/2417907536 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8effd640 1 --2- 172.21.15.73:0/2417907536 >> v2:172.21.15.162:3300/0 conn(0x7f6a9015cb70 0x7f6a900b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 -- 172.21.15.73:0/2417907536 >> v2:172.21.15.162:3300/0 conn(0x7f6a9015cb70 msgr2=0x7f6a900b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 --2- 172.21.15.73:0/2417907536 >> v2:172.21.15.162:3300/0 conn(0x7f6a9015cb70 0x7f6a900b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 -- 172.21.15.73:0/2417907536 >> v1:172.21.15.162:6789/0 conn(0x7f6a900b3710 legacy=0x7f6a900b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:13.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.991+0000 7f6a8f7fe640 1 -- 172.21.15.73:0/2417907536 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900cb950 con 0x7f6a9015cf50 2023-12-19T16:17:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a8f7fe640 1 --2- 172.21.15.73:0/2417907536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cf50 0x7f6a900cbe70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008ac80 tx=0x7f6a8801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c862c916798bc10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a8e7fc640 1 -- 172.21.15.73:0/2417907536 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a57f0 con 0x7f6a9015cf50 2023-12-19T16:17:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a8e7fc640 1 -- 172.21.15.73:0/2417907536 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880a5950 con 0x7f6a9015cf50 2023-12-19T16:17:13.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a8e7fc640 1 -- 172.21.15.73:0/2417907536 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5ce0 con 0x7f6a9015cf50 2023-12-19T16:17:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- 172.21.15.73:0/2417907536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cf50 msgr2=0x7f6a900cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- 172.21.15.73:0/2417907536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cf50 0x7f6a900cbe70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008ac80 tx=0x7f6a8801c990 comp rx=0 tx=0).stop 2023-12-19T16:17:14.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- 172.21.15.73:0/2417907536 shutdown_connections 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- 172.21.15.73:0/2417907536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cf50 0x7f6a900cbe70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- 172.21.15.73:0/2417907536 >> v2:172.21.15.162:3300/0 conn(0x7f6a9015cb70 0x7f6a900b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- 172.21.15.73:0/2417907536 >> 172.21.15.73:0/2417907536 conn(0x7f6a90099c30 msgr2=0x7f6a900d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- 172.21.15.73:0/2417907536 shutdown_connections 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- 172.21.15.73:0/2417907536 wait complete. 2023-12-19T16:17:14.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 Processor -- start 2023-12-19T16:17:14.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- start start 2023-12-19T16:17:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a900b3710 0x7f6a90152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a9015cf50 0x7f6a9015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e550 con 0x7f6a9015cb70 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e830 con 0x7f6a9015cf50 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.995+0000 7f6a954df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015eb10 con 0x7f6a900b3710 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52330/0 (socket says 172.21.15.73:52330) 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 -- 172.21.15.73:0/3098816918 learned_addr learned my addr 172.21.15.73:0/3098816918 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a8effd640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a900b3710 0x7f6a90152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a8f7fe640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a9015cf50 0x7f6a9015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 -- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a900b3710 msgr2=0x7f6a90152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a900b3710 0x7f6a90152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 -- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a9015cf50 msgr2=0x7f6a9015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a9015cf50 0x7f6a9015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 -- 172.21.15.73:0/3098816918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009b30 con 0x7f6a9015cb70 2023-12-19T16:17:14.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a87fff640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c450 tx=0x7f6a7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78012830 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780129b0 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9015edf0 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78012d60 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a90155b00 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9004e070 con 0x7f6a9015cb70 2023-12-19T16:17:14.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a7801c460 con 0x7f6a9015cb70 2023-12-19T16:17:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 0x7f6a70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:13.999+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6a78082cd0 con 0x7f6a9015cb70 2023-12-19T16:17:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.003+0000 7f6a8effd640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 0x7f6a70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.003+0000 7f6a8effd640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 0x7f6a70067f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.003+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6a78050940 con 0x7f6a9015cb70 2023-12-19T16:17:14.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.155+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6a900c7420 con 0x7f6a9015cb70 2023-12-19T16:17:14.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.159+0000 7f6a877fe640 1 -- 172.21.15.73:0/3098816918 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a78053f60 con 0x7f6a9015cb70 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 msgr2=0x7f6a70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 0x7f6a70067f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a80006fd0 tx=0x7f6a80008040 comp rx=0 tx=0).stop 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 msgr2=0x7f6a90155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6a7800c450 tx=0x7f6a7800c910 comp rx=0 tx=0).stop 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 shutdown_connections 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a9015cf50 0x7f6a9015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6a70065a60 0x7f6a70067f20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a9015cb70 0x7f6a90155e40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 --2- 172.21.15.73:0/3098816918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a900b3710 0x7f6a90152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 >> 172.21.15.73:0/3098816918 conn(0x7f6a90099c30 msgr2=0x7f6a900ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 shutdown_connections 2023-12-19T16:17:14.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.163+0000 7f6a954df640 1 -- 172.21.15.73:0/3098816918 wait complete. 2023-12-19T16:17:14.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2023-12-19T16:17:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 Processor -- start 2023-12-19T16:17:14.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 -- start start 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03a815dfc0 0x7f03a80cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 0x7f03a80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80c9940 con 0x7f03a80c8fa0 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a806d720 con 0x7f03a815dfc0 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03af12c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815e3a0 con 0x7f03a80b26a0 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03a815dfc0 0x7f03a80cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f039ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f03a80c8fa0 0x7f03a8070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:35634/0 (socket says 172.21.15.73:35634) 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03a815dfc0 0x7f03a80cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52346/0 (socket says 172.21.15.73:52346) 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f039ffff640 1 -- 172.21.15.73:0/3998733110 learned_addr learned my addr 172.21.15.73:0/3998733110 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:14.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03ad6c9640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 0x7f03a80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 -- 172.21.15.73:0/3998733110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 msgr2=0x7f03a80c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 0x7f03a80c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 -- 172.21.15.73:0/3998733110 >> v1:172.21.15.73:6789/0 conn(0x7f03a80c8fa0 legacy=0x7f03a8070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03acec8640 1 -- 172.21.15.73:0/3998733110 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a806c3a0 con 0x7f03a815dfc0 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f03ad6c9640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 0x7f03a80c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:14.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.331+0000 7f039f7fe640 1 -- 172.21.15.73:0/3998733110 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322020707 0 0) 0x7f03a80c9940 con 0x7f03a80c8fa0 2023-12-19T16:17:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03acec8640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a80cbac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097c0 tx=0x7f03a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b726348f7e07280 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f039f7fe640 1 -- 172.21.15.73:0/3998733110 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40ab600 con 0x7f03a815dfc0 2023-12-19T16:17:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f039f7fe640 1 -- 172.21.15.73:0/3998733110 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a40a7050 con 0x7f03a815dfc0 2023-12-19T16:17:14.340 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f039f7fe640 1 -- 172.21.15.73:0/3998733110 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40ab980 con 0x7f03a815dfc0 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- 172.21.15.73:0/3998733110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 msgr2=0x7f03a80cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a80cbac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097c0 tx=0x7f03a401c450 comp rx=0 tx=0).stop 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- 172.21.15.73:0/3998733110 shutdown_connections 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80b26a0 0x7f03a80c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 --2- 172.21.15.73:0/3998733110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a80cbac0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- 172.21.15.73:0/3998733110 >> 172.21.15.73:0/3998733110 conn(0x7f03a80b0270 msgr2=0x7f03a80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.341 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- 172.21.15.73:0/3998733110 shutdown_connections 2023-12-19T16:17:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- 172.21.15.73:0/3998733110 wait complete. 2023-12-19T16:17:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 Processor -- start 2023-12-19T16:17:14.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.335+0000 7f03af12c640 1 -- start start 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 0x7f03a80c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 0x7f03a81568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8155bc0 con 0x7f03a815dfc0 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8156460 con 0x7f03a80b26a0 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8157370 con 0x7f03a80c8fa0 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52352/0 (socket says 172.21.15.73:52352) 2023-12-19T16:17:14.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 -- 172.21.15.73:0/1903171694 learned_addr learned my addr 172.21.15.73:0/1903171694 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039ffff640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 0x7f03a81568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03acec8640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 0x7f03a80c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 -- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 msgr2=0x7f03a81568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 0x7f03a81568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 -- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 msgr2=0x7f03a80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 0x7f03a80c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 -- 172.21.15.73:0/1903171694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a4009420 con 0x7f03a815dfc0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039ffff640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 0x7f03a81568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03acec8640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 0x7f03a80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03ad6c9640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007ef0 tx=0x7f03a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a0015600 con 0x7f03a815dfc0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000f040 con 0x7f03a815dfc0 2023-12-19T16:17:14.346 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00159a0 con 0x7f03a815dfc0 2023-12-19T16:17:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80c45c0 con 0x7f03a815dfc0 2023-12-19T16:17:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a81560f0 con 0x7f03a815dfc0 2023-12-19T16:17:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a81562b0 con 0x7f03a815dfc0 2023-12-19T16:17:14.347 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.339+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f03a001e3b0 con 0x7f03a815dfc0 2023-12-19T16:17:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.343+0000 7f039d7fa640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 0x7f0394067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.343+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f03a0083270 con 0x7f03a815dfc0 2023-12-19T16:17:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.343+0000 7f03acec8640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 0x7f0394067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.343+0000 7f03acec8640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 0x7f0394067f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f03a40ad000 tx=0x7f03a4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.347+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f03a0050ec0 con 0x7f03a815dfc0 2023-12-19T16:17:14.556 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.551+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7f03a81565d0 con 0x7f03a815dfc0 2023-12-19T16:17:14.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.699+0000 7f039d7fa640 1 -- 172.21.15.73:0/1903171694 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v105) v1 ==== 147+0+0 (secure 0 0 0) 0x7f03a00544e0 con 0x7f03a815dfc0 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 msgr2=0x7f0394067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 0x7f0394067f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f03a40ad000 tx=0x7f03a4008040 comp rx=0 tx=0).stop 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 msgr2=0x7f03a8156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03a0007ef0 tx=0x7f03a000d4a0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 shutdown_connections 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0394065a90 0x7f0394067f50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a815dfc0 0x7f03a8156e30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03a80c8fa0 0x7f03a81568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 --2- 172.21.15.73:0/1903171694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a80b26a0 0x7f03a80c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 >> 172.21.15.73:0/1903171694 conn(0x7f03a80b0270 msgr2=0x7f03a80ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 shutdown_connections 2023-12-19T16:17:14.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.703+0000 7f03af12c640 1 -- 172.21.15.73:0/1903171694 wait complete. 2023-12-19T16:17:14.728 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ok 2023-12-19T16:17:14.728 INFO:tasks.cephfs_test_runner:Starting test: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) Opening a file should increment omap_total_updates by 1. 2023-12-19T16:17:14.729 INFO:tasks.cephfs_test_runner:test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) 2023-12-19T16:17:14.729 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2023-12-19T16:17:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.859+0000 7f9420ba6640 1 Processor -- start 2023-12-19T16:17:14.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.859+0000 7f9420ba6640 1 -- start start 2023-12-19T16:17:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f9420ba6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f941c0cba40 0x7f941c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f9420ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c06cdb0 0x7f941c0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f9420ba6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0cc8f0 con 0x7f941c1612e0 2023-12-19T16:17:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f9420ba6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0ccbd0 con 0x7f941c0cba40 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f9420ba6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0cceb0 con 0x7f941c06cdb0 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f941c0cba40 0x7f941c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f941c0cba40 0x7f941c0cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36210/0 (socket says 172.21.15.73:36210) 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 -- 172.21.15.73:0/1759179936 learned_addr learned my addr 172.21.15.73:0/1759179936 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941ad9d640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c06cdb0 0x7f941c0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 -- 172.21.15.73:0/1759179936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c06cdb0 msgr2=0x7f941c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c06cdb0 0x7f941c0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 -- 172.21.15.73:0/1759179936 >> v1:172.21.15.162:6789/0 conn(0x7f941c1612e0 legacy=0x7f941c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.863+0000 7f941a59c640 1 -- 172.21.15.73:0/1759179936 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0cd190 con 0x7f941c0cba40 2023-12-19T16:17:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f941a59c640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0cc310 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f940c009870 tx=0x7f940c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f2f448c33ebbd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9419d9b640 1 -- 172.21.15.73:0/1759179936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0a8a30 con 0x7f941c0cba40 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9419d9b640 1 -- 172.21.15.73:0/1759179936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c0a8b90 con 0x7f941c0cba40 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9419d9b640 1 -- 172.21.15.73:0/1759179936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b0440 con 0x7f941c0cba40 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- 172.21.15.73:0/1759179936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 msgr2=0x7f941c0cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0cc310 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f940c009870 tx=0x7f940c01ed30 comp rx=0 tx=0).stop 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- 172.21.15.73:0/1759179936 shutdown_connections 2023-12-19T16:17:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c06cdb0 0x7f941c0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- 172.21.15.73:0/1759179936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0cc310 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- 172.21.15.73:0/1759179936 >> 172.21.15.73:0/1759179936 conn(0x7f941c0b0270 msgr2=0x7f941c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- 172.21.15.73:0/1759179936 shutdown_connections 2023-12-19T16:17:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- 172.21.15.73:0/1759179936 wait complete. 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 Processor -- start 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 -- start start 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c06cdb0 0x7f941c14c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.867+0000 7f9420ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c1612e0 0x7f941c0c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c7510 con 0x7f941c0cba40 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c6900 con 0x7f941c06cdb0 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c6be0 con 0x7f941c1612e0 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f941a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c06cdb0 0x7f941c14c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36222/0 (socket says 172.21.15.73:36222) 2023-12-19T16:17:14.877 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 -- 172.21.15.73:0/2180415201 learned_addr learned my addr 172.21.15.73:0/2180415201 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f941ad9d640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c1612e0 0x7f941c0c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 -- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c1612e0 msgr2=0x7f941c0c79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c1612e0 0x7f941c0c79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 -- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c06cdb0 msgr2=0x7f941c14c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c06cdb0 0x7f941c14c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 -- 172.21.15.73:0/2180415201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c0094d0 con 0x7f941c0cba40 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9411d9b640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f940400c7a0 tx=0x7f940400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404003b80 con 0x7f941c0cba40 2023-12-19T16:17:14.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404003ce0 con 0x7f941c0cba40 2023-12-19T16:17:14.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0c6ec0 con 0x7f941c0cba40 2023-12-19T16:17:14.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400aa90 con 0x7f941c0cba40 2023-12-19T16:17:14.879 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0c4360 con 0x7f941c0cba40 2023-12-19T16:17:14.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c0c76c0 con 0x7f941c0cba40 2023-12-19T16:17:14.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.871+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f940400abf0 con 0x7f941c0cba40 2023-12-19T16:17:14.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.875+0000 7f94137fe640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:14.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.875+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9404082b90 con 0x7f941c0cba40 2023-12-19T16:17:14.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.875+0000 7f941a59c640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:14.882 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.875+0000 7f941a59c640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 0x7f93fc067f50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f940c0b2000 tx=0x7f940c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:14.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:14.879+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f941c0c76c0 con 0x7f941c0cba40 2023-12-19T16:17:15.087 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.083+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7f941c074050 con 0x7f941c0cba40 2023-12-19T16:17:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.703+0000 7f94137fe640 1 -- 172.21.15.73:0/2180415201 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v106) v1 ==== 146+0+0 (secure 0 0 0) 0x7f9404050890 con 0x7f941c0cba40 2023-12-19T16:17:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 msgr2=0x7f93fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 0x7f93fc067f50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f940c0b2000 tx=0x7f940c009040 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 msgr2=0x7f941c0c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f940400c7a0 tx=0x7f940400cc60 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 shutdown_connections 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c1612e0 0x7f941c0c79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f93fc065a90 0x7f93fc067f50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0cba40 0x7f941c0c49f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 --2- 172.21.15.73:0/2180415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c06cdb0 0x7f941c14c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 >> 172.21.15.73:0/2180415201 conn(0x7f941c0b0270 msgr2=0x7f941c1605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 shutdown_connections 2023-12-19T16:17:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.707+0000 7f9420ba6640 1 -- 172.21.15.73:0/2180415201 wait complete. 2023-12-19T16:17:15.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T16:17:15.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 Processor -- start 2023-12-19T16:17:15.878 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 -- start start 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d841598c0 0x7f0d8406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 0x7f0d840b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840cce80 con 0x7f0d840b0660 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840b0af0 con 0x7f0d841598c0 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.871+0000 7f0d8a0b6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8406cad0 con 0x7f0d8406d410 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d841598c0 0x7f0d8406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d83fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0d840b0660 0x7f0d840c9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33398/0 (socket says 172.21.15.73:33398) 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d83fff640 1 -- 172.21.15.73:0/2527958548 learned_addr learned my addr 172.21.15.73:0/2527958548 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d82ffd640 1 --2- 172.21.15.73:0/2527958548 >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 0x7f0d840b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 -- 172.21.15.73:0/2527958548 >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 msgr2=0x7f0d840b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 --2- 172.21.15.73:0/2527958548 >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 0x7f0d840b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 -- 172.21.15.73:0/2527958548 >> v1:172.21.15.73:6789/0 conn(0x7f0d840b0660 legacy=0x7f0d840c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d827fc640 1 -- 172.21.15.73:0/2527958548 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409936328 0 0) 0x7f0d840cce80 con 0x7f0d840b0660 2023-12-19T16:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 -- 172.21.15.73:0/2527958548 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840cc270 con 0x7f0d841598c0 2023-12-19T16:17:15.881 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d82ffd640 1 --2- 172.21.15.73:0/2527958548 >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 0x7f0d840b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:15.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.875+0000 7f0d837fe640 1 --2- 172.21.15.73:0/2527958548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d8406c590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ad980 tx=0x7f0d7401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc8cfed6a75608d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d827fc640 1 -- 172.21.15.73:0/2527958548 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d740ab660 con 0x7f0d841598c0 2023-12-19T16:17:15.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d827fc640 1 -- 172.21.15.73:0/2527958548 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740ab7c0 con 0x7f0d841598c0 2023-12-19T16:17:15.883 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d827fc640 1 -- 172.21.15.73:0/2527958548 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d740abb50 con 0x7f0d841598c0 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/2527958548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 msgr2=0x7f0d8406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/2527958548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d8406c590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0d840ad980 tx=0x7f0d7401c460 comp rx=0 tx=0).stop 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/2527958548 shutdown_connections 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/2527958548 >> v2:172.21.15.162:3300/0 conn(0x7f0d8406d410 0x7f0d840b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/2527958548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d8406c590 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/2527958548 >> 172.21.15.73:0/2527958548 conn(0x7f0d8406a570 msgr2=0x7f0d840ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/2527958548 shutdown_connections 2023-12-19T16:17:15.884 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/2527958548 wait complete. 2023-12-19T16:17:15.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 Processor -- start 2023-12-19T16:17:15.885 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- start start 2023-12-19T16:17:15.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8406d410 0x7f0d840c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d840b0660 0x7f0d840cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84157280 con 0x7f0d841598c0 2023-12-19T16:17:15.887 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84152bf0 con 0x7f0d840b0660 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d8a0b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84156c30 con 0x7f0d8406d410 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d83fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36240/0 (socket says 172.21.15.73:36240) 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d83fff640 1 -- 172.21.15.73:0/3915181672 learned_addr learned my addr 172.21.15.73:0/3915181672 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d82ffd640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d840b0660 0x7f0d840cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.879+0000 7f0d837fe640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8406d410 0x7f0d840c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 -- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8406d410 msgr2=0x7f0d840c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8406d410 0x7f0d840c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 -- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d840b0660 msgr2=0x7f0d840cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d840b0660 0x7f0d840cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:15.888 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 -- 172.21.15.73:0/3915181672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d74009420 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d83fff640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001570 tx=0x7f0d7c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00a640 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00a7c0 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00ab70 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84156f10 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84152830 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84157430 con 0x7f0d841598c0 2023-12-19T16:17:15.890 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d7c00acd0 con 0x7f0d841598c0 2023-12-19T16:17:15.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 0x7f0d70067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:15.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0d7c082430 con 0x7f0d841598c0 2023-12-19T16:17:15.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.883+0000 7f0d837fe640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 0x7f0d70067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:15.891 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.887+0000 7f0d837fe640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 0x7f0d70067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d740af000 tx=0x7f0d740a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:15.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:15.887+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0d84157430 con 0x7f0d841598c0 2023-12-19T16:17:16.043 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.039+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d841570a0 con 0x7f0d841598c0 2023-12-19T16:17:16.048 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d6bfff640 1 -- 172.21.15.73:0/3915181672 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d7c0180c0 con 0x7f0d841598c0 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 msgr2=0x7f0d70067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 0x7f0d70067f20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d740af000 tx=0x7f0d740a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 msgr2=0x7f0d841544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c001570 tx=0x7f0d7c00cca0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 shutdown_connections 2023-12-19T16:17:16.050 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d70065a60 0x7f0d70067f20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841598c0 0x7f0d841544c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d840b0660 0x7f0d840cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 --2- 172.21.15.73:0/3915181672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d8406d410 0x7f0d840c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 >> 172.21.15.73:0/3915181672 conn(0x7f0d8406a570 msgr2=0x7f0d840af490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 shutdown_connections 2023-12-19T16:17:16.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.043+0000 7f0d8a0b6640 1 -- 172.21.15.73:0/3915181672 wait complete. 2023-12-19T16:17:16.070 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:17:16.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:16.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:17:16.233 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:17:16.233 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:16.233 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:16.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:16.243 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:17:16.243 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:16.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:16.253 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:16.253 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:16.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:17:16.295 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:17:16.295 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:16.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:17:16.307 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T16:17:16.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:16.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 Processor -- start 2023-12-19T16:17:16.477 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 -- start start 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84600cdc40 0x7f846015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846015ad00 con 0x7f8460159830 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84600ce2d0 con 0x7f84600b40b0 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f8466552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846015e110 con 0x7f84600cdc40 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f845ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8460159830 0x7f84600cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33404/0 (socket says 172.21.15.73:33404) 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f845ffff640 1 -- 172.21.15.73:0/1882358081 learned_addr learned my addr 172.21.15.73:0/1882358081 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f845f7fe640 1 --2- 172.21.15.73:0/1882358081 >> v2:172.21.15.162:3300/0 conn(0x7f84600cdc40 0x7f846015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356641229 0 0) 0x7f846015ad00 con 0x7f8460159830 2023-12-19T16:17:16.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.471+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8448005740 con 0x7f8460159830 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1975814537 0 0) 0x7f8448005740 con 0x7f8460159830 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 >> v2:172.21.15.162:3300/0 conn(0x7f84600cdc40 msgr2=0x7f846015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 --2- 172.21.15.73:0/1882358081 >> v2:172.21.15.162:3300/0 conn(0x7f84600cdc40 0x7f846015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 >> v1:172.21.15.162:6789/0 conn(0x7f84600b40b0 legacy=0x7f84600ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846015d490 con 0x7f8460159830 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f8450001680 con 0x7f8460159830 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 >> v1:172.21.15.73:6789/0 conn(0x7f8460159830 legacy=0x7f84600cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 0x7f8448005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84480069e0 0x7f8448006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84480073a0 0x7f844800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846015e110 con 0x7f8448005b90 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844800e340 con 0x7f84480069e0 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844800e500 con 0x7f84480073a0 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 0x7f8448005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845f7fe640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84480069e0 0x7f8448006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f8464aef640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84480073a0 0x7f844800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 -- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84480073a0 msgr2=0x7f844800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84480073a0 0x7f844800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 -- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84480069e0 msgr2=0x7f8448006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84480069e0 0x7f8448006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 -- 172.21.15.73:0/1882358081 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448005740 con 0x7f8448005b90 2023-12-19T16:17:16.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f8464aef640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84480073a0 0x7f844800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f8464aef640 1 -- 172.21.15.73:0/1882358081 reap_dead start 2023-12-19T16:17:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.475+0000 7f845ffff640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 0x7f8448005fb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f845000c240 tx=0x7f845001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655bd243c9250239 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450005ae0 con 0x7f8448005b90 2023-12-19T16:17:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450005c40 con 0x7f8448005b90 2023-12-19T16:17:16.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f845effd640 1 -- 172.21.15.73:0/1882358081 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500a5ad0 con 0x7f8448005b90 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 msgr2=0x7f8448005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 0x7f8448005fb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f845000c240 tx=0x7f845001cc10 comp rx=0 tx=0).stop 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- 172.21.15.73:0/1882358081 shutdown_connections 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 --2- 172.21.15.73:0/1882358081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8448005b90 0x7f8448005fb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- 172.21.15.73:0/1882358081 >> 172.21.15.73:0/1882358081 conn(0x7f84600b0270 msgr2=0x7f84600b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- 172.21.15.73:0/1882358081 shutdown_connections 2023-12-19T16:17:16.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- 172.21.15.73:0/1882358081 wait complete. 2023-12-19T16:17:16.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 Processor -- start 2023-12-19T16:17:16.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- start start 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8448005b90 0x7f84600c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 0x7f84600ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c7f30 con 0x7f84600ac830 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c7360 con 0x7f8448005b90 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.479+0000 7f8466552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84600c7600 con 0x7f84600b23c0 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 0x7f84600ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 0x7f84600ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:54216/0 (socket says 172.21.15.73:54216) 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845f7fe640 1 -- 172.21.15.73:0/3654920423 learned_addr learned my addr 172.21.15.73:0/3654920423 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36268/0 (socket says 172.21.15.73:36268) 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845ffff640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8448005b90 0x7f84600c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 -- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 msgr2=0x7f84600ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 0x7f84600ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 -- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8448005b90 msgr2=0x7f84600c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8448005b90 0x7f84600c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 -- 172.21.15.73:0/3654920423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84600c78e0 con 0x7f84600ac830 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8464aef640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f84600712b0 tx=0x7f845800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845800eed0 con 0x7f84600ac830 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8458003980 con 0x7f84600ac830 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458003d30 con 0x7f84600ac830 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84600c7bc0 con 0x7f84600ac830 2023-12-19T16:17:16.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8460152a30 con 0x7f84600ac830 2023-12-19T16:17:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8460152c20 con 0x7f84600ac830 2023-12-19T16:17:16.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f84580050d0 con 0x7f84600ac830 2023-12-19T16:17:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.483+0000 7f845cff9640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 0x7f844c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.487+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8458082b00 con 0x7f84600ac830 2023-12-19T16:17:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.487+0000 7f845ffff640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 0x7f844c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.487+0000 7f845ffff640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 0x7f844c067f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84500ab000 tx=0x7f84500b1040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.487+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8460152c20 con 0x7f84600ac830 2023-12-19T16:17:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.671+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8460152c20 con 0x7f84600ac830 2023-12-19T16:17:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.671+0000 7f845cff9640 1 -- 172.21.15.73:0/3654920423 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f8460152c20 con 0x7f84600ac830 2023-12-19T16:17:16.678 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:16.678 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/950737161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":950737161},{"type":"v1","addr":"172.21.15.162:6835","nonce":950737161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/686580342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":686580342},{"type":"v1","addr":"172.21.15.73:6836","nonce":686580342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3142565476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3142565476},{"type":"v1","addr":"172.21.15.73:6837","nonce":3142565476}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5365,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/2998684402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2998684402},{"type":"v1","addr":"172.21.15.162:6833","nonce":2998684402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-12-19T16:17:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 24 2023-12-19T16:17:16.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 msgr2=0x7f844c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 0x7f844c067f20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f84500ab000 tx=0x7f84500b1040 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 msgr2=0x7f8460151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f84600712b0 tx=0x7f845800eb90 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 shutdown_connections 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f844c065a60 0x7f844c067f20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84600ac830 0x7f8460151d50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84600b23c0 0x7f84600ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 --2- 172.21.15.73:0/3654920423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8448005b90 0x7f84600c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 >> 172.21.15.73:0/3654920423 conn(0x7f84600b0270 msgr2=0x7f846006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 shutdown_connections 2023-12-19T16:17:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.675+0000 7f8466552640 1 -- 172.21.15.73:0/3654920423 wait complete. 2023-12-19T16:17:16.699 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:17:16.699 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:17:16.699 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:17:16.699 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:16.699 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:17:16.699 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:17:16.700 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:17:16.700 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:16.700 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:17:16.700 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:17:16.700 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:17:16.700 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:16.700 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:17:16.701 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:17:16.701 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:17:16.701 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:16.713 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:17:16.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:17:16.714 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:17:16.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:17:16.718 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:17:16.718 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:17:16.719 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:17:16.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:17:16.762 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:17:16.762 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:16.764 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:17:16.764 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:16.769 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:17:16.770 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:16.772 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:17:16.772 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:16.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T16:17:16.850 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-19T16:17:16.851 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:17:16.861 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:17:16.867 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:17:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.915+0000 7f1da7bbc640 1 Processor -- start 2023-12-19T16:17:16.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.915+0000 7f1da7bbc640 1 -- start start 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.915+0000 7f1da7bbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 0x7f1da015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da7bbc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 0x7f1da00ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da7bbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da015ad00 con 0x7f1da0159830 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da7bbc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da015e110 con 0x7f1da00b40b0 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da7bbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00ce2d0 con 0x7f1da00cdc40 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5958640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1da0159830 0x7f1da00cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33424/0 (socket says 172.21.15.73:33424) 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5958640 1 -- 172.21.15.73:0/2186471221 learned_addr learned my addr 172.21.15.73:0/2186471221 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da6159640 1 --2- 172.21.15.73:0/2186471221 >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 0x7f1da00ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 --2- 172.21.15.73:0/2186471221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 0x7f1da015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da4956640 1 -- 172.21.15.73:0/2186471221 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496232679 0 0) 0x7f1da015ad00 con 0x7f1da0159830 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da4956640 1 -- 172.21.15.73:0/2186471221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c003530 con 0x7f1da0159830 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 -- 172.21.15.73:0/2186471221 >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 msgr2=0x7f1da00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 --2- 172.21.15.73:0/2186471221 >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 0x7f1da00ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 -- 172.21.15.73:0/2186471221 >> v1:172.21.15.73:6789/0 conn(0x7f1da0159830 legacy=0x7f1da00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 -- 172.21.15.73:0/2186471221 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da015d490 con 0x7f1da00cdc40 2023-12-19T16:17:16.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da6159640 1 --2- 172.21.15.73:0/2186471221 >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 0x7f1da00ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:16.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.919+0000 7f1da5157640 1 --2- 172.21.15.73:0/2186471221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 0x7f1da015a7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097c0 tx=0x7f1d9001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1cdae270594ff6f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da4956640 1 -- 172.21.15.73:0/2186471221 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900ac620 con 0x7f1da00cdc40 2023-12-19T16:17:16.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da4956640 1 -- 172.21.15.73:0/2186471221 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900ac780 con 0x7f1da00cdc40 2023-12-19T16:17:16.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da4956640 1 -- 172.21.15.73:0/2186471221 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900acb10 con 0x7f1da00cdc40 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- 172.21.15.73:0/2186471221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 msgr2=0x7f1da015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/2186471221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 0x7f1da015a7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d900097c0 tx=0x7f1d9001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- 172.21.15.73:0/2186471221 shutdown_connections 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/2186471221 >> v2:172.21.15.162:3300/0 conn(0x7f1da00b40b0 0x7f1da00ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/2186471221 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00cdc40 0x7f1da015a7c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- 172.21.15.73:0/2186471221 >> 172.21.15.73:0/2186471221 conn(0x7f1da00b0270 msgr2=0x7f1da00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- 172.21.15.73:0/2186471221 shutdown_connections 2023-12-19T16:17:16.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- 172.21.15.73:0/2186471221 wait complete. 2023-12-19T16:17:16.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 Processor -- start 2023-12-19T16:17:16.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- start start 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00b40b0 0x7f1da00ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 0x7f1da0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 0x7f1da0151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01534f0 con 0x7f1da0159830 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01f9340 con 0x7f1da00cdc40 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da7bbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01f9620 con 0x7f1da00b40b0 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da6159640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 0x7f1da0151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da5958640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00b40b0 0x7f1da00ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da5157640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 0x7f1da0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da6159640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 0x7f1da0151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36314/0 (socket says 172.21.15.73:36314) 2023-12-19T16:17:16.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.923+0000 7f1da6159640 1 -- 172.21.15.73:0/4037786307 learned_addr learned my addr 172.21.15.73:0/4037786307 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 -- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00b40b0 msgr2=0x7f1da00ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00b40b0 0x7f1da00ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 -- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 msgr2=0x7f1da0151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 0x7f1da0151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 -- 172.21.15.73:0/4037786307 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98009a70 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5157640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 0x7f1da0151c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ac000 tx=0x7f1d9001ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900ac620 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900b8450 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90009420 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900b8800 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da01f9be0 con 0x7f1da00cdc40 2023-12-19T16:17:16.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0074050 con 0x7f1da00cdc40 2023-12-19T16:17:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d900aa070 con 0x7f1da00cdc40 2023-12-19T16:17:16.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 0x7f1d84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1d9011d360 con 0x7f1da00cdc40 2023-12-19T16:17:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.927+0000 7f1da5958640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 0x7f1d84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:16.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.931+0000 7f1da5958640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 0x7f1d84067f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0011f0 tx=0x7f1d9c007d40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:16.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:16.935+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d900eafe0 con 0x7f1da00cdc40 2023-12-19T16:17:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:17.095+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1da00ce020 con 0x7f1da00cdc40 2023-12-19T16:17:18.053 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1d967fc640 1 -- 172.21.15.73:0/4037786307 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1d900ee600 con 0x7f1da00cdc40 2023-12-19T16:17:18.053 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 msgr2=0x7f1d84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 0x7f1d84067f20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c0011f0 tx=0x7f1d9c007d40 comp rx=0 tx=0).stop 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 msgr2=0x7f1da0151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 0x7f1da0151c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d900ac000 tx=0x7f1d9001ac00 comp rx=0 tx=0).stop 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.046+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 shutdown_connections 2023-12-19T16:17:18.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1d84065a60 0x7f1d84067f20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1da0159830 0x7f1da0151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da00cdc40 0x7f1da0151c50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 --2- 172.21.15.73:0/4037786307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1da00b40b0 0x7f1da00ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 >> 172.21.15.73:0/4037786307 conn(0x7f1da00b0270 msgr2=0x7f1da015b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 shutdown_connections 2023-12-19T16:17:18.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.050+0000 7f1da7bbc640 1 -- 172.21.15.73:0/4037786307 wait complete. 2023-12-19T16:17:18.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T16:17:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.206+0000 7f5b3f6e5640 1 Processor -- start 2023-12-19T16:17:18.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 -- start start 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b380c8fa0 0x7f5b380c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b380b1690 0x7f5b380b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b380c9940 con 0x7f5b3815dfc0 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3806d720 con 0x7f5b380c8fa0 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3f6e5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3815e3a0 con 0x7f5b380b1690 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b380c8fa0 0x7f5b380c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3d481640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5b3815dfc0 0x7f5b380cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33440/0 (socket says 172.21.15.73:33440) 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3d481640 1 -- 172.21.15.73:0/4225664803 learned_addr learned my addr 172.21.15.73:0/4225664803 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b380c8fa0 0x7f5b380c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36322/0 (socket says 172.21.15.73:36322) 2023-12-19T16:17:18.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3dc82640 1 --2- 172.21.15.73:0/4225664803 >> v2:172.21.15.162:3300/0 conn(0x7f5b380b1690 0x7f5b380b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 -- 172.21.15.73:0/4225664803 >> v2:172.21.15.162:3300/0 conn(0x7f5b380b1690 msgr2=0x7f5b380b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 --2- 172.21.15.73:0/4225664803 >> v2:172.21.15.162:3300/0 conn(0x7f5b380b1690 0x7f5b380b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 -- 172.21.15.73:0/4225664803 >> v1:172.21.15.73:6789/0 conn(0x7f5b3815dfc0 legacy=0x7f5b380cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.218 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.210+0000 7f5b3cc80640 1 -- 172.21.15.73:0/4225664803 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3806c3a0 con 0x7f5b380c8fa0 2023-12-19T16:17:18.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3cc80640 1 --2- 172.21.15.73:0/4225664803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c9400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806e550 tx=0x7f5b2801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ba3e4949b70ebe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b2ffff640 1 -- 172.21.15.73:0/4225664803 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280a7070 con 0x7f5b380c8fa0 2023-12-19T16:17:18.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b2ffff640 1 -- 172.21.15.73:0/4225664803 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b280ab430 con 0x7f5b380c8fa0 2023-12-19T16:17:18.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b2ffff640 1 -- 172.21.15.73:0/4225664803 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b280ab7c0 con 0x7f5b380c8fa0 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/4225664803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b380c8fa0 msgr2=0x7f5b380c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/4225664803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c9400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b3806e550 tx=0x7f5b2801c430 comp rx=0 tx=0).stop 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/4225664803 shutdown_connections 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/4225664803 >> v2:172.21.15.162:3300/0 conn(0x7f5b380b1690 0x7f5b380b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/4225664803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c9400 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/4225664803 >> 172.21.15.73:0/4225664803 conn(0x7f5b380b0270 msgr2=0x7f5b380b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/4225664803 shutdown_connections 2023-12-19T16:17:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/4225664803 wait complete. 2023-12-19T16:17:18.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 Processor -- start 2023-12-19T16:17:18.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.214+0000 7f5b3f6e5640 1 -- start start 2023-12-19T16:17:18.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b380b1690 0x7f5b380ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380abec0 con 0x7f5b3815dfc0 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380ac1a0 con 0x7f5b380c8fa0 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b380ac480 con 0x7f5b380b1690 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36328/0 (socket says 172.21.15.73:36328) 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 -- 172.21.15.73:0/1915045922 learned_addr learned my addr 172.21.15.73:0/1915045922 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3d481640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b380b1690 0x7f5b380ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3cc80640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 -- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b380b1690 msgr2=0x7f5b380ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b380b1690 0x7f5b380ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.225 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 -- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b380c8fa0 msgr2=0x7f5b380c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 -- 172.21.15.73:0/1915045922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b28009420 con 0x7f5b3815dfc0 2023-12-19T16:17:18.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3dc82640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b30007e40 tx=0x7f5b3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30014620 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000ee90 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300149e0 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b380ac760 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b38159030 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.218+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38074050 con 0x7f5b3815dfc0 2023-12-19T16:17:18.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.222+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b30014b40 con 0x7f5b3815dfc0 2023-12-19T16:17:18.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.222+0000 7f5b2dffb640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 0x7f5b1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.222+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b30083650 con 0x7f5b3815dfc0 2023-12-19T16:17:18.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.222+0000 7f5b3d481640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 0x7f5b1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.222+0000 7f5b3d481640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 0x7f5b1c067f50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b34005890 tx=0x7f5b34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.226+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b30051400 con 0x7f5b3815dfc0 2023-12-19T16:17:18.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5b380acc10 con 0x7f5b3815dfc0 2023-12-19T16:17:18.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b2dffb640 1 -- 172.21.15.73:0/1915045922 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5b30054a20 con 0x7f5b3815dfc0 2023-12-19T16:17:18.433 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:18.433 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:17:18.433 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2023-12-19T16:17:18.433 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlEa21KBAAPi35lLT1QVm0TtqHtAkVBQ==", 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:17:18.434 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlPWcWNRAAg+P1Pb2YDSAluRy+kgP9vA==", 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.435 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlHRYLMBAAe6JO4aNCG3tRKcf301jEGA==", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFlYT3lABAAvTiyPDU3fDNRgpUeTgQhMw==", 2023-12-19T16:17:18.436 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB0wYFlnEe8GhAAFy+bGsYQdTfzzRIvVsSmOg==", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.437 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB3wYFlUm36IhAA2xVp+ZXzw7xti1Pkx5KdIg==", 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2023-12-19T16:17:18.438 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB6wYFlDtP5KRAAglWrB9m+EVDcWoUU1j7sNA==", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB9wYFlx9lDMBAA6L1/ZYNN8OrH77GacAfDlA==", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCEwYFlzK5bABAAm36Alvm7ZfE52fDUGc7GQQ==", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCHwYFlCWpPBhAAjS701JMVRnTSQQ3tYx9fuQ==", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.440 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCKwYFlwfPDDBAAeQxfTEkcpet6fVrXEqwaSA==", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCNwYFlVxsgExAAWN8f82RULx+p0mTwVOf/SA==", 2023-12-19T16:17:18.441 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFlWX79BBAAAARcLd3AscjfpzZ6uWTRGw==", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow r", 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFluZ2CDhAAydccccZqgYYK2rtJ5PQhSQ==", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFl1JX8ChAAB6m058FKdH4c1IyeCnnd3w==", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:17:18.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBxwYFl7tp6FBAAHqaB7TYTKy55/x3oA393gw==", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2023-12-19T16:17:18.444 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlpRNMDBAAhFBeHnFTKjx1PdD7B82YxA==", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlSD18JBAAWCIX1iH3o6OdOn866TPV/Q==", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.445 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwwYFlUC6tIBAApfXknRNqcF6e4Va+YWlomQ==", 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2023-12-19T16:17:18.446 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:17:18.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 msgr2=0x7f5b1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 0x7f5b1c067f50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b34005890 tx=0x7f5b34009040 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 msgr2=0x7f5b3814bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b30007e40 tx=0x7f5b3000e4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 shutdown_connections 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5b1c065a90 0x7f5b1c067f50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b3815dfc0 0x7f5b3814bc30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b380c8fa0 0x7f5b380c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 --2- 172.21.15.73:0/1915045922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b380b1690 0x7f5b380ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 >> 172.21.15.73:0/1915045922 conn(0x7f5b380b0270 msgr2=0x7f5b380cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.426+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 shutdown_connections 2023-12-19T16:17:18.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.430+0000 7f5b3f6e5640 1 -- 172.21.15.73:0/1915045922 wait complete. 2023-12-19T16:17:18.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 Processor -- start 2023-12-19T16:17:18.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 -- start start 2023-12-19T16:17:18.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 0x7ff8480b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff84815cff0 0x7ff8480b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480b7250 con 0x7ff8480b4bd0 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8480b7530 con 0x7ff84815cff0 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84c9f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480b7810 con 0x7ff8480b47f0 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff83ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff8480b4bd0 0x7ff84815c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33448/0 (socket says 172.21.15.73:33448) 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff83ffff640 1 -- 172.21.15.73:0/1306180827 learned_addr learned my addr 172.21.15.73:0/1306180827 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff846d9d640 1 --2- 172.21.15.73:0/1306180827 >> v2:172.21.15.162:3300/0 conn(0x7ff84815cff0 0x7ff8480b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff84659c640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 0x7ff8480b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff845d9b640 1 -- 172.21.15.73:0/1306180827 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985621935 0 0) 0x7ff8480b7250 con 0x7ff8480b4bd0 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff845d9b640 1 -- 172.21.15.73:0/1306180827 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff834003530 con 0x7ff8480b4bd0 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.586+0000 7ff846d9d640 1 -- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 msgr2=0x7ff8480b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff846d9d640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 0x7ff8480b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff846d9d640 1 -- 172.21.15.73:0/1306180827 >> v1:172.21.15.73:6789/0 conn(0x7ff8480b4bd0 legacy=0x7ff84815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff846d9d640 1 -- 172.21.15.73:0/1306180827 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480b7af0 con 0x7ff84815cff0 2023-12-19T16:17:18.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84659c640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 0x7ff8480b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff846d9d640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff8480b5c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff840009d90 tx=0x7ff84001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=141cd1788f858c9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff845d9b640 1 -- 172.21.15.73:0/1306180827 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400a5970 con 0x7ff84815cff0 2023-12-19T16:17:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff845d9b640 1 -- 172.21.15.73:0/1306180827 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400a5ad0 con 0x7ff84815cff0 2023-12-19T16:17:18.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff845d9b640 1 -- 172.21.15.73:0/1306180827 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400a5e60 con 0x7ff84815cff0 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 -- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 msgr2=0x7ff8480b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff8480b5c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff840009d90 tx=0x7ff84001c890 comp rx=0 tx=0).stop 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 -- 172.21.15.73:0/1306180827 shutdown_connections 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff8480b5c40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/1306180827 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b47f0 0x7ff8480b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 -- 172.21.15.73:0/1306180827 >> 172.21.15.73:0/1306180827 conn(0x7ff848065ce0 msgr2=0x7ff8480660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 -- 172.21.15.73:0/1306180827 shutdown_connections 2023-12-19T16:17:18.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.590+0000 7ff84c9f0640 1 -- 172.21.15.73:0/1306180827 wait complete. 2023-12-19T16:17:18.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 Processor -- start 2023-12-19T16:17:18.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 -- start start 2023-12-19T16:17:18.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 0x7ff84815df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff848158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c91a0 con 0x7ff8480b47f0 2023-12-19T16:17:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480c9480 con 0x7ff84815cff0 2023-12-19T16:17:18.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff848155220 con 0x7ff8480b4bd0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36336/0 (socket says 172.21.15.73:36336) 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 -- 172.21.15.73:0/3079191244 learned_addr learned my addr 172.21.15.73:0/3079191244 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff846d9d640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff848158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff83ffff640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 0x7ff84815df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 -- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 msgr2=0x7ff84815df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 0x7ff84815df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 -- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 msgr2=0x7ff848158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff848158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 -- 172.21.15.73:0/3079191244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009420 con 0x7ff8480b47f0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff846d9d640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff848158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff83ffff640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 0x7ff84815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84659c640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff83800ebe0 tx=0x7ff83800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800eee0 con 0x7ff8480b47f0 2023-12-19T16:17:18.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83800cc30 con 0x7ff8480b47f0 2023-12-19T16:17:18.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff840009a70 con 0x7ff8480b47f0 2023-12-19T16:17:18.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.594+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838013470 con 0x7ff8480b47f0 2023-12-19T16:17:18.606 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8481557e0 con 0x7ff8480b47f0 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84815c320 con 0x7ff8480b47f0 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8380135d0 con 0x7ff8480b47f0 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff83effd640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 0x7ff828067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8380831e0 con 0x7ff8480b47f0 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff83ffff640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 0x7ff828067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.598+0000 7ff83ffff640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 0x7ff828067f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff84814e0a0 tx=0x7ff830009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.602+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff838050e50 con 0x7ff8480b47f0 2023-12-19T16:17:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.754+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff848074050 con 0x7ff8480b47f0 2023-12-19T16:17:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.754+0000 7ff83effd640 1 -- 172.21.15.73:0/3079191244 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+12389 (secure 0 0 0) 0x7ff838054470 con 0x7ff8480b47f0 2023-12-19T16:17:18.763 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:18.763 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":48,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:17:18.046857+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 msgr2=0x7ff828067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 0x7ff828067f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff84814e0a0 tx=0x7ff830009040 comp rx=0 tx=0).stop 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 msgr2=0x7ff84815fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff83800ebe0 tx=0x7ff83800c520 comp rx=0 tx=0).stop 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 shutdown_connections 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff84815cff0 0x7ff848158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8480b4bd0 0x7ff84815df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff828065a60 0x7ff828067f20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 --2- 172.21.15.73:0/3079191244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8480b47f0 0x7ff84815fd00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 >> 172.21.15.73:0/3079191244 conn(0x7ff848065ce0 msgr2=0x7ff84815b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 shutdown_connections 2023-12-19T16:17:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.758+0000 7ff84c9f0640 1 -- 172.21.15.73:0/3079191244 wait complete. 2023-12-19T16:17:18.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:17:18.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:17:18.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 Processor -- start 2023-12-19T16:17:18.926 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 -- start start 2023-12-19T16:17:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce48158270 0x7fce4815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158650 0x7fce48070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4806ffb0 con 0x7fce4815e4d0 2023-12-19T16:17:18.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4815b730 con 0x7fce48158270 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4f139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815ba10 con 0x7fce48158650 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4ced5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce48158270 0x7fce4815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4ced5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce48158270 0x7fce4815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36346/0 (socket says 172.21.15.73:36346) 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.918+0000 7fce4ced5640 1 -- 172.21.15.73:0/3671118389 learned_addr learned my addr 172.21.15.73:0/3671118389 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce3ffff640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158650 0x7fce48070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4ced5640 1 -- 172.21.15.73:0/3671118389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158650 msgr2=0x7fce48070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4ced5640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158650 0x7fce48070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4ced5640 1 -- 172.21.15.73:0/3671118389 >> v1:172.21.15.162:6789/0 conn(0x7fce4815e4d0 legacy=0x7fce4806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4ced5640 1 -- 172.21.15.73:0/3671118389 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4815bcf0 con 0x7fce48158270 2023-12-19T16:17:18.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4ced5640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48158270 0x7fce4815aee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fce44009870 tx=0x7fce4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bc7133a2666948 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce3f7fe640 1 -- 172.21.15.73:0/3671118389 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440ab620 con 0x7fce48158270 2023-12-19T16:17:18.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce3f7fe640 1 -- 172.21.15.73:0/3671118389 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440ab780 con 0x7fce48158270 2023-12-19T16:17:18.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce3f7fe640 1 -- 172.21.15.73:0/3671118389 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440abb10 con 0x7fce48158270 2023-12-19T16:17:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 -- 172.21.15.73:0/3671118389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48158270 msgr2=0x7fce4815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48158270 0x7fce4815aee0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fce44009870 tx=0x7fce4401c510 comp rx=0 tx=0).stop 2023-12-19T16:17:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 -- 172.21.15.73:0/3671118389 shutdown_connections 2023-12-19T16:17:18.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158650 0x7fce48070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 --2- 172.21.15.73:0/3671118389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce48158270 0x7fce4815aee0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.922+0000 7fce4f139640 1 -- 172.21.15.73:0/3671118389 >> 172.21.15.73:0/3671118389 conn(0x7fce4806a570 msgr2=0x7fce480ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- 172.21.15.73:0/3671118389 shutdown_connections 2023-12-19T16:17:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- 172.21.15.73:0/3671118389 wait complete. 2023-12-19T16:17:18.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 Processor -- start 2023-12-19T16:17:18.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- start start 2023-12-19T16:17:18.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 0x7fce4815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce48158650 0x7fce4814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4814d3f0 con 0x7fce4815e4d0 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4814dc80 con 0x7fce48158650 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4f139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4814df60 con 0x7fce48158270 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4ced5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 0x7fce4815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36362/0 (socket says 172.21.15.73:36362) 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4ced5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 0x7fce4815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:54310/0 (socket says 172.21.15.73:54310) 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 -- 172.21.15.73:0/148589682 learned_addr learned my addr 172.21.15.73:0/148589682 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:18.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce3ffff640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce48158650 0x7fce4814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 -- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 msgr2=0x7fce4815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 0x7fce4815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 -- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce48158650 msgr2=0x7fce4814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce48158650 0x7fce4814d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.926+0000 7fce4d6d6640 1 -- 172.21.15.73:0/148589682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440094d0 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce4d6d6640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c730 tx=0x7fce4000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40003b80 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40003ce0 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40005310 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4814e240 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4814e800 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48156650 con 0x7fce4815e4d0 2023-12-19T16:17:18.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce40005680 con 0x7fce4815e4d0 2023-12-19T16:17:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 0x7fce34067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce40082c10 con 0x7fce4815e4d0 2023-12-19T16:17:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.930+0000 7fce4ced5640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 0x7fce34067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:18.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.934+0000 7fce4ced5640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 0x7fce34067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fce440af000 tx=0x7fce440b6040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:18.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:18.934+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fce48156650 con 0x7fce4815e4d0 2023-12-19T16:17:19.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce48156650 con 0x7fce4815e4d0 2023-12-19T16:17:19.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce3d7fa640 1 -- 172.21.15.73:0/148589682 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce48156650 con 0x7fce4815e4d0 2023-12-19T16:17:19.092 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:17:19.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 msgr2=0x7fce34067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 0x7fce34067f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fce440af000 tx=0x7fce440b6040 comp rx=0 tx=0).stop 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 msgr2=0x7fce4814ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c730 tx=0x7fce4000cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 shutdown_connections 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fce34065a60 0x7fce34067f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815e4d0 0x7fce4814ceb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce48158650 0x7fce4814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 --2- 172.21.15.73:0/148589682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce48158270 0x7fce4815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 >> 172.21.15.73:0/148589682 conn(0x7fce4806a570 msgr2=0x7fce48159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 shutdown_connections 2023-12-19T16:17:19.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.086+0000 7fce4f139640 1 -- 172.21.15.73:0/148589682 wait complete. 2023-12-19T16:17:19.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T16:17:19.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.242+0000 7f38602b6640 1 Processor -- start 2023-12-19T16:17:19.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.242+0000 7f38602b6640 1 -- start start 2023-12-19T16:17:19.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f38602b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385815dfc0 0x7f38580cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f38602b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38580c8fa0 0x7f38580c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f38602b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580c9940 con 0x7f3858070130 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f38602b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385806d720 con 0x7f38580c8fa0 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f38602b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385815e3a0 con 0x7f385815dfc0 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38580c8fa0 0x7f38580c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38580c8fa0 0x7f38580c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36378/0 (socket says 172.21.15.73:36378) 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 -- 172.21.15.73:0/4207193942 learned_addr learned my addr 172.21.15.73:0/4207193942 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385e052640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385815dfc0 0x7f38580cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 -- 172.21.15.73:0/4207193942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385815dfc0 msgr2=0x7f38580cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:19.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385815dfc0 0x7f38580cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 -- 172.21.15.73:0/4207193942 >> v1:172.21.15.162:6789/0 conn(0x7f3858070130 legacy=0x7f38580705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.246+0000 7f385d851640 1 -- 172.21.15.73:0/4207193942 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385806c3a0 con 0x7f38580c8fa0 2023-12-19T16:17:19.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f385d851640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38580c8fa0 0x7f38580c9400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3848009870 tx=0x7f384801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a18dcc364299016 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f385d050640 1 -- 172.21.15.73:0/4207193942 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480aa670 con 0x7f38580c8fa0 2023-12-19T16:17:19.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f385d050640 1 -- 172.21.15.73:0/4207193942 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480aa7d0 con 0x7f38580c8fa0 2023-12-19T16:17:19.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f385d050640 1 -- 172.21.15.73:0/4207193942 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480aab60 con 0x7f38580c8fa0 2023-12-19T16:17:19.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- 172.21.15.73:0/4207193942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38580c8fa0 msgr2=0x7f38580c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38580c8fa0 0x7f38580c9400 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3848009870 tx=0x7f384801c510 comp rx=0 tx=0).stop 2023-12-19T16:17:19.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- 172.21.15.73:0/4207193942 shutdown_connections 2023-12-19T16:17:19.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38580c8fa0 0x7f38580c9400 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 --2- 172.21.15.73:0/4207193942 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f385815dfc0 0x7f38580cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- 172.21.15.73:0/4207193942 >> 172.21.15.73:0/4207193942 conn(0x7f38580b0270 msgr2=0x7f38580b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:19.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- 172.21.15.73:0/4207193942 shutdown_connections 2023-12-19T16:17:19.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- 172.21.15.73:0/4207193942 wait complete. 2023-12-19T16:17:19.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 Processor -- start 2023-12-19T16:17:19.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.250+0000 7f38602b6640 1 -- start start 2023-12-19T16:17:19.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3858070130 0x7f38580c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38580c8fa0 0x7f38580cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580c8810 con 0x7f385815dfc0 2023-12-19T16:17:19.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cdc40 con 0x7f38580c8fa0 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cc660 con 0x7f3858070130 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e052640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3858070130 0x7f38580c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36394/0 (socket says 172.21.15.73:36394) 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 -- 172.21.15.73:0/3801568738 learned_addr learned my addr 172.21.15.73:0/3801568738 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385d851640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38580c8fa0 0x7f38580cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 -- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3858070130 msgr2=0x7f38580c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3858070130 0x7f38580c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 -- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38580c8fa0 msgr2=0x7f38580cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38580c8fa0 0x7f38580cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 -- 172.21.15.73:0/3801568738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38480094d0 con 0x7f385815dfc0 2023-12-19T16:17:19.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f385e853640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f385000c730 tx=0x7f385000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850003b80 con 0x7f385815dfc0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850003ce0 con 0x7f385815dfc0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385000aa30 con 0x7f385815dfc0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580cc940 con 0x7f385815dfc0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580ccf00 con 0x7f385815dfc0 2023-12-19T16:17:19.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3858074050 con 0x7f385815dfc0 2023-12-19T16:17:19.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.254+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f385000ab90 con 0x7f385815dfc0 2023-12-19T16:17:19.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.258+0000 7f384effd640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.258+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3850082a20 con 0x7f385815dfc0 2023-12-19T16:17:19.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.258+0000 7f385e052640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.258+0000 7f385e052640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 0x7f383c067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3854006aa0 tx=0x7f3854008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.262+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3850050850 con 0x7f385815dfc0 2023-12-19T16:17:19.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.410+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38580b3990 con 0x7f385815dfc0 2023-12-19T16:17:19.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.410+0000 7f384effd640 1 -- 172.21.15.73:0/3801568738 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3850053e70 con 0x7f385815dfc0 2023-12-19T16:17:19.418 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T16:17:19.419 INFO:teuthology.orchestra.run.smithi073.stdout:] 2023-12-19T16:17:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 msgr2=0x7f383c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 0x7f383c067f20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3854006aa0 tx=0x7f3854008040 comp rx=0 tx=0).stop 2023-12-19T16:17:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 msgr2=0x7f38580c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f385000c730 tx=0x7f385000cbf0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 shutdown_connections 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f383c065a60 0x7f383c067f20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f385815dfc0 0x7f38580c5a70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38580c8fa0 0x7f38580cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 --2- 172.21.15.73:0/3801568738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3858070130 0x7f38580c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 >> 172.21.15.73:0/3801568738 conn(0x7f38580b0270 msgr2=0x7f385815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:19.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 shutdown_connections 2023-12-19T16:17:19.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.414+0000 7f38602b6640 1 -- 172.21.15.73:0/3801568738 wait complete. 2023-12-19T16:17:19.438 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T16:17:19.439 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T16:17:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 Processor -- start 2023-12-19T16:17:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 -- start start 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68c015cb70 0x7f68c00b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 0x7f68c00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c00cb0b0 con 0x7f68c00b3710 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00cb390 con 0x7f68c015cb70 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68c5539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00cb670 con 0x7f68c015cf50 2023-12-19T16:17:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68b67fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f68c00b3710 0x7f68c00b1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33454/0 (socket says 172.21.15.73:33454) 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68b67fc640 1 -- 172.21.15.73:0/2097990417 learned_addr learned my addr 172.21.15.73:0/2097990417 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68beffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f68c015cb70 0x7f68c00b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68bf7fe640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 0x7f68c00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68beffd640 1 -- 172.21.15.73:0/2097990417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 msgr2=0x7f68c00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68beffd640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 0x7f68c00cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68beffd640 1 -- 172.21.15.73:0/2097990417 >> v1:172.21.15.73:6789/0 conn(0x7f68c00b3710 legacy=0x7f68c00b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68beffd640 1 -- 172.21.15.73:0/2097990417 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00cb950 con 0x7f68c015cb70 2023-12-19T16:17:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68bf7fe640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 0x7f68c00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.574+0000 7f68be7fc640 1 -- 172.21.15.73:0/2097990417 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739686940 0 0) 0x7f68c00cb0b0 con 0x7f68c00b3710 2023-12-19T16:17:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68beffd640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c015cb70 0x7f68c00b14d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68b00097a0 tx=0x7f68b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c390d320a3ea01fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68be7fc640 1 -- 172.21.15.73:0/2097990417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00ab600 con 0x7f68c015cb70 2023-12-19T16:17:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68be7fc640 1 -- 172.21.15.73:0/2097990417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b00ab760 con 0x7f68c015cb70 2023-12-19T16:17:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68be7fc640 1 -- 172.21.15.73:0/2097990417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00abaf0 con 0x7f68c015cb70 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 -- 172.21.15.73:0/2097990417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c015cb70 msgr2=0x7f68c00b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c015cb70 0x7f68c00b14d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f68b00097a0 tx=0x7f68b001c460 comp rx=0 tx=0).stop 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 -- 172.21.15.73:0/2097990417 shutdown_connections 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cf50 0x7f68c00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 --2- 172.21.15.73:0/2097990417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c015cb70 0x7f68c00b14d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 -- 172.21.15.73:0/2097990417 >> 172.21.15.73:0/2097990417 conn(0x7f68c0099c30 msgr2=0x7f68c00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 -- 172.21.15.73:0/2097990417 shutdown_connections 2023-12-19T16:17:19.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.578+0000 7f68c5539640 1 -- 172.21.15.73:0/2097990417 wait complete. 2023-12-19T16:17:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 Processor -- start 2023-12-19T16:17:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- start start 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 0x7f68c0158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c015cf50 0x7f68c014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0155230 con 0x7f68c00b3710 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0156090 con 0x7f68c015cf50 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0155480 con 0x7f68c015cb70 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36422/0 (socket says 172.21.15.73:36422) 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 -- 172.21.15.73:0/3099514466 learned_addr learned my addr 172.21.15.73:0/3099514466 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68bf7fe640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c015cf50 0x7f68c014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68b67fc640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 0x7f68c0158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 -- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 msgr2=0x7f68c0158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 0x7f68c0158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 -- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c015cf50 msgr2=0x7f68c014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c015cf50 0x7f68c014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 -- 172.21.15.73:0/3099514466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00093b0 con 0x7f68c00b3710 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68b67fc640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 0x7f68c0158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68beffd640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68b00ad040 tx=0x7f68b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00b5810 con 0x7f68c00b3710 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b00b5970 con 0x7f68c00b3710 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b00b5d20 con 0x7f68c00b3710 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0155760 con 0x7f68c00b3710 2023-12-19T16:17:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.582+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0155d20 con 0x7f68c00b3710 2023-12-19T16:17:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c004e070 con 0x7f68c00b3710 2023-12-19T16:17:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68b00bf410 con 0x7f68c00b3710 2023-12-19T16:17:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68b7fff640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 0x7f68a0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68b011d800 con 0x7f68c00b3710 2023-12-19T16:17:19.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68b67fc640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 0x7f68a0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:19.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.586+0000 7f68b67fc640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 0x7f68a0067f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68c01504b0 tx=0x7f68a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:19.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.590+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f68b00eb470 con 0x7f68c00b3710 2023-12-19T16:17:19.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:19.738+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f68c00d11d0 con 0x7f68c00b3710 2023-12-19T16:17:20.730 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.722+0000 7f68b7fff640 1 -- 172.21.15.73:0/3099514466 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68b00eea90 con 0x7f68c00b3710 2023-12-19T16:17:20.730 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 msgr2=0x7f68a0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 0x7f68a0067f50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f68c01504b0 tx=0x7f68a8009040 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 msgr2=0x7f68c0154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68b00ad040 tx=0x7f68b001aca0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 shutdown_connections 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c015cf50 0x7f68c014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68c015cb70 0x7f68c0158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f68a0065a90 0x7f68a0067f50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 --2- 172.21.15.73:0/3099514466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68c00b3710 0x7f68c0154490 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 >> 172.21.15.73:0/3099514466 conn(0x7f68c0099c30 msgr2=0x7f68c00b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 shutdown_connections 2023-12-19T16:17:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.726+0000 7f68c5539640 1 -- 172.21.15.73:0/3099514466 wait complete. 2023-12-19T16:17:20.761 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T16:17:20.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.902+0000 7fc30b4ca640 1 Processor -- start 2023-12-19T16:17:20.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.902+0000 7fc30b4ca640 1 -- start start 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30b4ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc3040cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30b4ca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3040ccd20 0x7fc3040cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30b4ca640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30415aed0 con 0x7fc30415aaf0 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30b4ca640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040cbd60 con 0x7fc3040ccd20 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30b4ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30415f580 con 0x7fc3040cb390 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc30415aaf0 0x7fc30415e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33470/0 (socket says 172.21.15.73:33470) 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 -- 172.21.15.73:0/129686501 learned_addr learned my addr 172.21.15.73:0/129686501 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30acc9640 1 --2- 172.21.15.73:0/129686501 >> v2:172.21.15.162:3300/0 conn(0x7fc3040ccd20 0x7fc3040cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.914 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc309cc7640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc3040cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762159416 0 0) 0x7fc30415aed0 con 0x7fc30415aaf0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f0003530 con 0x7fc30415aaf0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722023646 0 0) 0x7fc2f0003530 con 0x7fc30415aaf0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 msgr2=0x7fc3040cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc3040cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 >> v2:172.21.15.162:3300/0 conn(0x7fc3040ccd20 msgr2=0x7fc3040cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 --2- 172.21.15.73:0/129686501 >> v2:172.21.15.162:3300/0 conn(0x7fc3040ccd20 0x7fc3040cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30415ed10 con 0x7fc30415aaf0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fc300001800 con 0x7fc30415aaf0 2023-12-19T16:17:20.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 >> v1:172.21.15.73:6789/0 conn(0x7fc30415aaf0 legacy=0x7fc30415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f0003980 0x7fc2f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f00047d0 0x7fc2f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc2f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cbd60 con 0x7fc2f0003980 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30415f580 con 0x7fc2f00047d0 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f000b990 con 0x7fc3040cb390 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f0003980 0x7fc2f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc309cc7640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f00047d0 0x7fc2f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30acc9640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc2f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 -- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 msgr2=0x7fc2f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc2f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 -- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f00047d0 msgr2=0x7fc2f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f00047d0 0x7fc2f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30a4c8640 1 -- 172.21.15.73:0/129686501 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0003530 con 0x7fc2f0003980 2023-12-19T16:17:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.906+0000 7fc30acc9640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3040cb390 0x7fc2f0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f0003980 0x7fc2f0003da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c210 tx=0x7fc30001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce4a47f5a483e6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000070d0 con 0x7fc2f0003980 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300007230 con 0x7fc2f0003980 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc3094c6640 1 -- 172.21.15.73:0/129686501 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000075e0 con 0x7fc2f0003980 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- 172.21.15.73:0/129686501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f0003980 msgr2=0x7fc2f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/129686501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f0003980 0x7fc2f0003da0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c210 tx=0x7fc30001cc30 comp rx=0 tx=0).stop 2023-12-19T16:17:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30acc9640 1 -- 172.21.15.73:0/129686501 reap_dead start 2023-12-19T16:17:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- 172.21.15.73:0/129686501 shutdown_connections 2023-12-19T16:17:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- 172.21.15.73:0/129686501 >> 172.21.15.73:0/129686501 conn(0x7fc30406a120 msgr2=0x7fc30406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- 172.21.15.73:0/129686501 shutdown_connections 2023-12-19T16:17:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- 172.21.15.73:0/129686501 wait complete. 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 Processor -- start 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.910+0000 7fc30b4ca640 1 -- start start 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f0003980 0x7fc30415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3041f91f0 0x7fc3041f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304160110 con 0x7fc30415fc90 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040abb90 con 0x7fc2f0003980 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041f62a0 con 0x7fc3041f91f0 2023-12-19T16:17:20.922 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36434/0 (socket says 172.21.15.73:36434) 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 -- 172.21.15.73:0/3375852037 learned_addr learned my addr 172.21.15.73:0/3375852037 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f0003980 0x7fc30415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30acc9640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3041f91f0 0x7fc3041f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 -- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3041f91f0 msgr2=0x7fc3041f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3041f91f0 0x7fc3041f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 -- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f0003980 msgr2=0x7fc30415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f0003980 0x7fc30415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 -- 172.21.15.73:0/3375852037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3041f6580 con 0x7fc30415fc90 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc309cc7640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4011960 tx=0x7fc2f4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400faf0 con 0x7fc30415fc90 2023-12-19T16:17:20.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400fc50 con 0x7fc30415fc90 2023-12-19T16:17:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4014440 con 0x7fc30415fc90 2023-12-19T16:17:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041f6880 con 0x7fc30415fc90 2023-12-19T16:17:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3041f6e40 con 0x7fc30415fc90 2023-12-19T16:17:20.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.914+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30404e000 con 0x7fc30415fc90 2023-12-19T16:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.918+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2f40145a0 con 0x7fc30415fc90 2023-12-19T16:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.918+0000 7fc2faffd640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 0x7fc2e8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.918+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc2f4083610 con 0x7fc30415fc90 2023-12-19T16:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.918+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 0x7fc2e8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:20.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.918+0000 7fc30a4c8640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 0x7fc2e8067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3000aa000 tx=0x7fc3000b0040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:20.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:20.922+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2f40512f0 con 0x7fc30415fc90 2023-12-19T16:17:21.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.070+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc30406ca50 con 0x7fc30415fc90 2023-12-19T16:17:21.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.726+0000 7fc2faffd640 1 -- 172.21.15.73:0/3375852037 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc2f4054910 con 0x7fc30415fc90 2023-12-19T16:17:21.735 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2023-12-19T16:17:21.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.734+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 msgr2=0x7fc2e8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:21.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.734+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 0x7fc2e8067f50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc3000aa000 tx=0x7fc3000b0040 comp rx=0 tx=0).stop 2023-12-19T16:17:21.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.734+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 msgr2=0x7fc3041f8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:21.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.734+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4011960 tx=0x7fc2f4011e20 comp rx=0 tx=0).stop 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 shutdown_connections 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3041f91f0 0x7fc3041f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc2e8065a90 0x7fc2e8067f50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc30415fc90 0x7fc3041f8cb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 --2- 172.21.15.73:0/3375852037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2f0003980 0x7fc30415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 >> 172.21.15.73:0/3375852037 conn(0x7fc30406a120 msgr2=0x7fc30415e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 shutdown_connections 2023-12-19T16:17:21.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.738+0000 7fc30b4ca640 1 -- 172.21.15.73:0/3375852037 wait complete. 2023-12-19T16:17:21.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T16:17:21.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.914+0000 7f346a760640 1 Processor -- start 2023-12-19T16:17:21.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.914+0000 7f346a760640 1 -- start start 2023-12-19T16:17:21.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34641598c0 0x7f346406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 0x7f34640b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34640b0660 0x7f34640c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640b0af0 con 0x7f34641598c0 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640cce80 con 0x7f346406d410 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f346a760640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346406cad0 con 0x7f34640b0660 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34641598c0 0x7f346406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34641598c0 0x7f346406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36436/0 (socket says 172.21.15.73:36436) 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 -- 172.21.15.73:0/691032286 learned_addr learned my addr 172.21.15.73:0/691032286 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 -- 172.21.15.73:0/691032286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34640b0660 msgr2=0x7f34640c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 --2- 172.21.15.73:0/691032286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34640b0660 0x7f34640c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 -- 172.21.15.73:0/691032286 >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 msgr2=0x7f34640b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f34637fe640 1 --2- 172.21.15.73:0/691032286 >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 0x7f34640b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 --2- 172.21.15.73:0/691032286 >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 0x7f34640b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f3463fff640 1 -- 172.21.15.73:0/691032286 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640cc270 con 0x7f34641598c0 2023-12-19T16:17:21.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.918+0000 7f34637fe640 1 --2- 172.21.15.73:0/691032286 >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 0x7f34640b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:21.927 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f3463fff640 1 --2- 172.21.15.73:0/691032286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641598c0 0x7f346406c590 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34640ad980 tx=0x7f345401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537d47abbde517f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:21.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f3462ffd640 1 -- 172.21.15.73:0/691032286 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540aa5f0 con 0x7f34641598c0 2023-12-19T16:17:21.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f3462ffd640 1 -- 172.21.15.73:0/691032286 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540aa750 con 0x7f34641598c0 2023-12-19T16:17:21.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f3462ffd640 1 -- 172.21.15.73:0/691032286 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540aaae0 con 0x7f34641598c0 2023-12-19T16:17:21.928 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- 172.21.15.73:0/691032286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641598c0 msgr2=0x7f346406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 --2- 172.21.15.73:0/691032286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641598c0 0x7f346406c590 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34640ad980 tx=0x7f345401c4d0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- 172.21.15.73:0/691032286 shutdown_connections 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 --2- 172.21.15.73:0/691032286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34640b0660 0x7f34640c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 --2- 172.21.15.73:0/691032286 >> v2:172.21.15.162:3300/0 conn(0x7f346406d410 0x7f34640b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 --2- 172.21.15.73:0/691032286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641598c0 0x7f346406c590 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- 172.21.15.73:0/691032286 >> 172.21.15.73:0/691032286 conn(0x7f346406a570 msgr2=0x7f34640ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- 172.21.15.73:0/691032286 shutdown_connections 2023-12-19T16:17:21.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- 172.21.15.73:0/691032286 wait complete. 2023-12-19T16:17:21.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 Processor -- start 2023-12-19T16:17:21.930 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.922+0000 7f346a760640 1 -- start start 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 0x7f34641f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34641598c0 0x7f3464070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c4510 con 0x7f34640b0660 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34641f5ab0 con 0x7f346406d410 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34641f5d90 con 0x7f34641598c0 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36446/0 (socket says 172.21.15.73:36446) 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 -- 172.21.15.73:0/3289356196 learned_addr learned my addr 172.21.15.73:0/3289356196 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:21.932 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3463fff640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 0x7f34641f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3468cfd640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34641598c0 0x7f3464070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 -- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34641598c0 msgr2=0x7f3464070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34641598c0 0x7f3464070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 -- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 msgr2=0x7f34641f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 0x7f34641f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 -- 172.21.15.73:0/3289356196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540094d0 con 0x7f34640b0660 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3463fff640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 0x7f34641f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:21.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f34637fe640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f345800c7c0 tx=0x7f345800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458007a30 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458007b90 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345800ce70 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34641f84c0 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34641f8a80 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346404e070 con 0x7f34640b0660 2023-12-19T16:17:21.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.926+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34580113f0 con 0x7f34640b0660 2023-12-19T16:17:21.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.930+0000 7f3460ff9640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 0x7f3450067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:21.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.930+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3458083810 con 0x7f34640b0660 2023-12-19T16:17:21.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.930+0000 7f3463fff640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 0x7f3450067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:21.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.930+0000 7f3463fff640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 0x7f3450067f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34540ae000 tx=0x7f34540a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:21.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:21.930+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3458051210 con 0x7f34640b0660 2023-12-19T16:17:22.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.114+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f34640c7500 con 0x7f34640b0660 2023-12-19T16:17:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.122+0000 7f3460ff9640 1 -- 172.21.15.73:0/3289356196 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3458054830 con 0x7f34640b0660 2023-12-19T16:17:22.131 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 6 and data pool 7 2023-12-19T16:17:22.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 msgr2=0x7f3450067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 0x7f3450067f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34540ae000 tx=0x7f34540a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 msgr2=0x7f34641508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f345800c7c0 tx=0x7f345800cc80 comp rx=0 tx=0).stop 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 shutdown_connections 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34641598c0 0x7f3464070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3450065ab0 0x7f3450067f70 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34540ae000 tx=0x7f34540a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34640b0660 0x7f34641508a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 --2- 172.21.15.73:0/3289356196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f346406d410 0x7f34641f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.126+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 >> 172.21.15.73:0/3289356196 conn(0x7f346406a570 msgr2=0x7f34640afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.134+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 shutdown_connections 2023-12-19T16:17:22.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.138+0000 7f346a760640 1 -- 172.21.15.73:0/3289356196 wait complete. 2023-12-19T16:17:22.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:22.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.306+0000 7f10baf39640 1 Processor -- start 2023-12-19T16:17:22.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.306+0000 7f10baf39640 1 -- start start 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10baf39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 0x7f10b40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10baf39640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 0x7f10b40cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10baf39640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40ca6f0 con 0x7f10b415cc80 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10baf39640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40cccb0 con 0x7f10b40cbe90 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10baf39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4159530 con 0x7f10b406ddf0 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b94d6640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10b415cc80 0x7f10b4070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33474/0 (socket says 172.21.15.73:33474) 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b94d6640 1 -- 172.21.15.73:0/197998671 learned_addr learned my addr 172.21.15.73:0/197998671 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/197998671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 0x7f10b40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b3fff640 1 --2- 172.21.15.73:0/197998671 >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 0x7f10b40cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b37fe640 1 -- 172.21.15.73:0/197998671 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524332329 0 0) 0x7f10b40ca6f0 con 0x7f10b415cc80 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b37fe640 1 -- 172.21.15.73:0/197998671 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4005740 con 0x7f10b415cc80 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 -- 172.21.15.73:0/197998671 >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 msgr2=0x7f10b40cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/197998671 >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 0x7f10b40cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 -- 172.21.15.73:0/197998671 >> v1:172.21.15.73:6789/0 conn(0x7f10b415cc80 legacy=0x7f10b4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 -- 172.21.15.73:0/197998671 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40c9ae0 con 0x7f10b406ddf0 2023-12-19T16:17:22.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b3fff640 1 --2- 172.21.15.73:0/197998671 >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 0x7f10b40cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:22.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.310+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/197998671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 0x7f10b40cce70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097f0 tx=0x7f10a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b3a9533f987bd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10b37fe640 1 -- 172.21.15.73:0/197998671 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80ac630 con 0x7f10b406ddf0 2023-12-19T16:17:22.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10b37fe640 1 -- 172.21.15.73:0/197998671 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a80ac790 con 0x7f10b406ddf0 2023-12-19T16:17:22.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10b37fe640 1 -- 172.21.15.73:0/197998671 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80acb20 con 0x7f10b406ddf0 2023-12-19T16:17:22.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- 172.21.15.73:0/197998671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 msgr2=0x7f10b40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- 172.21.15.73:0/197998671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 0x7f10b40cce70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097f0 tx=0x7f10a801c450 comp rx=0 tx=0).stop 2023-12-19T16:17:22.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- 172.21.15.73:0/197998671 shutdown_connections 2023-12-19T16:17:22.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- 172.21.15.73:0/197998671 >> v2:172.21.15.162:3300/0 conn(0x7f10b40cbe90 0x7f10b40cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- 172.21.15.73:0/197998671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b406ddf0 0x7f10b40cce70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- 172.21.15.73:0/197998671 >> 172.21.15.73:0/197998671 conn(0x7f10b40b0270 msgr2=0x7f10b40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- 172.21.15.73:0/197998671 shutdown_connections 2023-12-19T16:17:22.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- 172.21.15.73:0/197998671 wait complete. 2023-12-19T16:17:22.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 Processor -- start 2023-12-19T16:17:22.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- start start 2023-12-19T16:17:22.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 0x7f10b4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b415cc80 0x7f10b406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c6220 con 0x7f10b40cbe90 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c6da0 con 0x7f10b406ddf0 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.314+0000 7f10baf39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4151490 con 0x7f10b415cc80 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36448/0 (socket says 172.21.15.73:36448) 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 -- 172.21.15.73:0/2231429133 learned_addr learned my addr 172.21.15.73:0/2231429133 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 0x7f10b4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b94d6640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b415cc80 0x7f10b406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 -- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b415cc80 msgr2=0x7f10b406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b415cc80 0x7f10b406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 -- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 msgr2=0x7f10b4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 0x7f10b4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 -- 172.21.15.73:0/2231429133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a0009420 con 0x7f10b40cbe90 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 0x7f10b4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b3fff640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f10a000ec10 tx=0x7f10a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000cc30 con 0x7f10b40cbe90 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a000cd90 con 0x7f10b40cbe90 2023-12-19T16:17:22.326 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0013690 con 0x7f10b40cbe90 2023-12-19T16:17:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a8009420 con 0x7f10b40cbe90 2023-12-19T16:17:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b40c6750 con 0x7f10b40cbe90 2023-12-19T16:17:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b4074050 con 0x7f10b40cbe90 2023-12-19T16:17:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10a00137f0 con 0x7f10b40cbe90 2023-12-19T16:17:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 0x7f1098067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.318+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10a0083550 con 0x7f10b40cbe90 2023-12-19T16:17:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.322+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 0x7f1098067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.328 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.322+0000 7f10b8cd5640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 0x7f1098067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ae000 tx=0x7f10a80a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.330 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.322+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f10a0050e70 con 0x7f10b40cbe90 2023-12-19T16:17:22.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.474+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10b406cf60 con 0x7f10b40cbe90 2023-12-19T16:17:22.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10b17fa640 1 -- 172.21.15.73:0/2231429133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f10a0054490 con 0x7f10b40cbe90 2023-12-19T16:17:22.484 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:22.484 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:17:22.119729+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 msgr2=0x7f1098067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 0x7f1098067f20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f10a80ae000 tx=0x7f10a80a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 msgr2=0x7f10b40c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f10a000ec10 tx=0x7f10a000c520 comp rx=0 tx=0).stop 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 shutdown_connections 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b415cc80 0x7f10b406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1098065a60 0x7f1098067f20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10b40cbe90 0x7f10b40c7230 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 --2- 172.21.15.73:0/2231429133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b406ddf0 0x7f10b4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 >> 172.21.15.73:0/2231429133 conn(0x7f10b40b0270 msgr2=0x7f10b40aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 shutdown_connections 2023-12-19T16:17:22.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.478+0000 7f10baf39640 1 -- 172.21.15.73:0/2231429133 wait complete. 2023-12-19T16:17:22.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:22.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.634+0000 7f362dab6640 1 Processor -- start 2023-12-19T16:17:22.643 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 -- start start 2023-12-19T16:17:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f362815dfc0 0x7f36280cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36280c8fa0 0x7f36280c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280c9940 con 0x7f3628070130 2023-12-19T16:17:22.644 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362806d720 con 0x7f36280c8fa0 2023-12-19T16:17:22.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f362dab6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362815e3a0 con 0x7f362815dfc0 2023-12-19T16:17:22.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f361ffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f36280c8fa0 0x7f36280c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f3627fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3628070130 0x7f3628070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33482/0 (socket says 172.21.15.73:33482) 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f3627fff640 1 -- 172.21.15.73:0/644974525 learned_addr learned my addr 172.21.15.73:0/644974525 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f36277fe640 1 --2- 172.21.15.73:0/644974525 >> v2:172.21.15.162:3300/0 conn(0x7f362815dfc0 0x7f36280cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f361ffff640 1 -- 172.21.15.73:0/644974525 >> v2:172.21.15.162:3300/0 conn(0x7f362815dfc0 msgr2=0x7f36280cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f361ffff640 1 --2- 172.21.15.73:0/644974525 >> v2:172.21.15.162:3300/0 conn(0x7f362815dfc0 0x7f36280cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f361ffff640 1 -- 172.21.15.73:0/644974525 >> v1:172.21.15.73:6789/0 conn(0x7f3628070130 legacy=0x7f3628070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f361ffff640 1 -- 172.21.15.73:0/644974525 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362806c3a0 con 0x7f36280c8fa0 2023-12-19T16:17:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.638+0000 7f3626ffd640 1 -- 172.21.15.73:0/644974525 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308273656 0 0) 0x7f36280c9940 con 0x7f3628070130 2023-12-19T16:17:22.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f361ffff640 1 --2- 172.21.15.73:0/644974525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c9400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f36280ce580 tx=0x7f361001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2914de3d8dc263b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f3626ffd640 1 -- 172.21.15.73:0/644974525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100a7070 con 0x7f36280c8fa0 2023-12-19T16:17:22.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f3626ffd640 1 -- 172.21.15.73:0/644974525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100ab430 con 0x7f36280c8fa0 2023-12-19T16:17:22.648 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f3626ffd640 1 -- 172.21.15.73:0/644974525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100ab7c0 con 0x7f36280c8fa0 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- 172.21.15.73:0/644974525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 msgr2=0x7f36280c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 --2- 172.21.15.73:0/644974525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c9400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f36280ce580 tx=0x7f361001c430 comp rx=0 tx=0).stop 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- 172.21.15.73:0/644974525 shutdown_connections 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 --2- 172.21.15.73:0/644974525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c9400 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 --2- 172.21.15.73:0/644974525 >> v2:172.21.15.162:3300/0 conn(0x7f362815dfc0 0x7f36280cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- 172.21.15.73:0/644974525 >> 172.21.15.73:0/644974525 conn(0x7f36280b0270 msgr2=0x7f36280b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- 172.21.15.73:0/644974525 shutdown_connections 2023-12-19T16:17:22.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- 172.21.15.73:0/644974525 wait complete. 2023-12-19T16:17:22.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 Processor -- start 2023-12-19T16:17:22.651 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.642+0000 7f362dab6640 1 -- start start 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3628070130 0x7f362814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362815dfc0 0x7f362815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c37f0 con 0x7f36280c8fa0 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c2be0 con 0x7f3628070130 2023-12-19T16:17:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c2ec0 con 0x7f362815dfc0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36466/0 (socket says 172.21.15.73:36466) 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 -- 172.21.15.73:0/2559240035 learned_addr learned my addr 172.21.15.73:0/2559240035 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f36277fe640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3628070130 0x7f362814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f3627fff640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362815dfc0 0x7f362815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 -- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362815dfc0 msgr2=0x7f362815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362815dfc0 0x7f362815caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 -- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3628070130 msgr2=0x7f362814b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3628070130 0x7f362814b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 -- 172.21.15.73:0/2559240035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610009420 con 0x7f36280c8fa0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f361ffff640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f36100ad040 tx=0x7f361001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100bf610 con 0x7f36280c8fa0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100bf790 con 0x7f36280c8fa0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36100bfb40 con 0x7f36280c8fa0 2023-12-19T16:17:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280c31a0 con 0x7f36280c8fa0 2023-12-19T16:17:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362814b840 con 0x7f36280c8fa0 2023-12-19T16:17:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.646+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280c6f10 con 0x7f36280c8fa0 2023-12-19T16:17:22.655 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.650+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f36100bfca0 con 0x7f36280c8fa0 2023-12-19T16:17:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.650+0000 7f3624ff9640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 0x7f3608067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.650+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f361011d8b0 con 0x7f36280c8fa0 2023-12-19T16:17:22.656 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.650+0000 7f36277fe640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 0x7f3608067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.657 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.650+0000 7f36277fe640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 0x7f3608067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f362815d9e0 tx=0x7f3618008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.660 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.654+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f36100eb440 con 0x7f36280c8fa0 2023-12-19T16:17:22.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.806+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3628074050 con 0x7f36280c8fa0 2023-12-19T16:17:22.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f3624ff9640 1 -- 172.21.15.73:0/2559240035 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f36100eea60 con 0x7f36280c8fa0 2023-12-19T16:17:22.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:22.816 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":51,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:17:22.119729+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 msgr2=0x7f3608067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 0x7f3608067f20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f362815d9e0 tx=0x7f3618008040 comp rx=0 tx=0).stop 2023-12-19T16:17:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 msgr2=0x7f36280c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f36100ad040 tx=0x7f361001ac70 comp rx=0 tx=0).stop 2023-12-19T16:17:22.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 shutdown_connections 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f362815dfc0 0x7f362815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3608065a60 0x7f3608067f20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f36280c8fa0 0x7f36280c2270 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 --2- 172.21.15.73:0/2559240035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3628070130 0x7f362814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 >> 172.21.15.73:0/2559240035 conn(0x7f36280b0270 msgr2=0x7f36280af700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 shutdown_connections 2023-12-19T16:17:22.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.810+0000 7f362dab6640 1 -- 172.21.15.73:0/2559240035 wait complete. 2023-12-19T16:17:22.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T16:17:22.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.970+0000 7f864c22d640 1 Processor -- start 2023-12-19T16:17:22.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.970+0000 7f864c22d640 1 -- start start 2023-12-19T16:17:22.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864c22d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 0x7f86440b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864c22d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440cce80 con 0x7f86440b0660 2023-12-19T16:17:22.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864c22d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86440cc270 con 0x7f86441598c0 2023-12-19T16:17:22.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864c22d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86440b0ae0 con 0x7f864406d410 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864a7ca640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86440b0660 0x7f86440cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33496/0 (socket says 172.21.15.73:33496) 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f864a7ca640 1 -- 172.21.15.73:0/2349616289 learned_addr learned my addr 172.21.15.73:0/2349616289 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f86497c8640 1 --2- 172.21.15.73:0/2349616289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 0x7f86440b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510805733 0 0) 0x7f86440cce80 con 0x7f86440b0660 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8630003530 con 0x7f86440b0660 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217985456 0 0) 0x7f86440cc270 con 0x7f86441598c0 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86440cce80 con 0x7f86441598c0 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f86497c8640 1 -- 172.21.15.73:0/2349616289 >> v1:172.21.15.162:6789/0 conn(0x7f86441598c0 legacy=0x7f864406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f86497c8640 1 -- 172.21.15.73:0/2349616289 >> v1:172.21.15.73:6789/0 conn(0x7f86440b0660 legacy=0x7f86440cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.974+0000 7f86497c8640 1 -- 172.21.15.73:0/2349616289 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86440cc550 con 0x7f864406d410 2023-12-19T16:17:22.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f86497c8640 1 --2- 172.21.15.73:0/2349616289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 0x7f86440b0120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86340097f0 tx=0x7f863401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e34e52e4cbe4d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340aa5f0 con 0x7f864406d410 2023-12-19T16:17:22.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340aa750 con 0x7f864406d410 2023-12-19T16:17:22.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f8648fc7640 1 -- 172.21.15.73:0/2349616289 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340aaac0 con 0x7f864406d410 2023-12-19T16:17:22.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- 172.21.15.73:0/2349616289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 msgr2=0x7f86440b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 --2- 172.21.15.73:0/2349616289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 0x7f86440b0120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86340097f0 tx=0x7f863401c490 comp rx=0 tx=0).stop 2023-12-19T16:17:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- 172.21.15.73:0/2349616289 shutdown_connections 2023-12-19T16:17:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 --2- 172.21.15.73:0/2349616289 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f864406d410 0x7f86440b0120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- 172.21.15.73:0/2349616289 >> 172.21.15.73:0/2349616289 conn(0x7f864406a570 msgr2=0x7f86440ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- 172.21.15.73:0/2349616289 shutdown_connections 2023-12-19T16:17:22.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- 172.21.15.73:0/2349616289 wait complete. 2023-12-19T16:17:22.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 Processor -- start 2023-12-19T16:17:22.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 -- start start 2023-12-19T16:17:22.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.978+0000 7f864c22d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 0x7f86441f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 0x7f8644157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644157610 con 0x7f864406d410 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644153440 con 0x7f86440b0660 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8644158e00 con 0x7f86441598c0 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36482/0 (socket says 172.21.15.73:36482) 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 -- 172.21.15.73:0/3378706169 learned_addr learned my addr 172.21.15.73:0/3378706169 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864a7ca640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 0x7f8644157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 -- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 msgr2=0x7f8644157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f86497c8640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 0x7f86441f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.989 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 0x7f8644157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 -- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 msgr2=0x7f86441f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 0x7f86441f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 -- 172.21.15.73:0/3378706169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634009420 con 0x7f864406d410 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864a7ca640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 0x7f8644157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f86497c8640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 0x7f86441f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f8649fc9640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f864000c460 tx=0x7f864000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400052d0 con 0x7f864406d410 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8640005450 con 0x7f864406d410 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8640003840 con 0x7f864406d410 2023-12-19T16:17:22.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86440c3990 con 0x7f864406d410 2023-12-19T16:17:22.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644156f50 con 0x7f864406d410 2023-12-19T16:17:22.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864404e070 con 0x7f864406d410 2023-12-19T16:17:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86400039a0 con 0x7f864406d410 2023-12-19T16:17:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.982+0000 7f863a7fc640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 0x7f8628067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.986+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8640082730 con 0x7f864406d410 2023-12-19T16:17:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.986+0000 7f86497c8640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 0x7f8628067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:22.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.986+0000 7f86497c8640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 0x7f8628067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86340ae000 tx=0x7f86340a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:22.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:22.990+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86400500f0 con 0x7f864406d410 2023-12-19T16:17:23.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:23.174+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f86441590d0 con 0x7f864406d410 2023-12-19T16:17:24.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f863a7fc640 1 -- 172.21.15.73:0/3378706169 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8640053710 con 0x7f864406d410 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 msgr2=0x7f8628067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 0x7f8628067f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f86340ae000 tx=0x7f86340a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 msgr2=0x7f8644164a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f864000c460 tx=0x7f864000c920 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 shutdown_connections 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86441598c0 0x7f8644157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86440b0660 0x7f86441f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8628065a60 0x7f8628067f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 --2- 172.21.15.73:0/3378706169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f864406d410 0x7f8644164a60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 >> 172.21.15.73:0/3378706169 conn(0x7f864406a570 msgr2=0x7f86440afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 shutdown_connections 2023-12-19T16:17:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.130+0000 7f864c22d640 1 -- 172.21.15.73:0/3378706169 wait complete. 2023-12-19T16:17:24.161 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T16:17:24.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T16:17:24.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 Processor -- start 2023-12-19T16:17:24.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 -- start start 2023-12-19T16:17:24.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f602c158650 0x7f602c070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c06ffb0 con 0x7f602c15e4d0 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c15b730 con 0x7f602c158270 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f6034020640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c15ba10 con 0x7f602c158650 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f60325bd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f602c15e4d0 0x7f602c06bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33502/0 (socket says 172.21.15.73:33502) 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f60315bb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f602c158650 0x7f602c070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.298+0000 7f60325bd640 1 -- 172.21.15.73:0/429022656 learned_addr learned my addr 172.21.15.73:0/429022656 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f60315bb640 1 -- 172.21.15.73:0/429022656 >> v1:172.21.15.162:6789/0 conn(0x7f602c158270 legacy=0x7f602c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f60315bb640 1 -- 172.21.15.73:0/429022656 >> v1:172.21.15.73:6789/0 conn(0x7f602c15e4d0 legacy=0x7f602c06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f60315bb640 1 -- 172.21.15.73:0/429022656 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c15bcf0 con 0x7f602c158650 2023-12-19T16:17:24.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6030dba640 1 -- 172.21.15.73:0/429022656 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122227912 0 0) 0x7f602c06ffb0 con 0x7f602c15e4d0 2023-12-19T16:17:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f60315bb640 1 --2- 172.21.15.73:0/429022656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c070790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f602c0701a0 tx=0x7f601c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d57f759ff00edc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6030dba640 1 -- 172.21.15.73:0/429022656 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0ab600 con 0x7f602c158650 2023-12-19T16:17:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6030dba640 1 -- 172.21.15.73:0/429022656 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c0a7050 con 0x7f602c158650 2023-12-19T16:17:24.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6030dba640 1 -- 172.21.15.73:0/429022656 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0ab980 con 0x7f602c158650 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6034020640 1 -- 172.21.15.73:0/429022656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 msgr2=0x7f602c070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6034020640 1 --2- 172.21.15.73:0/429022656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c070790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f602c0701a0 tx=0x7f601c01c3a0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6034020640 1 -- 172.21.15.73:0/429022656 shutdown_connections 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6034020640 1 --2- 172.21.15.73:0/429022656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c070790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.302+0000 7f6034020640 1 -- 172.21.15.73:0/429022656 >> 172.21.15.73:0/429022656 conn(0x7f602c06a570 msgr2=0x7f602c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- 172.21.15.73:0/429022656 shutdown_connections 2023-12-19T16:17:24.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- 172.21.15.73:0/429022656 wait complete. 2023-12-19T16:17:24.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 Processor -- start 2023-12-19T16:17:24.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- start start 2023-12-19T16:17:24.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c158270 0x7f602c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c15e4d0 0x7f602c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c150270 con 0x7f602c158650 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c153250 con 0x7f602c158270 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6034020640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c151df0 con 0x7f602c15e4d0 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36488/0 (socket says 172.21.15.73:36488) 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 -- 172.21.15.73:0/1368751099 learned_addr learned my addr 172.21.15.73:0/1368751099 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f6031dbc640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c158270 0x7f602c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60325bd640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c15e4d0 0x7f602c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 -- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c15e4d0 msgr2=0x7f602c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c15e4d0 0x7f602c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 -- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c158270 msgr2=0x7f602c14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c158270 0x7f602c14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 -- 172.21.15.73:0/1368751099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009420 con 0x7f602c158650 2023-12-19T16:17:24.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60315bb640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f601c019fd0 tx=0x7f601c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.306+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c004020 con 0x7f602c158650 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c004180 con 0x7f602c158650 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c06d140 con 0x7f602c158650 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0044f0 con 0x7f602c158650 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c152040 con 0x7f602c158650 2023-12-19T16:17:24.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c04e070 con 0x7f602c158650 2023-12-19T16:17:24.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f601c0b2040 con 0x7f602c158650 2023-12-19T16:17:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f60227fc640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 0x7f6010067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f601c11cfe0 con 0x7f602c158650 2023-12-19T16:17:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f6031dbc640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 0x7f6010067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:24.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.310+0000 7f6031dbc640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 0x7f6010067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:24.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.314+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f601c0ea9d0 con 0x7f602c158650 2023-12-19T16:17:24.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:24.498+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f602c158050 con 0x7f602c158650 2023-12-19T16:17:25.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.134+0000 7f60227fc640 1 -- 172.21.15.73:0/1368751099 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f601c0b0020 con 0x7f602c158650 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 msgr2=0x7f6010067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 0x7f6010067f20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6028007fd0 tx=0x7f6028009040 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 msgr2=0x7f602c14fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f601c019fd0 tx=0x7f601c019140 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 shutdown_connections 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f602c15e4d0 0x7f602c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6010065a60 0x7f6010067f20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c158650 0x7f602c14fd30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 --2- 172.21.15.73:0/1368751099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f602c158270 0x7f602c14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 >> 172.21.15.73:0/1368751099 conn(0x7f602c06a570 msgr2=0x7f602c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 shutdown_connections 2023-12-19T16:17:25.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.138+0000 7f6034020640 1 -- 172.21.15.73:0/1368751099 wait complete. 2023-12-19T16:17:25.166 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T16:17:25.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.298+0000 7f473228c640 1 Processor -- start 2023-12-19T16:17:25.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 -- start start 2023-12-19T16:17:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f472c159830 0x7f472c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0b40b0 0x7f472c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c15ad00 con 0x7f472c0cda70 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c15e110 con 0x7f472c159830 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f473228c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0cdf00 con 0x7f472c0b40b0 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f472c159830 0x7f472c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f4730829640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f472c0cda70 0x7f472c0cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41400/0 (socket says 172.21.15.73:41400) 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f4730829640 1 -- 172.21.15.73:0/343118312 learned_addr learned my addr 172.21.15.73:0/343118312 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472b7fe640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0b40b0 0x7f472c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.309 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472affd640 1 -- 172.21.15.73:0/343118312 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133011879 0 0) 0x7f472c15ad00 con 0x7f472c0cda70 2023-12-19T16:17:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472bfff640 1 -- 172.21.15.73:0/343118312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0b40b0 msgr2=0x7f472c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472bfff640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0b40b0 0x7f472c0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472bfff640 1 -- 172.21.15.73:0/343118312 >> v1:172.21.15.73:6789/0 conn(0x7f472c0cda70 legacy=0x7f472c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.302+0000 7f472bfff640 1 -- 172.21.15.73:0/343118312 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0ce2d0 con 0x7f472c159830 2023-12-19T16:17:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f472bfff640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c159830 0x7f472c15a7c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097c0 tx=0x7f471c01e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d07e4a5ee4b769a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f472affd640 1 -- 172.21.15.73:0/343118312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b2600 con 0x7f472c159830 2023-12-19T16:17:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f472affd640 1 -- 172.21.15.73:0/343118312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0b2760 con 0x7f472c159830 2023-12-19T16:17:25.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f472affd640 1 -- 172.21.15.73:0/343118312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b2af0 con 0x7f472c159830 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- 172.21.15.73:0/343118312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c159830 msgr2=0x7f472c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c159830 0x7f472c15a7c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f471c0097c0 tx=0x7f471c01e5d0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- 172.21.15.73:0/343118312 shutdown_connections 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0b40b0 0x7f472c0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 --2- 172.21.15.73:0/343118312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c159830 0x7f472c15a7c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- 172.21.15.73:0/343118312 >> 172.21.15.73:0/343118312 conn(0x7f472c0b0270 msgr2=0x7f472c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- 172.21.15.73:0/343118312 shutdown_connections 2023-12-19T16:17:25.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- 172.21.15.73:0/343118312 wait complete. 2023-12-19T16:17:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 Processor -- start 2023-12-19T16:17:25.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.306+0000 7f473228c640 1 -- start start 2023-12-19T16:17:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 0x7f472c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 0x7f472c0ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0c45b0 con 0x7f472c0b40b0 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0c7c40 con 0x7f472c0cda70 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c0c3930 con 0x7f472c159830 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36540/0 (socket says 172.21.15.73:36540) 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 -- 172.21.15.73:0/566490435 learned_addr learned my addr 172.21.15.73:0/566490435 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4730829640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 0x7f472c0ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472b7fe640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 0x7f472c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 -- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 msgr2=0x7f472c0ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 0x7f472c0ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 -- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 msgr2=0x7f472c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 0x7f472c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 -- 172.21.15.73:0/566490435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009420 con 0x7f472c0b40b0 2023-12-19T16:17:25.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472b7fe640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 0x7f472c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4730829640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 0x7f472c0ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f472bfff640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f471c01c200 tx=0x7f471c01b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b6040 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0b2ce0 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c004230 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0c3c10 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c0c41d0 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0c46f0 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.310+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f471c004390 con 0x7f472c0b40b0 2023-12-19T16:17:25.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.314+0000 7f4728ff9640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 0x7f4718067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.314+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f471c11f090 con 0x7f472c0b40b0 2023-12-19T16:17:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.314+0000 7f472b7fe640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 0x7f4718067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.314+0000 7f472b7fe640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 0x7f4718067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f472c0c5320 tx=0x7f4720008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.318+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f472c0c46f0 con 0x7f472c0b40b0 2023-12-19T16:17:25.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472c0c46f0 con 0x7f472c0b40b0 2023-12-19T16:17:25.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f4728ff9640 1 -- 172.21.15.73:0/566490435 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f472c0c46f0 con 0x7f472c0b40b0 2023-12-19T16:17:25.504 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:25.504 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1099449589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1099449589},{"type":"v1","addr":"172.21.15.162:6833","nonce":1099449589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2309978342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2309978342},{"type":"v1","addr":"172.21.15.162:6835","nonce":2309978342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5433,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1926317864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1926317864},{"type":"v1","addr":"172.21.15.73:6836","nonce":1926317864}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:25.133270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2630347924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2630347924},{"type":"v1","addr":"172.21.15.73:6837","nonce":2630347924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:25.504 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 30 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 msgr2=0x7f4718067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 0x7f4718067f20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f472c0c5320 tx=0x7f4720008040 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 msgr2=0x7f472c0c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f471c01c200 tx=0x7f471c01b370 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 shutdown_connections 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c159830 0x7f472c0ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0cda70 0x7f472c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4718065a60 0x7f4718067f20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 --2- 172.21.15.73:0/566490435 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f472c0b40b0 0x7f472c0c32c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 >> 172.21.15.73:0/566490435 conn(0x7f472c0b0270 msgr2=0x7f472c06d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 shutdown_connections 2023-12-19T16:17:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.498+0000 7f473228c640 1 -- 172.21.15.73:0/566490435 wait complete. 2023-12-19T16:17:25.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:17:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.654+0000 7f08c0f6d640 1 Processor -- start 2023-12-19T16:17:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.654+0000 7f08c0f6d640 1 -- start start 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08c0f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08bc0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08c0f6d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0cc8f0 con 0x7f08bc1612e0 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08c0f6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0ccbd0 con 0x7f08bc06cdb0 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08c0f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0cceb0 con 0x7f08bc0cba40 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b1d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f08bc1612e0 0x7f08bc06c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41412/0 (socket says 172.21.15.73:41412) 2023-12-19T16:17:25.664 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b1d9b640 1 -- 172.21.15.73:0/3608486912 learned_addr learned my addr 172.21.15.73:0/3608486912 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893563100 0 0) 0x7f08bc0cc8f0 con 0x7f08bc1612e0 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08bc0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8003530 con 0x7f08bc1612e0 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 524660776 0 0) 0x7f08a8003530 con 0x7f08bc1612e0 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 msgr2=0x7f08bc0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08bc0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 >> v1:172.21.15.162:6789/0 conn(0x7f08bc06cdb0 legacy=0x7f08bc0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0cd190 con 0x7f08bc1612e0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f08a4001680 con 0x7f08bc1612e0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 >> v1:172.21.15.73:6789/0 conn(0x7f08bc1612e0 legacy=0x7f08bc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08a80039b0 0x7f08a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a8004d10 0x7f08a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0cceb0 con 0x7f08a80039b0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800bad0 con 0x7f08a8004d10 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a800bc90 con 0x7f08bc0cba40 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08a80039b0 0x7f08a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08b1d9b640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08bad9d640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a8004d10 0x7f08a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 -- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 msgr2=0x7f08a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc0cba40 0x7f08a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.667 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 -- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a8004d10 msgr2=0x7f08a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a8004d10 0x7f08a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.658+0000 7f08ba59c640 1 -- 172.21.15.73:0/3608486912 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8003530 con 0x7f08a80039b0 2023-12-19T16:17:25.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08a80039b0 0x7f08a8003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009ab0 tx=0x7f08ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68136ab3053823be server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0a5520 con 0x7f08a80039b0 2023-12-19T16:17:25.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac0a5680 con 0x7f08a80039b0 2023-12-19T16:17:25.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08b9d9b640 1 -- 172.21.15.73:0/3608486912 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0a5a30 con 0x7f08a80039b0 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3608486912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08a80039b0 msgr2=0x7f08a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3608486912 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08a80039b0 0x7f08a8003dd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009ab0 tx=0x7f08ac01ca30 comp rx=0 tx=0).stop 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08bad9d640 1 -- 172.21.15.73:0/3608486912 reap_dead start 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3608486912 shutdown_connections 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3608486912 >> 172.21.15.73:0/3608486912 conn(0x7f08bc0b0270 msgr2=0x7f08bc0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3608486912 shutdown_connections 2023-12-19T16:17:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.662+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3608486912 wait complete. 2023-12-19T16:17:25.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 Processor -- start 2023-12-19T16:17:25.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- start start 2023-12-19T16:17:25.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a80039b0 0x7f08bc0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc1548a0 0x7f08bc154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc155260 con 0x7f08bc0c30c0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b3e70 con 0x7f08a80039b0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b3260 con 0x7f08bc1548a0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36562/0 (socket says 172.21.15.73:36562) 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 -- 172.21.15.73:0/3626316818 learned_addr learned my addr 172.21.15.73:0/3626316818 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a80039b0 0x7f08bc0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08bad9d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc1548a0 0x7f08bc154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 -- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc1548a0 msgr2=0x7f08bc154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc1548a0 0x7f08bc154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 -- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a80039b0 msgr2=0x7f08bc0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a80039b0 0x7f08bc0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 -- 172.21.15.73:0/3626316818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0b3540 con 0x7f08bc0c30c0 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b1d9b640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f08a4012530 tx=0x7f08a40129f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4014810 con 0x7f08bc0c30c0 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4014970 con 0x7f08bc0c30c0 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc0b3820 con 0x7f08bc0c30c0 2023-12-19T16:17:25.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4014d20 con 0x7f08bc0c30c0 2023-12-19T16:17:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.666+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0b2f10 con 0x7f08bc0c30c0 2023-12-19T16:17:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc074050 con 0x7f08bc0c30c0 2023-12-19T16:17:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f08a40153e0 con 0x7f08bc0c30c0 2023-12-19T16:17:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08b37fe640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a4085dd0 con 0x7f08bc0c30c0 2023-12-19T16:17:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.670+0000 7f08ba59c640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0af000 tx=0x7f08ac0046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.674+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f08a4053830 con 0x7f08bc0c30c0 2023-12-19T16:17:25.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.822+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08bc0b3fb0 con 0x7f08bc0c30c0 2023-12-19T16:17:25.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08b37fe640 1 -- 172.21.15.73:0/3626316818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f08a401c090 con 0x7f08bc0c30c0 2023-12-19T16:17:25.832 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:25.832 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":52,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:17:23.123220+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 msgr2=0x7f089c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0af000 tx=0x7f08ac0046d0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 msgr2=0x7f08bc0c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f08a4012530 tx=0x7f08a40129f0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 shutdown_connections 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08bc1548a0 0x7f08bc154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f089c065a60 0x7f089c067f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08bc0c30c0 0x7f08bc0c3540 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 --2- 172.21.15.73:0/3626316818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08a80039b0 0x7f08bc0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 >> 172.21.15.73:0/3626316818 conn(0x7f08bc0b0270 msgr2=0x7f08bc0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 shutdown_connections 2023-12-19T16:17:25.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.826+0000 7f08c0f6d640 1 -- 172.21.15.73:0/3626316818 wait complete. 2023-12-19T16:17:25.853 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T16:17:25.854 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 Processor -- start 2023-12-19T16:17:25.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 -- start start 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d6c15ca80 0x7f0d6c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c0d0cf0 con 0x7f0d6c0d04f0 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c0d0fd0 con 0x7f0d6c160610 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d71ba2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0d12b0 con 0x7f0d6c15ca80 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d70ba0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d6c15ca80 0x7f0d6c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d6bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0d6c0d04f0 0x7f0d6c15d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41416/0 (socket says 172.21.15.73:41416) 2023-12-19T16:17:25.993 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d6bfff640 1 -- 172.21.15.73:0/1334753567 learned_addr learned my addr 172.21.15.73:0/1334753567 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d70ba0640 1 -- 172.21.15.73:0/1334753567 >> v1:172.21.15.162:6789/0 conn(0x7f0d6c160610 legacy=0x7f0d6c0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d70ba0640 1 -- 172.21.15.73:0/1334753567 >> v1:172.21.15.73:6789/0 conn(0x7f0d6c0d04f0 legacy=0x7f0d6c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d6b7fe640 1 -- 172.21.15.73:0/1334753567 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804319250 0 0) 0x7f0d6c0d0cf0 con 0x7f0d6c0d04f0 2023-12-19T16:17:25.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.986+0000 7f0d70ba0640 1 -- 172.21.15.73:0/1334753567 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c15d270 con 0x7f0d6c15ca80 2023-12-19T16:17:25.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d70ba0640 1 --2- 172.21.15.73:0/1334753567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c06ca30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0d600097c0 tx=0x7f0d6001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12c817dfd23ab59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:25.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d6b7fe640 1 -- 172.21.15.73:0/1334753567 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600ab600 con 0x7f0d6c15ca80 2023-12-19T16:17:25.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d6b7fe640 1 -- 172.21.15.73:0/1334753567 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600a7050 con 0x7f0d6c15ca80 2023-12-19T16:17:25.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d6b7fe640 1 -- 172.21.15.73:0/1334753567 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600ab980 con 0x7f0d6c15ca80 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1334753567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c15ca80 msgr2=0x7f0d6c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1334753567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c06ca30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0d600097c0 tx=0x7f0d6001c320 comp rx=0 tx=0).stop 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1334753567 shutdown_connections 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1334753567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c06ca30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1334753567 >> 172.21.15.73:0/1334753567 conn(0x7f0d6c0658e0 msgr2=0x7f0d6c065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1334753567 shutdown_connections 2023-12-19T16:17:25.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1334753567 wait complete. 2023-12-19T16:17:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.990+0000 7f0d71ba2640 1 Processor -- start 2023-12-19T16:17:25.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- start start 2023-12-19T16:17:26.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d6c0d04f0 0x7f0d6c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0c4030 con 0x7f0d6c160610 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1f92e0 con 0x7f0d6c15ca80 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0b4be0 con 0x7f0d6c0d04f0 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36584/0 (socket says 172.21.15.73:36584) 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 -- 172.21.15.73:0/1524552413 learned_addr learned my addr 172.21.15.73:0/1524552413 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d6bfff640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d70ba0640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d6c0d04f0 0x7f0d6c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 -- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d6c0d04f0 msgr2=0x7f0d6c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d6c0d04f0 0x7f0d6c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 -- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d6c15ca80 msgr2=0x7f0d6c159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 -- 172.21.15.73:0/1524552413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60009420 con 0x7f0d6c160610 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d713a1640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400b970 tx=0x7f0d6400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400cb40 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6400cca0 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64014680 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c0b4ec0 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c0b48d0 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.994+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c0b53e0 con 0x7f0d6c160610 2023-12-19T16:17:26.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.998+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d6401d3b0 con 0x7f0d6c160610 2023-12-19T16:17:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.998+0000 7f0d697fa640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 0x7f0d50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.998+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d64083080 con 0x7f0d6c160610 2023-12-19T16:17:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.998+0000 7f0d70ba0640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 0x7f0d50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:25.998+0000 7f0d70ba0640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 0x7f0d50067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d600ad000 tx=0x7f0d600a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.002+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0d640b40a0 con 0x7f0d6c160610 2023-12-19T16:17:26.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.150+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d6c0cd7f0 con 0x7f0d50065a60 2023-12-19T16:17:26.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.162+0000 7f0d697fa640 1 -- 172.21.15.73:0/1524552413 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288071 (secure 0 0 0) 0x7f0d600bc090 con 0x7f0d50065a60 2023-12-19T16:17:26.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:26.173 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:17:26.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.162+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 msgr2=0x7f0d50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.162+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 0x7f0d50067f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d600ad000 tx=0x7f0d600a6000 comp rx=0 tx=0).stop 2023-12-19T16:17:26.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.162+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 msgr2=0x7f0d6c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.162+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400b970 tx=0x7f0d6400be30 comp rx=0 tx=0).stop 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 shutdown_connections 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0d50065a60 0x7f0d50067f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d6c160610 0x7f0d6c0b56c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d6c15ca80 0x7f0d6c159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 --2- 172.21.15.73:0/1524552413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d6c0d04f0 0x7f0d6c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 >> 172.21.15.73:0/1524552413 conn(0x7f0d6c0658e0 msgr2=0x7f0d6c06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 shutdown_connections 2023-12-19T16:17:26.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.166+0000 7f0d71ba2640 1 -- 172.21.15.73:0/1524552413 wait complete. 2023-12-19T16:17:26.190 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-12-19T16:17:24.469317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225436,"kb_used_data":5724,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749284,"statfs":{"total":773094113280,"available":772863266816,"internally_reserved":0,"allocated":5861376,"data_stored":3072346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000667"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160155+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160155+0000","last_peered":"2023-12-19T16:17:22.160155+0000","last_clean":"2023-12-19T16:17:22.160155+0000","last_became_active":"2023-12-19T16:17:22.155094+0000","last_became_peered":"2023-12-19T16:17:22.155094+0000","last_unstale":"2023-12-19T16:17:22.160155+0000","last_undegraded":"2023-12-19T16:17:22.160155+0000","last_fullsized":"2023-12-19T16:17:22.160155+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135072+0000","last_change":"2023-12-19T16:17:22.151796+0000","last_active":"2023-12-19T16:17:23.135072+0000","last_peered":"2023-12-19T16:17:23.135072+0000","last_clean":"2023-12-19T16:17:23.135072+0000","last_became_active":"2023-12-19T16:17:22.151376+0000","last_became_peered":"2023-12-19T16:17:22.151376+0000","last_unstale":"2023-12-19T16:17:23.135072+0000","last_undegraded":"2023-12-19T16:17:23.135072+0000","last_fullsized":"2023-12-19T16:17:23.135072+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.152979+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.152979+0000","last_peered":"2023-12-19T16:17:22.152979+0000","last_clean":"2023-12-19T16:17:22.152979+0000","last_became_active":"2023-12-19T16:17:22.148854+0000","last_became_peered":"2023-12-19T16:17:22.148854+0000","last_unstale":"2023-12-19T16:17:22.152979+0000","last_undegraded":"2023-12-19T16:17:22.152979+0000","last_fullsized":"2023-12-19T16:17:22.152979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:36.076596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160354+0000","last_change":"2023-12-19T16:17:22.153271+0000","last_active":"2023-12-19T16:17:22.160354+0000","last_peered":"2023-12-19T16:17:22.160354+0000","last_clean":"2023-12-19T16:17:22.160354+0000","last_became_active":"2023-12-19T16:17:22.152741+0000","last_became_peered":"2023-12-19T16:17:22.152741+0000","last_unstale":"2023-12-19T16:17:22.160354+0000","last_undegraded":"2023-12-19T16:17:22.160354+0000","last_fullsized":"2023-12-19T16:17:22.160354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:22.185982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153900+0000","last_change":"2023-12-19T16:17:22.146150+0000","last_active":"2023-12-19T16:17:22.153900+0000","last_peered":"2023-12-19T16:17:22.153900+0000","last_clean":"2023-12-19T16:17:22.153900+0000","last_became_active":"2023-12-19T16:17:22.145911+0000","last_became_peered":"2023-12-19T16:17:22.145911+0000","last_unstale":"2023-12-19T16:17:22.153900+0000","last_undegraded":"2023-12-19T16:17:22.153900+0000","last_fullsized":"2023-12-19T16:17:22.153900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166513+0000","last_change":"2023-12-19T16:17:22.159277+0000","last_active":"2023-12-19T16:17:22.166513+0000","last_peered":"2023-12-19T16:17:22.166513+0000","last_clean":"2023-12-19T16:17:22.166513+0000","last_became_active":"2023-12-19T16:17:22.157136+0000","last_became_peered":"2023-12-19T16:17:22.157136+0000","last_unstale":"2023-12-19T16:17:22.166513+0000","last_undegraded":"2023-12-19T16:17:22.166513+0000","last_fullsized":"2023-12-19T16:17:22.166513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.978621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158401+0000","last_change":"2023-12-19T16:17:22.152378+0000","last_active":"2023-12-19T16:17:22.158401+0000","last_peered":"2023-12-19T16:17:22.158401+0000","last_clean":"2023-12-19T16:17:22.158401+0000","last_became_active":"2023-12-19T16:17:22.152125+0000","last_became_peered":"2023-12-19T16:17:22.152125+0000","last_unstale":"2023-12-19T16:17:22.158401+0000","last_undegraded":"2023-12-19T16:17:22.158401+0000","last_fullsized":"2023-12-19T16:17:22.158401+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:57:59.015795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166868+0000","last_change":"2023-12-19T16:17:22.161522+0000","last_active":"2023-12-19T16:17:22.166868+0000","last_peered":"2023-12-19T16:17:22.166868+0000","last_clean":"2023-12-19T16:17:22.166868+0000","last_became_active":"2023-12-19T16:17:22.161247+0000","last_became_peered":"2023-12-19T16:17:22.161247+0000","last_unstale":"2023-12-19T16:17:22.166868+0000","last_undegraded":"2023-12-19T16:17:22.166868+0000","last_fullsized":"2023-12-19T16:17:22.166868+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:49.572099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167337+0000","last_change":"2023-12-19T16:17:22.164109+0000","last_active":"2023-12-19T16:17:22.167337+0000","last_peered":"2023-12-19T16:17:22.167337+0000","last_clean":"2023-12-19T16:17:22.167337+0000","last_became_active":"2023-12-19T16:17:22.163818+0000","last_became_peered":"2023-12-19T16:17:22.163818+0000","last_unstale":"2023-12-19T16:17:22.167337+0000","last_undegraded":"2023-12-19T16:17:22.167337+0000","last_fullsized":"2023-12-19T16:17:22.167337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167027+0000","last_change":"2023-12-19T16:17:22.162318+0000","last_active":"2023-12-19T16:17:22.167027+0000","last_peered":"2023-12-19T16:17:22.167027+0000","last_clean":"2023-12-19T16:17:22.167027+0000","last_became_active":"2023-12-19T16:17:22.161961+0000","last_became_peered":"2023-12-19T16:17:22.161961+0000","last_unstale":"2023-12-19T16:17:22.167027+0000","last_undegraded":"2023-12-19T16:17:22.167027+0000","last_fullsized":"2023-12-19T16:17:22.167027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:17.864523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134881+0000","last_change":"2023-12-19T16:17:22.147920+0000","last_active":"2023-12-19T16:17:23.134881+0000","last_peered":"2023-12-19T16:17:23.134881+0000","last_clean":"2023-12-19T16:17:23.134881+0000","last_became_active":"2023-12-19T16:17:22.147715+0000","last_became_peered":"2023-12-19T16:17:22.147715+0000","last_unstale":"2023-12-19T16:17:23.134881+0000","last_undegraded":"2023-12-19T16:17:23.134881+0000","last_fullsized":"2023-12-19T16:17:23.134881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161975+0000","last_change":"2023-12-19T16:17:22.157376+0000","last_active":"2023-12-19T16:17:22.161975+0000","last_peered":"2023-12-19T16:17:22.161975+0000","last_clean":"2023-12-19T16:17:22.161975+0000","last_became_active":"2023-12-19T16:17:22.157066+0000","last_became_peered":"2023-12-19T16:17:22.157066+0000","last_unstale":"2023-12-19T16:17:22.161975+0000","last_undegraded":"2023-12-19T16:17:22.161975+0000","last_fullsized":"2023-12-19T16:17:22.161975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167226+0000","last_change":"2023-12-19T16:17:22.163715+0000","last_active":"2023-12-19T16:17:22.167226+0000","last_peered":"2023-12-19T16:17:22.167226+0000","last_clean":"2023-12-19T16:17:22.167226+0000","last_became_active":"2023-12-19T16:17:22.163411+0000","last_became_peered":"2023-12-19T16:17:22.163411+0000","last_unstale":"2023-12-19T16:17:22.167226+0000","last_undegraded":"2023-12-19T16:17:22.167226+0000","last_fullsized":"2023-12-19T16:17:22.167226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:41.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160945+0000","last_change":"2023-12-19T16:17:22.154892+0000","last_active":"2023-12-19T16:17:22.160945+0000","last_peered":"2023-12-19T16:17:22.160945+0000","last_clean":"2023-12-19T16:17:22.160945+0000","last_became_active":"2023-12-19T16:17:22.154466+0000","last_became_peered":"2023-12-19T16:17:22.154466+0000","last_unstale":"2023-12-19T16:17:22.160945+0000","last_undegraded":"2023-12-19T16:17:22.160945+0000","last_fullsized":"2023-12-19T16:17:22.160945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:45.655780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.163321+0000","last_change":"2023-12-19T16:17:22.159873+0000","last_active":"2023-12-19T16:17:22.163321+0000","last_peered":"2023-12-19T16:17:22.163321+0000","last_clean":"2023-12-19T16:17:22.163321+0000","last_became_active":"2023-12-19T16:17:22.159334+0000","last_became_peered":"2023-12-19T16:17:22.159334+0000","last_unstale":"2023-12-19T16:17:22.163321+0000","last_undegraded":"2023-12-19T16:17:22.163321+0000","last_fullsized":"2023-12-19T16:17:22.163321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135257+0000","last_change":"2023-12-19T16:17:22.159381+0000","last_active":"2023-12-19T16:17:23.135257+0000","last_peered":"2023-12-19T16:17:23.135257+0000","last_clean":"2023-12-19T16:17:23.135257+0000","last_became_active":"2023-12-19T16:17:22.159098+0000","last_became_peered":"2023-12-19T16:17:22.159098+0000","last_unstale":"2023-12-19T16:17:23.135257+0000","last_undegraded":"2023-12-19T16:17:23.135257+0000","last_fullsized":"2023-12-19T16:17:23.135257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160665+0000","last_change":"2023-12-19T16:17:22.154775+0000","last_active":"2023-12-19T16:17:22.160665+0000","last_peered":"2023-12-19T16:17:22.160665+0000","last_clean":"2023-12-19T16:17:22.160665+0000","last_became_active":"2023-12-19T16:17:22.154030+0000","last_became_peered":"2023-12-19T16:17:22.154030+0000","last_unstale":"2023-12-19T16:17:22.160665+0000","last_undegraded":"2023-12-19T16:17:22.160665+0000","last_fullsized":"2023-12-19T16:17:22.160665+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:55.606279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161535+0000","last_change":"2023-12-19T16:17:22.158100+0000","last_active":"2023-12-19T16:17:22.161535+0000","last_peered":"2023-12-19T16:17:22.161535+0000","last_clean":"2023-12-19T16:17:22.161535+0000","last_became_active":"2023-12-19T16:17:22.157849+0000","last_became_peered":"2023-12-19T16:17:22.157849+0000","last_unstale":"2023-12-19T16:17:22.161535+0000","last_undegraded":"2023-12-19T16:17:22.161535+0000","last_fullsized":"2023-12-19T16:17:22.161535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156098+0000","last_change":"2023-12-19T16:17:22.152299+0000","last_active":"2023-12-19T16:17:22.156098+0000","last_peered":"2023-12-19T16:17:22.156098+0000","last_clean":"2023-12-19T16:17:22.156098+0000","last_became_active":"2023-12-19T16:17:22.151817+0000","last_became_peered":"2023-12-19T16:17:22.151817+0000","last_unstale":"2023-12-19T16:17:22.156098+0000","last_undegraded":"2023-12-19T16:17:22.156098+0000","last_fullsized":"2023-12-19T16:17:22.156098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:51.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149605+0000","last_change":"2023-12-19T16:17:22.141954+0000","last_active":"2023-12-19T16:17:22.149605+0000","last_peered":"2023-12-19T16:17:22.149605+0000","last_clean":"2023-12-19T16:17:22.149605+0000","last_became_active":"2023-12-19T16:17:22.141589+0000","last_became_peered":"2023-12-19T16:17:22.141589+0000","last_unstale":"2023-12-19T16:17:22.149605+0000","last_undegraded":"2023-12-19T16:17:22.149605+0000","last_fullsized":"2023-12-19T16:17:22.149605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:56.610477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.148162+0000","last_change":"2023-12-19T16:17:22.142801+0000","last_active":"2023-12-19T16:17:22.148162+0000","last_peered":"2023-12-19T16:17:22.148162+0000","last_clean":"2023-12-19T16:17:22.148162+0000","last_became_active":"2023-12-19T16:17:22.142404+0000","last_became_peered":"2023-12-19T16:17:22.142404+0000","last_unstale":"2023-12-19T16:17:22.148162+0000","last_undegraded":"2023-12-19T16:17:22.148162+0000","last_fullsized":"2023-12-19T16:17:22.148162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:37.679998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134630+0000","last_change":"2023-12-19T16:17:22.155898+0000","last_active":"2023-12-19T16:17:23.134630+0000","last_peered":"2023-12-19T16:17:23.134630+0000","last_clean":"2023-12-19T16:17:23.134630+0000","last_became_active":"2023-12-19T16:17:22.155625+0000","last_became_peered":"2023-12-19T16:17:22.155625+0000","last_unstale":"2023-12-19T16:17:23.134630+0000","last_undegraded":"2023-12-19T16:17:23.134630+0000","last_fullsized":"2023-12-19T16:17:23.134630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160173+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160173+0000","last_peered":"2023-12-19T16:17:22.160173+0000","last_clean":"2023-12-19T16:17:22.160173+0000","last_became_active":"2023-12-19T16:17:22.154831+0000","last_became_peered":"2023-12-19T16:17:22.154831+0000","last_unstale":"2023-12-19T16:17:22.160173+0000","last_undegraded":"2023-12-19T16:17:22.160173+0000","last_fullsized":"2023-12-19T16:17:22.160173+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166936+0000","last_change":"2023-12-19T16:17:22.161976+0000","last_active":"2023-12-19T16:17:22.166936+0000","last_peered":"2023-12-19T16:17:22.166936+0000","last_clean":"2023-12-19T16:17:22.166936+0000","last_became_active":"2023-12-19T16:17:22.161253+0000","last_became_peered":"2023-12-19T16:17:22.161253+0000","last_unstale":"2023-12-19T16:17:22.166936+0000","last_undegraded":"2023-12-19T16:17:22.166936+0000","last_fullsized":"2023-12-19T16:17:22.166936+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141110+0000","last_change":"2023-12-19T16:17:22.133581+0000","last_active":"2023-12-19T16:17:22.141110+0000","last_peered":"2023-12-19T16:17:22.141110+0000","last_clean":"2023-12-19T16:17:22.141110+0000","last_became_active":"2023-12-19T16:17:22.133306+0000","last_became_peered":"2023-12-19T16:17:22.133306+0000","last_unstale":"2023-12-19T16:17:22.141110+0000","last_undegraded":"2023-12-19T16:17:22.141110+0000","last_fullsized":"2023-12-19T16:17:22.141110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:40.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143624+0000","last_change":"2023-12-19T16:17:22.139797+0000","last_active":"2023-12-19T16:17:22.143624+0000","last_peered":"2023-12-19T16:17:22.143624+0000","last_clean":"2023-12-19T16:17:22.143624+0000","last_became_active":"2023-12-19T16:17:22.139565+0000","last_became_peered":"2023-12-19T16:17:22.139565+0000","last_unstale":"2023-12-19T16:17:22.143624+0000","last_undegraded":"2023-12-19T16:17:22.143624+0000","last_fullsized":"2023-12-19T16:17:22.143624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:15.932295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153879+0000","last_change":"2023-12-19T16:17:22.145631+0000","last_active":"2023-12-19T16:17:22.153879+0000","last_peered":"2023-12-19T16:17:22.153879+0000","last_clean":"2023-12-19T16:17:22.153879+0000","last_became_active":"2023-12-19T16:17:22.145292+0000","last_became_peered":"2023-12-19T16:17:22.145292+0000","last_unstale":"2023-12-19T16:17:22.153879+0000","last_undegraded":"2023-12-19T16:17:22.153879+0000","last_fullsized":"2023-12-19T16:17:22.153879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134641+0000","last_change":"2023-12-19T16:17:22.142912+0000","last_active":"2023-12-19T16:17:23.134641+0000","last_peered":"2023-12-19T16:17:23.134641+0000","last_clean":"2023-12-19T16:17:23.134641+0000","last_became_active":"2023-12-19T16:17:22.142631+0000","last_became_peered":"2023-12-19T16:17:22.142631+0000","last_unstale":"2023-12-19T16:17:23.134641+0000","last_undegraded":"2023-12-19T16:17:23.134641+0000","last_fullsized":"2023-12-19T16:17:23.134641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165928+0000","last_change":"2023-12-19T16:17:22.158179+0000","last_active":"2023-12-19T16:17:22.165928+0000","last_peered":"2023-12-19T16:17:22.165928+0000","last_clean":"2023-12-19T16:17:22.165928+0000","last_became_active":"2023-12-19T16:17:22.157886+0000","last_became_peered":"2023-12-19T16:17:22.157886+0000","last_unstale":"2023-12-19T16:17:22.165928+0000","last_undegraded":"2023-12-19T16:17:22.165928+0000","last_fullsized":"2023-12-19T16:17:22.165928+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:35.956464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156734+0000","last_change":"2023-12-19T16:17:22.151320+0000","last_active":"2023-12-19T16:17:22.156734+0000","last_peered":"2023-12-19T16:17:22.156734+0000","last_clean":"2023-12-19T16:17:22.156734+0000","last_became_active":"2023-12-19T16:17:22.150541+0000","last_became_peered":"2023-12-19T16:17:22.150541+0000","last_unstale":"2023-12-19T16:17:22.156734+0000","last_undegraded":"2023-12-19T16:17:22.156734+0000","last_fullsized":"2023-12-19T16:17:22.156734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:28.033745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155355+0000","last_change":"2023-12-19T16:17:22.149896+0000","last_active":"2023-12-19T16:17:22.155355+0000","last_peered":"2023-12-19T16:17:22.155355+0000","last_clean":"2023-12-19T16:17:22.155355+0000","last_became_active":"2023-12-19T16:17:22.149454+0000","last_became_peered":"2023-12-19T16:17:22.149454+0000","last_unstale":"2023-12-19T16:17:22.155355+0000","last_undegraded":"2023-12-19T16:17:22.155355+0000","last_fullsized":"2023-12-19T16:17:22.155355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:45.196163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161358+0000","last_change":"2023-12-19T16:17:21.757846+0000","last_active":"2023-12-19T16:17:22.161358+0000","last_peered":"2023-12-19T16:17:22.161358+0000","last_clean":"2023-12-19T16:17:22.161358+0000","last_became_active":"2023-12-19T16:17:21.757491+0000","last_became_peered":"2023-12-19T16:17:21.757491+0000","last_unstale":"2023-12-19T16:17:22.161358+0000","last_undegraded":"2023-12-19T16:17:22.161358+0000","last_fullsized":"2023-12-19T16:17:22.161358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161319+0000","last_change":"2023-12-19T16:17:22.158007+0000","last_active":"2023-12-19T16:17:22.161319+0000","last_peered":"2023-12-19T16:17:22.161319+0000","last_clean":"2023-12-19T16:17:22.161319+0000","last_became_active":"2023-12-19T16:17:22.157731+0000","last_became_peered":"2023-12-19T16:17:22.157731+0000","last_unstale":"2023-12-19T16:17:22.161319+0000","last_undegraded":"2023-12-19T16:17:22.161319+0000","last_fullsized":"2023-12-19T16:17:22.161319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151665+0000","last_change":"2023-12-19T16:17:21.755136+0000","last_active":"2023-12-19T16:17:22.151665+0000","last_peered":"2023-12-19T16:17:22.151665+0000","last_clean":"2023-12-19T16:17:22.151665+0000","last_became_active":"2023-12-19T16:17:21.754811+0000","last_became_peered":"2023-12-19T16:17:21.754811+0000","last_unstale":"2023-12-19T16:17:22.151665+0000","last_undegraded":"2023-12-19T16:17:22.151665+0000","last_fullsized":"2023-12-19T16:17:22.151665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:21.178496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134945+0000","last_change":"2023-12-19T16:17:22.151779+0000","last_active":"2023-12-19T16:17:23.134945+0000","last_peered":"2023-12-19T16:17:23.134945+0000","last_clean":"2023-12-19T16:17:23.134945+0000","last_became_active":"2023-12-19T16:17:22.151531+0000","last_became_peered":"2023-12-19T16:17:22.151531+0000","last_unstale":"2023-12-19T16:17:23.134945+0000","last_undegraded":"2023-12-19T16:17:23.134945+0000","last_fullsized":"2023-12-19T16:17:23.134945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157539+0000","last_change":"2023-12-19T16:17:21.756962+0000","last_active":"2023-12-19T16:17:22.157539+0000","last_peered":"2023-12-19T16:17:22.157539+0000","last_clean":"2023-12-19T16:17:22.157539+0000","last_became_active":"2023-12-19T16:17:21.756429+0000","last_became_peered":"2023-12-19T16:17:21.756429+0000","last_unstale":"2023-12-19T16:17:22.157539+0000","last_undegraded":"2023-12-19T16:17:22.157539+0000","last_fullsized":"2023-12-19T16:17:22.157539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156016+0000","last_change":"2023-12-19T16:17:22.151997+0000","last_active":"2023-12-19T16:17:22.156016+0000","last_peered":"2023-12-19T16:17:22.156016+0000","last_clean":"2023-12-19T16:17:22.156016+0000","last_became_active":"2023-12-19T16:17:22.151660+0000","last_became_peered":"2023-12-19T16:17:22.151660+0000","last_unstale":"2023-12-19T16:17:22.156016+0000","last_undegraded":"2023-12-19T16:17:22.156016+0000","last_fullsized":"2023-12-19T16:17:22.156016+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:08.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143903+0000","last_change":"2023-12-19T16:17:21.751163+0000","last_active":"2023-12-19T16:17:22.143903+0000","last_peered":"2023-12-19T16:17:22.143903+0000","last_clean":"2023-12-19T16:17:22.143903+0000","last_became_active":"2023-12-19T16:17:21.750841+0000","last_became_peered":"2023-12-19T16:17:21.750841+0000","last_unstale":"2023-12-19T16:17:22.143903+0000","last_undegraded":"2023-12-19T16:17:22.143903+0000","last_fullsized":"2023-12-19T16:17:22.143903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:13.969787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143497+0000","last_change":"2023-12-19T16:17:22.138939+0000","last_active":"2023-12-19T16:17:22.143497+0000","last_peered":"2023-12-19T16:17:22.143497+0000","last_clean":"2023-12-19T16:17:22.143497+0000","last_became_active":"2023-12-19T16:17:22.136474+0000","last_became_peered":"2023-12-19T16:17:22.136474+0000","last_unstale":"2023-12-19T16:17:22.143497+0000","last_undegraded":"2023-12-19T16:17:22.143497+0000","last_fullsized":"2023-12-19T16:17:22.143497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:10.979687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156965+0000","last_change":"2023-12-19T16:17:21.761909+0000","last_active":"2023-12-19T16:17:22.156965+0000","last_peered":"2023-12-19T16:17:22.156965+0000","last_clean":"2023-12-19T16:17:22.156965+0000","last_became_active":"2023-12-19T16:17:21.761644+0000","last_became_peered":"2023-12-19T16:17:21.761644+0000","last_unstale":"2023-12-19T16:17:22.156965+0000","last_undegraded":"2023-12-19T16:17:22.156965+0000","last_fullsized":"2023-12-19T16:17:22.156965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.154258+0000","last_change":"2023-12-19T16:17:21.752834+0000","last_active":"2023-12-19T16:17:22.154258+0000","last_peered":"2023-12-19T16:17:22.154258+0000","last_clean":"2023-12-19T16:17:22.154258+0000","last_became_active":"2023-12-19T16:17:21.751522+0000","last_became_peered":"2023-12-19T16:17:21.751522+0000","last_unstale":"2023-12-19T16:17:22.154258+0000","last_undegraded":"2023-12-19T16:17:22.154258+0000","last_fullsized":"2023-12-19T16:17:22.154258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:27.026260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137520+0000","last_change":"2023-12-19T16:17:21.757958+0000","last_active":"2023-12-19T16:17:22.137520+0000","last_peered":"2023-12-19T16:17:22.137520+0000","last_clean":"2023-12-19T16:17:22.137520+0000","last_became_active":"2023-12-19T16:17:21.757638+0000","last_became_peered":"2023-12-19T16:17:21.757638+0000","last_unstale":"2023-12-19T16:17:22.137520+0000","last_undegraded":"2023-12-19T16:17:22.137520+0000","last_fullsized":"2023-12-19T16:17:22.137520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151506+0000","last_change":"2023-12-19T16:17:22.146956+0000","last_active":"2023-12-19T16:17:22.151506+0000","last_peered":"2023-12-19T16:17:22.151506+0000","last_clean":"2023-12-19T16:17:22.151506+0000","last_became_active":"2023-12-19T16:17:22.146235+0000","last_became_peered":"2023-12-19T16:17:22.146235+0000","last_unstale":"2023-12-19T16:17:22.151506+0000","last_undegraded":"2023-12-19T16:17:22.151506+0000","last_fullsized":"2023-12-19T16:17:22.151506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:40.626111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140193+0000","last_change":"2023-12-19T16:17:22.136135+0000","last_active":"2023-12-19T16:17:22.140193+0000","last_peered":"2023-12-19T16:17:22.140193+0000","last_clean":"2023-12-19T16:17:22.140193+0000","last_became_active":"2023-12-19T16:17:22.135881+0000","last_became_peered":"2023-12-19T16:17:22.135881+0000","last_unstale":"2023-12-19T16:17:22.140193+0000","last_undegraded":"2023-12-19T16:17:22.140193+0000","last_fullsized":"2023-12-19T16:17:22.140193+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:46.895243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129442+0000","last_change":"2023-12-19T16:17:21.758331+0000","last_active":"2023-12-19T16:17:22.129442+0000","last_peered":"2023-12-19T16:17:22.129442+0000","last_clean":"2023-12-19T16:17:22.129442+0000","last_became_active":"2023-12-19T16:17:21.758062+0000","last_became_peered":"2023-12-19T16:17:21.758062+0000","last_unstale":"2023-12-19T16:17:22.129442+0000","last_undegraded":"2023-12-19T16:17:22.129442+0000","last_fullsized":"2023-12-19T16:17:22.129442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:56:16.429059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162960+0000","last_change":"2023-12-19T16:17:22.157415+0000","last_active":"2023-12-19T16:17:22.162960+0000","last_peered":"2023-12-19T16:17:22.162960+0000","last_clean":"2023-12-19T16:17:22.162960+0000","last_became_active":"2023-12-19T16:17:22.157175+0000","last_became_peered":"2023-12-19T16:17:22.157175+0000","last_unstale":"2023-12-19T16:17:22.162960+0000","last_undegraded":"2023-12-19T16:17:22.162960+0000","last_fullsized":"2023-12-19T16:17:22.162960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:35.693932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733700+0000","last_change":"2023-12-19T16:17:20.733700+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733700+0000","last_undegraded":"2023-12-19T16:17:20.733700+0000","last_fullsized":"2023-12-19T16:17:20.733700+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167325+0000","last_change":"2023-12-19T16:17:22.164149+0000","last_active":"2023-12-19T16:17:22.167325+0000","last_peered":"2023-12-19T16:17:22.167325+0000","last_clean":"2023-12-19T16:17:22.167325+0000","last_became_active":"2023-12-19T16:17:22.163873+0000","last_became_peered":"2023-12-19T16:17:22.163873+0000","last_unstale":"2023-12-19T16:17:22.167325+0000","last_undegraded":"2023-12-19T16:17:22.167325+0000","last_fullsized":"2023-12-19T16:17:22.167325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135051+0000","last_change":"2023-12-19T16:17:21.760196+0000","last_active":"2023-12-19T16:17:23.135051+0000","last_peered":"2023-12-19T16:17:23.135051+0000","last_clean":"2023-12-19T16:17:23.135051+0000","last_became_active":"2023-12-19T16:17:21.759918+0000","last_became_peered":"2023-12-19T16:17:21.759918+0000","last_unstale":"2023-12-19T16:17:23.135051+0000","last_undegraded":"2023-12-19T16:17:23.135051+0000","last_fullsized":"2023-12-19T16:17:23.135051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158619+0000","last_change":"2023-12-19T16:17:22.156495+0000","last_active":"2023-12-19T16:17:22.158619+0000","last_peered":"2023-12-19T16:17:22.158619+0000","last_clean":"2023-12-19T16:17:22.158619+0000","last_became_active":"2023-12-19T16:17:22.156228+0000","last_became_peered":"2023-12-19T16:17:22.156228+0000","last_unstale":"2023-12-19T16:17:22.158619+0000","last_undegraded":"2023-12-19T16:17:22.158619+0000","last_fullsized":"2023-12-19T16:17:22.158619+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:36.662860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733675+0000","last_change":"2023-12-19T16:17:20.733675+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733675+0000","last_undegraded":"2023-12-19T16:17:20.733675+0000","last_fullsized":"2023-12-19T16:17:20.733675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162919+0000","last_change":"2023-12-19T16:17:22.157237+0000","last_active":"2023-12-19T16:17:22.162919+0000","last_peered":"2023-12-19T16:17:22.162919+0000","last_clean":"2023-12-19T16:17:22.162919+0000","last_became_active":"2023-12-19T16:17:22.156973+0000","last_became_peered":"2023-12-19T16:17:22.156973+0000","last_unstale":"2023-12-19T16:17:22.162919+0000","last_undegraded":"2023-12-19T16:17:22.162919+0000","last_fullsized":"2023-12-19T16:17:22.162919+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:31.895567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157483+0000","last_change":"2023-12-19T16:17:21.761048+0000","last_active":"2023-12-19T16:17:22.157483+0000","last_peered":"2023-12-19T16:17:22.157483+0000","last_clean":"2023-12-19T16:17:22.157483+0000","last_became_active":"2023-12-19T16:17:21.758547+0000","last_became_peered":"2023-12-19T16:17:21.758547+0000","last_unstale":"2023-12-19T16:17:22.157483+0000","last_undegraded":"2023-12-19T16:17:22.157483+0000","last_fullsized":"2023-12-19T16:17:22.157483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:15.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149532+0000","last_change":"2023-12-19T16:17:22.141474+0000","last_active":"2023-12-19T16:17:22.149532+0000","last_peered":"2023-12-19T16:17:22.149532+0000","last_clean":"2023-12-19T16:17:22.149532+0000","last_became_active":"2023-12-19T16:17:22.141183+0000","last_became_peered":"2023-12-19T16:17:22.141183+0000","last_unstale":"2023-12-19T16:17:22.149532+0000","last_undegraded":"2023-12-19T16:17:22.149532+0000","last_fullsized":"2023-12-19T16:17:22.149532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:10.623748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137461+0000","last_change":"2023-12-19T16:17:21.743866+0000","last_active":"2023-12-19T16:17:22.137461+0000","last_peered":"2023-12-19T16:17:22.137461+0000","last_clean":"2023-12-19T16:17:22.137461+0000","last_became_active":"2023-12-19T16:17:21.743597+0000","last_became_peered":"2023-12-19T16:17:21.743597+0000","last_unstale":"2023-12-19T16:17:22.137461+0000","last_undegraded":"2023-12-19T16:17:22.137461+0000","last_fullsized":"2023-12-19T16:17:22.137461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155323+0000","last_change":"2023-12-19T16:17:22.149800+0000","last_active":"2023-12-19T16:17:22.155323+0000","last_peered":"2023-12-19T16:17:22.155323+0000","last_clean":"2023-12-19T16:17:22.155323+0000","last_became_active":"2023-12-19T16:17:22.149385+0000","last_became_peered":"2023-12-19T16:17:22.149385+0000","last_unstale":"2023-12-19T16:17:22.155323+0000","last_undegraded":"2023-12-19T16:17:22.155323+0000","last_fullsized":"2023-12-19T16:17:22.155323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:57.924303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.139919+0000","last_change":"2023-12-19T16:17:21.761964+0000","last_active":"2023-12-19T16:17:22.139919+0000","last_peered":"2023-12-19T16:17:22.139919+0000","last_clean":"2023-12-19T16:17:22.139919+0000","last_became_active":"2023-12-19T16:17:21.760304+0000","last_became_peered":"2023-12-19T16:17:21.760304+0000","last_unstale":"2023-12-19T16:17:22.139919+0000","last_undegraded":"2023-12-19T16:17:22.139919+0000","last_fullsized":"2023-12-19T16:17:22.139919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:44.188677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134631+0000","last_change":"2023-12-19T16:17:22.148063+0000","last_active":"2023-12-19T16:17:23.134631+0000","last_peered":"2023-12-19T16:17:23.134631+0000","last_clean":"2023-12-19T16:17:23.134631+0000","last_became_active":"2023-12-19T16:17:22.147442+0000","last_became_peered":"2023-12-19T16:17:22.147442+0000","last_unstale":"2023-12-19T16:17:23.134631+0000","last_undegraded":"2023-12-19T16:17:23.134631+0000","last_fullsized":"2023-12-19T16:17:23.134631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.735466+0000","last_change":"2023-12-19T16:17:20.735466+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.735466+0000","last_undegraded":"2023-12-19T16:17:20.735466+0000","last_fullsized":"2023-12-19T16:17:20.735466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149280+0000","last_change":"2023-12-19T16:17:22.140926+0000","last_active":"2023-12-19T16:17:22.149280+0000","last_peered":"2023-12-19T16:17:22.149280+0000","last_clean":"2023-12-19T16:17:22.149280+0000","last_became_active":"2023-12-19T16:17:22.140652+0000","last_became_peered":"2023-12-19T16:17:22.140652+0000","last_unstale":"2023-12-19T16:17:22.149280+0000","last_undegraded":"2023-12-19T16:17:22.149280+0000","last_fullsized":"2023-12-19T16:17:22.149280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:29.710944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166720+0000","last_change":"2023-12-19T16:17:21.761218+0000","last_active":"2023-12-19T16:17:22.166720+0000","last_peered":"2023-12-19T16:17:22.166720+0000","last_clean":"2023-12-19T16:17:22.166720+0000","last_became_active":"2023-12-19T16:17:21.760858+0000","last_became_peered":"2023-12-19T16:17:21.760858+0000","last_unstale":"2023-12-19T16:17:22.166720+0000","last_undegraded":"2023-12-19T16:17:22.166720+0000","last_fullsized":"2023-12-19T16:17:22.166720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.150861+0000","last_change":"2023-12-19T16:17:22.148334+0000","last_active":"2023-12-19T16:17:22.150861+0000","last_peered":"2023-12-19T16:17:22.150861+0000","last_clean":"2023-12-19T16:17:22.150861+0000","last_became_active":"2023-12-19T16:17:22.148036+0000","last_became_peered":"2023-12-19T16:17:22.148036+0000","last_unstale":"2023-12-19T16:17:22.150861+0000","last_undegraded":"2023-12-19T16:17:22.150861+0000","last_fullsized":"2023-12-19T16:17:22.150861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:57.733309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158973+0000","last_change":"2023-12-19T16:17:21.759281+0000","last_active":"2023-12-19T16:17:22.158973+0000","last_peered":"2023-12-19T16:17:22.158973+0000","last_clean":"2023-12-19T16:17:22.158973+0000","last_became_active":"2023-12-19T16:17:21.758854+0000","last_became_peered":"2023-12-19T16:17:21.758854+0000","last_unstale":"2023-12-19T16:17:22.158973+0000","last_undegraded":"2023-12-19T16:17:22.158973+0000","last_fullsized":"2023-12-19T16:17:22.158973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:43.061583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134967+0000","last_change":"2023-12-19T16:17:22.157996+0000","last_active":"2023-12-19T16:17:23.134967+0000","last_peered":"2023-12-19T16:17:23.134967+0000","last_clean":"2023-12-19T16:17:23.134967+0000","last_became_active":"2023-12-19T16:17:22.157742+0000","last_became_peered":"2023-12-19T16:17:22.157742+0000","last_unstale":"2023-12-19T16:17:23.134967+0000","last_undegraded":"2023-12-19T16:17:23.134967+0000","last_fullsized":"2023-12-19T16:17:23.134967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165864+0000","last_change":"2023-12-19T16:17:21.755379+0000","last_active":"2023-12-19T16:17:22.165864+0000","last_peered":"2023-12-19T16:17:22.165864+0000","last_clean":"2023-12-19T16:17:22.165864+0000","last_became_active":"2023-12-19T16:17:21.754564+0000","last_became_peered":"2023-12-19T16:17:21.754564+0000","last_unstale":"2023-12-19T16:17:22.165864+0000","last_undegraded":"2023-12-19T16:17:22.165864+0000","last_fullsized":"2023-12-19T16:17:22.165864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:11.726871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149876+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.149876+0000","last_peered":"2023-12-19T16:17:22.149876+0000","last_clean":"2023-12-19T16:17:22.149876+0000","last_became_active":"2023-12-19T16:17:22.148868+0000","last_became_peered":"2023-12-19T16:17:22.148868+0000","last_unstale":"2023-12-19T16:17:22.149876+0000","last_undegraded":"2023-12-19T16:17:22.149876+0000","last_fullsized":"2023-12-19T16:17:22.149876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:14.946456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140783+0000","last_change":"2023-12-19T16:17:21.763539+0000","last_active":"2023-12-19T16:17:22.140783+0000","last_peered":"2023-12-19T16:17:22.140783+0000","last_clean":"2023-12-19T16:17:22.140783+0000","last_became_active":"2023-12-19T16:17:21.763131+0000","last_became_peered":"2023-12-19T16:17:21.763131+0000","last_unstale":"2023-12-19T16:17:22.140783+0000","last_undegraded":"2023-12-19T16:17:22.140783+0000","last_fullsized":"2023-12-19T16:17:22.140783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:56.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161993+0000","last_change":"2023-12-19T16:17:22.157501+0000","last_active":"2023-12-19T16:17:22.161993+0000","last_peered":"2023-12-19T16:17:22.161993+0000","last_clean":"2023-12-19T16:17:22.161993+0000","last_became_active":"2023-12-19T16:17:22.157209+0000","last_became_peered":"2023-12-19T16:17:22.157209+0000","last_unstale":"2023-12-19T16:17:22.161993+0000","last_undegraded":"2023-12-19T16:17:22.161993+0000","last_fullsized":"2023-12-19T16:17:22.161993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:22.093772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137345+0000","last_change":"2023-12-19T16:17:21.751942+0000","last_active":"2023-12-19T16:17:22.137345+0000","last_peered":"2023-12-19T16:17:22.137345+0000","last_clean":"2023-12-19T16:17:22.137345+0000","last_became_active":"2023-12-19T16:17:21.751600+0000","last_became_peered":"2023-12-19T16:17:21.751600+0000","last_unstale":"2023-12-19T16:17:22.137345+0000","last_undegraded":"2023-12-19T16:17:22.137345+0000","last_fullsized":"2023-12-19T16:17:22.137345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:47.234683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156753+0000","last_change":"2023-12-19T16:17:22.152347+0000","last_active":"2023-12-19T16:17:22.156753+0000","last_peered":"2023-12-19T16:17:22.156753+0000","last_clean":"2023-12-19T16:17:22.156753+0000","last_became_active":"2023-12-19T16:17:22.151834+0000","last_became_peered":"2023-12-19T16:17:22.151834+0000","last_unstale":"2023-12-19T16:17:22.156753+0000","last_undegraded":"2023-12-19T16:17:22.156753+0000","last_fullsized":"2023-12-19T16:17:22.156753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733673+0000","last_change":"2023-12-19T16:17:20.733673+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733673+0000","last_undegraded":"2023-12-19T16:17:20.733673+0000","last_fullsized":"2023-12-19T16:17:20.733673+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155943+0000","last_change":"2023-12-19T16:17:22.151111+0000","last_active":"2023-12-19T16:17:22.155943+0000","last_peered":"2023-12-19T16:17:22.155943+0000","last_clean":"2023-12-19T16:17:22.155943+0000","last_became_active":"2023-12-19T16:17:22.150803+0000","last_became_peered":"2023-12-19T16:17:22.150803+0000","last_unstale":"2023-12-19T16:17:22.155943+0000","last_undegraded":"2023-12-19T16:17:22.155943+0000","last_fullsized":"2023-12-19T16:17:22.155943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127328+0000","last_change":"2023-12-19T16:17:21.756215+0000","last_active":"2023-12-19T16:17:22.127328+0000","last_peered":"2023-12-19T16:17:22.127328+0000","last_clean":"2023-12-19T16:17:22.127328+0000","last_became_active":"2023-12-19T16:17:21.755911+0000","last_became_peered":"2023-12-19T16:17:21.755911+0000","last_unstale":"2023-12-19T16:17:22.127328+0000","last_undegraded":"2023-12-19T16:17:22.127328+0000","last_fullsized":"2023-12-19T16:17:22.127328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:40.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158663+0000","last_change":"2023-12-19T16:17:22.156498+0000","last_active":"2023-12-19T16:17:22.158663+0000","last_peered":"2023-12-19T16:17:22.158663+0000","last_clean":"2023-12-19T16:17:22.158663+0000","last_became_active":"2023-12-19T16:17:22.156255+0000","last_became_peered":"2023-12-19T16:17:22.156255+0000","last_unstale":"2023-12-19T16:17:22.158663+0000","last_undegraded":"2023-12-19T16:17:22.158663+0000","last_fullsized":"2023-12-19T16:17:22.158663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:06.241133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156451+0000","last_change":"2023-12-19T16:17:21.758755+0000","last_active":"2023-12-19T16:17:22.156451+0000","last_peered":"2023-12-19T16:17:22.156451+0000","last_clean":"2023-12-19T16:17:22.156451+0000","last_became_active":"2023-12-19T16:17:21.758489+0000","last_became_peered":"2023-12-19T16:17:21.758489+0000","last_unstale":"2023-12-19T16:17:22.156451+0000","last_undegraded":"2023-12-19T16:17:22.156451+0000","last_fullsized":"2023-12-19T16:17:22.156451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141669+0000","last_change":"2023-12-19T16:17:21.756779+0000","last_active":"2023-12-19T16:17:22.141669+0000","last_peered":"2023-12-19T16:17:22.141669+0000","last_clean":"2023-12-19T16:17:22.141669+0000","last_became_active":"2023-12-19T16:17:21.756421+0000","last_became_peered":"2023-12-19T16:17:21.756421+0000","last_unstale":"2023-12-19T16:17:22.141669+0000","last_undegraded":"2023-12-19T16:17:22.141669+0000","last_fullsized":"2023-12-19T16:17:22.141669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158640+0000","last_change":"2023-12-19T16:17:22.156581+0000","last_active":"2023-12-19T16:17:22.158640+0000","last_peered":"2023-12-19T16:17:22.158640+0000","last_clean":"2023-12-19T16:17:22.158640+0000","last_became_active":"2023-12-19T16:17:22.156314+0000","last_became_peered":"2023-12-19T16:17:22.156314+0000","last_unstale":"2023-12-19T16:17:22.158640+0000","last_undegraded":"2023-12-19T16:17:22.158640+0000","last_fullsized":"2023-12-19T16:17:22.158640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:47.136357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129951+0000","last_change":"2023-12-19T16:17:21.759011+0000","last_active":"2023-12-19T16:17:22.129951+0000","last_peered":"2023-12-19T16:17:22.129951+0000","last_clean":"2023-12-19T16:17:22.129951+0000","last_became_active":"2023-12-19T16:17:21.758694+0000","last_became_peered":"2023-12-19T16:17:21.758694+0000","last_unstale":"2023-12-19T16:17:22.129951+0000","last_undegraded":"2023-12-19T16:17:22.129951+0000","last_fullsized":"2023-12-19T16:17:22.129951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:32.774324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140708+0000","last_change":"2023-12-19T16:17:21.758295+0000","last_active":"2023-12-19T16:17:22.140708+0000","last_peered":"2023-12-19T16:17:22.140708+0000","last_clean":"2023-12-19T16:17:22.140708+0000","last_became_active":"2023-12-19T16:17:21.758035+0000","last_became_peered":"2023-12-19T16:17:21.758035+0000","last_unstale":"2023-12-19T16:17:22.140708+0000","last_undegraded":"2023-12-19T16:17:22.140708+0000","last_fullsized":"2023-12-19T16:17:22.140708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:59.521708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156076+0000","last_change":"2023-12-19T16:17:22.151966+0000","last_active":"2023-12-19T16:17:22.156076+0000","last_peered":"2023-12-19T16:17:22.156076+0000","last_clean":"2023-12-19T16:17:22.156076+0000","last_became_active":"2023-12-19T16:17:22.150479+0000","last_became_peered":"2023-12-19T16:17:22.150479+0000","last_unstale":"2023-12-19T16:17:22.156076+0000","last_undegraded":"2023-12-19T16:17:22.156076+0000","last_fullsized":"2023-12-19T16:17:22.156076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:25.579064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127836+0000","last_change":"2023-12-19T16:17:21.753501+0000","last_active":"2023-12-19T16:17:22.127836+0000","last_peered":"2023-12-19T16:17:22.127836+0000","last_clean":"2023-12-19T16:17:22.127836+0000","last_became_active":"2023-12-19T16:17:21.753228+0000","last_became_peered":"2023-12-19T16:17:21.753228+0000","last_unstale":"2023-12-19T16:17:22.127836+0000","last_undegraded":"2023-12-19T16:17:22.127836+0000","last_fullsized":"2023-12-19T16:17:22.127836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:16.857037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162995+0000","last_change":"2023-12-19T16:17:22.158201+0000","last_active":"2023-12-19T16:17:22.162995+0000","last_peered":"2023-12-19T16:17:22.162995+0000","last_clean":"2023-12-19T16:17:22.162995+0000","last_became_active":"2023-12-19T16:17:22.155301+0000","last_became_peered":"2023-12-19T16:17:22.155301+0000","last_unstale":"2023-12-19T16:17:22.162995+0000","last_undegraded":"2023-12-19T16:17:22.162995+0000","last_fullsized":"2023-12-19T16:17:22.162995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:34.957262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140060+0000","last_change":"2023-12-19T16:17:21.755941+0000","last_active":"2023-12-19T16:17:22.140060+0000","last_peered":"2023-12-19T16:17:22.140060+0000","last_clean":"2023-12-19T16:17:22.140060+0000","last_became_active":"2023-12-19T16:17:21.755557+0000","last_became_peered":"2023-12-19T16:17:21.755557+0000","last_unstale":"2023-12-19T16:17:22.140060+0000","last_undegraded":"2023-12-19T16:17:22.140060+0000","last_fullsized":"2023-12-19T16:17:22.140060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:56.916818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134632+0000","last_change":"2023-12-19T16:17:22.141268+0000","last_active":"2023-12-19T16:17:23.134632+0000","last_peered":"2023-12-19T16:17:23.134632+0000","last_clean":"2023-12-19T16:17:23.134632+0000","last_became_active":"2023-12-19T16:17:22.140999+0000","last_became_peered":"2023-12-19T16:17:22.140999+0000","last_unstale":"2023-12-19T16:17:23.134632+0000","last_undegraded":"2023-12-19T16:17:23.134632+0000","last_fullsized":"2023-12-19T16:17:23.134632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129706+0000","last_change":"2023-12-19T16:17:21.749542+0000","last_active":"2023-12-19T16:17:22.129706+0000","last_peered":"2023-12-19T16:17:22.129706+0000","last_clean":"2023-12-19T16:17:22.129706+0000","last_became_active":"2023-12-19T16:17:21.749270+0000","last_became_peered":"2023-12-19T16:17:21.749270+0000","last_unstale":"2023-12-19T16:17:22.129706+0000","last_undegraded":"2023-12-19T16:17:22.129706+0000","last_fullsized":"2023-12-19T16:17:22.129706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:30.862265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166669+0000","last_change":"2023-12-19T16:17:22.159978+0000","last_active":"2023-12-19T16:17:22.166669+0000","last_peered":"2023-12-19T16:17:22.166669+0000","last_clean":"2023-12-19T16:17:22.166669+0000","last_became_active":"2023-12-19T16:17:22.159594+0000","last_became_peered":"2023-12-19T16:17:22.159594+0000","last_unstale":"2023-12-19T16:17:22.166669+0000","last_undegraded":"2023-12-19T16:17:22.166669+0000","last_fullsized":"2023-12-19T16:17:22.166669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:14.977272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151286+0000","last_change":"2023-12-19T16:17:21.757859+0000","last_active":"2023-12-19T16:17:22.151286+0000","last_peered":"2023-12-19T16:17:22.151286+0000","last_clean":"2023-12-19T16:17:22.151286+0000","last_became_active":"2023-12-19T16:17:21.757542+0000","last_became_peered":"2023-12-19T16:17:21.757542+0000","last_unstale":"2023-12-19T16:17:22.151286+0000","last_undegraded":"2023-12-19T16:17:22.151286+0000","last_fullsized":"2023-12-19T16:17:22.151286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:07.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T16:17:21.742544+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:17:21.742544+0000","last_peered":"2023-12-19T16:17:21.742544+0000","last_clean":"2023-12-19T16:17:21.742544+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:17:21.742544+0000","last_undegraded":"2023-12-19T16:17:21.742544+0000","last_fullsized":"2023-12-19T16:17:21.742544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476763,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":242672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.071}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.97099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476763,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":241198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.32400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.496}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.622},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.70299999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476763,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":831546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.624},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":241780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.435},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.54600000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.62}]}]},{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.68100000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.629}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.72999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":577536,"data_stored":234333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1171456,"data_stored":824701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.435}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50700000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.501},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:26.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:26.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 Processor -- start 2023-12-19T16:17:26.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 -- start start 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7b80cba40 0x7fa7b80cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 0x7fa7b80abe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80cc8f0 con 0x7fa7b81612e0 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80ccbd0 con 0x7fa7b80cba40 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bf266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80cceb0 con 0x7fa7b806cdb0 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bc801640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa7b81612e0 0x7fa7b806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41430/0 (socket says 172.21.15.73:41430) 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd002640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa7b80cba40 0x7fa7b80cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bc801640 1 -- 172.21.15.73:0/3369234798 learned_addr learned my addr 172.21.15.73:0/3369234798 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd803640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 0x7fa7b80abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7affff640 1 -- 172.21.15.73:0/3369234798 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842095248 0 0) 0x7fa7b80cc8f0 con 0x7fa7b81612e0 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7affff640 1 -- 172.21.15.73:0/3369234798 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a4003530 con 0x7fa7b81612e0 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd002640 1 -- 172.21.15.73:0/3369234798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 msgr2=0x7fa7b80abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd002640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 0x7fa7b80abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd002640 1 -- 172.21.15.73:0/3369234798 >> v1:172.21.15.73:6789/0 conn(0x7fa7b81612e0 legacy=0x7fa7b806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd002640 1 -- 172.21.15.73:0/3369234798 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80cd190 con 0x7fa7b80cba40 2023-12-19T16:17:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.362+0000 7fa7bd803640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 0x7fa7b80abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bd002640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b80cba40 0x7fa7b80cc310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097c0 tx=0x7fa7b401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40167e9c894bf713 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7affff640 1 -- 172.21.15.73:0/3369234798 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40a8970 con 0x7fa7b80cba40 2023-12-19T16:17:26.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7affff640 1 -- 172.21.15.73:0/3369234798 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40a8ad0 con 0x7fa7b80cba40 2023-12-19T16:17:26.374 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7affff640 1 -- 172.21.15.73:0/3369234798 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40a8e60 con 0x7fa7b80cba40 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 -- 172.21.15.73:0/3369234798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b80cba40 msgr2=0x7fa7b80cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b80cba40 0x7fa7b80cc310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40097c0 tx=0x7fa7b401ec70 comp rx=0 tx=0).stop 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 -- 172.21.15.73:0/3369234798 shutdown_connections 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b806cdb0 0x7fa7b80abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 --2- 172.21.15.73:0/3369234798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b80cba40 0x7fa7b80cc310 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.366+0000 7fa7bf266640 1 -- 172.21.15.73:0/3369234798 >> 172.21.15.73:0/3369234798 conn(0x7fa7b80b0270 msgr2=0x7fa7b80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- 172.21.15.73:0/3369234798 shutdown_connections 2023-12-19T16:17:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- 172.21.15.73:0/3369234798 wait complete. 2023-12-19T16:17:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 Processor -- start 2023-12-19T16:17:26.377 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- start start 2023-12-19T16:17:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b806cdb0 0x7fa7b8158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 0x7fa7b80b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80c5920 con 0x7fa7b81612e0 2023-12-19T16:17:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80c3240 con 0x7fa7b806cdb0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bf266640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80c2630 con 0x7fa7b80cba40 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36608/0 (socket says 172.21.15.73:36608) 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 -- 172.21.15.73:0/2990025370 learned_addr learned my addr 172.21.15.73:0/2990025370 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd002640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b806cdb0 0x7fa7b8158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bc801640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 0x7fa7b80b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 -- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 msgr2=0x7fa7b80b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 0x7fa7b80b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 -- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b806cdb0 msgr2=0x7fa7b8158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b806cdb0 0x7fa7b8158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 -- 172.21.15.73:0/2990025370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4009420 con 0x7fa7b81612e0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bc801640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 0x7fa7b80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.370+0000 7fa7bd803640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0007ef0 tx=0x7fa7b000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0003ba0 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000f040 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000de80 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b80c2910 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b80c2ed0 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b8074050 con 0x7fa7b81612e0 2023-12-19T16:17:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7b0004030 con 0x7fa7b81612e0 2023-12-19T16:17:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 0x7fa79c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7b00832c0 con 0x7fa7b81612e0 2023-12-19T16:17:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.374+0000 7fa7bd002640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 0x7fa79c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.383 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.378+0000 7fa7bd002640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 0x7fa79c067f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b2000 tx=0x7fa7b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.378+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa7b0050ea0 con 0x7fa7b81612e0 2023-12-19T16:17:26.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.526+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7b8161720 con 0x7fa79c065ab0 2023-12-19T16:17:26.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.534+0000 7fa7adffb640 1 -- 172.21.15.73:0/2990025370 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288071 (secure 0 0 0) 0x7fa7b40b0440 con 0x7fa79c065ab0 2023-12-19T16:17:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:26.548 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 msgr2=0x7fa79c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 0x7fa79c067f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40b2000 tx=0x7fa7b4008040 comp rx=0 tx=0).stop 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 msgr2=0x7fa7b815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0007ef0 tx=0x7fa7b000d4a0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 shutdown_connections 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa79c065ab0 0x7fa79c067f70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b81612e0 0x7fa7b815cb80 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa7b80cba40 0x7fa7b80b2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 --2- 172.21.15.73:0/2990025370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7b806cdb0 0x7fa7b8158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 >> 172.21.15.73:0/2990025370 conn(0x7fa7b80b0270 msgr2=0x7fa7b81605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 shutdown_connections 2023-12-19T16:17:26.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.538+0000 7fa7bf266640 1 -- 172.21.15.73:0/2990025370 wait complete. 2023-12-19T16:17:26.565 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T16:17:26.469798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225436,"kb_used_data":5724,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749284,"statfs":{"total":773094113280,"available":772863266816,"internally_reserved":0,"allocated":5861376,"data_stored":3072346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742766"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160155+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160155+0000","last_peered":"2023-12-19T16:17:22.160155+0000","last_clean":"2023-12-19T16:17:22.160155+0000","last_became_active":"2023-12-19T16:17:22.155094+0000","last_became_peered":"2023-12-19T16:17:22.155094+0000","last_unstale":"2023-12-19T16:17:22.160155+0000","last_undegraded":"2023-12-19T16:17:22.160155+0000","last_fullsized":"2023-12-19T16:17:22.160155+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135072+0000","last_change":"2023-12-19T16:17:22.151796+0000","last_active":"2023-12-19T16:17:23.135072+0000","last_peered":"2023-12-19T16:17:23.135072+0000","last_clean":"2023-12-19T16:17:23.135072+0000","last_became_active":"2023-12-19T16:17:22.151376+0000","last_became_peered":"2023-12-19T16:17:22.151376+0000","last_unstale":"2023-12-19T16:17:23.135072+0000","last_undegraded":"2023-12-19T16:17:23.135072+0000","last_fullsized":"2023-12-19T16:17:23.135072+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.152979+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.152979+0000","last_peered":"2023-12-19T16:17:22.152979+0000","last_clean":"2023-12-19T16:17:22.152979+0000","last_became_active":"2023-12-19T16:17:22.148854+0000","last_became_peered":"2023-12-19T16:17:22.148854+0000","last_unstale":"2023-12-19T16:17:22.152979+0000","last_undegraded":"2023-12-19T16:17:22.152979+0000","last_fullsized":"2023-12-19T16:17:22.152979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:36.076596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160354+0000","last_change":"2023-12-19T16:17:22.153271+0000","last_active":"2023-12-19T16:17:22.160354+0000","last_peered":"2023-12-19T16:17:22.160354+0000","last_clean":"2023-12-19T16:17:22.160354+0000","last_became_active":"2023-12-19T16:17:22.152741+0000","last_became_peered":"2023-12-19T16:17:22.152741+0000","last_unstale":"2023-12-19T16:17:22.160354+0000","last_undegraded":"2023-12-19T16:17:22.160354+0000","last_fullsized":"2023-12-19T16:17:22.160354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:22.185982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153900+0000","last_change":"2023-12-19T16:17:22.146150+0000","last_active":"2023-12-19T16:17:22.153900+0000","last_peered":"2023-12-19T16:17:22.153900+0000","last_clean":"2023-12-19T16:17:22.153900+0000","last_became_active":"2023-12-19T16:17:22.145911+0000","last_became_peered":"2023-12-19T16:17:22.145911+0000","last_unstale":"2023-12-19T16:17:22.153900+0000","last_undegraded":"2023-12-19T16:17:22.153900+0000","last_fullsized":"2023-12-19T16:17:22.153900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166513+0000","last_change":"2023-12-19T16:17:22.159277+0000","last_active":"2023-12-19T16:17:22.166513+0000","last_peered":"2023-12-19T16:17:22.166513+0000","last_clean":"2023-12-19T16:17:22.166513+0000","last_became_active":"2023-12-19T16:17:22.157136+0000","last_became_peered":"2023-12-19T16:17:22.157136+0000","last_unstale":"2023-12-19T16:17:22.166513+0000","last_undegraded":"2023-12-19T16:17:22.166513+0000","last_fullsized":"2023-12-19T16:17:22.166513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.978621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158401+0000","last_change":"2023-12-19T16:17:22.152378+0000","last_active":"2023-12-19T16:17:22.158401+0000","last_peered":"2023-12-19T16:17:22.158401+0000","last_clean":"2023-12-19T16:17:22.158401+0000","last_became_active":"2023-12-19T16:17:22.152125+0000","last_became_peered":"2023-12-19T16:17:22.152125+0000","last_unstale":"2023-12-19T16:17:22.158401+0000","last_undegraded":"2023-12-19T16:17:22.158401+0000","last_fullsized":"2023-12-19T16:17:22.158401+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:57:59.015795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166868+0000","last_change":"2023-12-19T16:17:22.161522+0000","last_active":"2023-12-19T16:17:22.166868+0000","last_peered":"2023-12-19T16:17:22.166868+0000","last_clean":"2023-12-19T16:17:22.166868+0000","last_became_active":"2023-12-19T16:17:22.161247+0000","last_became_peered":"2023-12-19T16:17:22.161247+0000","last_unstale":"2023-12-19T16:17:22.166868+0000","last_undegraded":"2023-12-19T16:17:22.166868+0000","last_fullsized":"2023-12-19T16:17:22.166868+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:49.572099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167337+0000","last_change":"2023-12-19T16:17:22.164109+0000","last_active":"2023-12-19T16:17:22.167337+0000","last_peered":"2023-12-19T16:17:22.167337+0000","last_clean":"2023-12-19T16:17:22.167337+0000","last_became_active":"2023-12-19T16:17:22.163818+0000","last_became_peered":"2023-12-19T16:17:22.163818+0000","last_unstale":"2023-12-19T16:17:22.167337+0000","last_undegraded":"2023-12-19T16:17:22.167337+0000","last_fullsized":"2023-12-19T16:17:22.167337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167027+0000","last_change":"2023-12-19T16:17:22.162318+0000","last_active":"2023-12-19T16:17:22.167027+0000","last_peered":"2023-12-19T16:17:22.167027+0000","last_clean":"2023-12-19T16:17:22.167027+0000","last_became_active":"2023-12-19T16:17:22.161961+0000","last_became_peered":"2023-12-19T16:17:22.161961+0000","last_unstale":"2023-12-19T16:17:22.167027+0000","last_undegraded":"2023-12-19T16:17:22.167027+0000","last_fullsized":"2023-12-19T16:17:22.167027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:17.864523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134881+0000","last_change":"2023-12-19T16:17:22.147920+0000","last_active":"2023-12-19T16:17:23.134881+0000","last_peered":"2023-12-19T16:17:23.134881+0000","last_clean":"2023-12-19T16:17:23.134881+0000","last_became_active":"2023-12-19T16:17:22.147715+0000","last_became_peered":"2023-12-19T16:17:22.147715+0000","last_unstale":"2023-12-19T16:17:23.134881+0000","last_undegraded":"2023-12-19T16:17:23.134881+0000","last_fullsized":"2023-12-19T16:17:23.134881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161975+0000","last_change":"2023-12-19T16:17:22.157376+0000","last_active":"2023-12-19T16:17:22.161975+0000","last_peered":"2023-12-19T16:17:22.161975+0000","last_clean":"2023-12-19T16:17:22.161975+0000","last_became_active":"2023-12-19T16:17:22.157066+0000","last_became_peered":"2023-12-19T16:17:22.157066+0000","last_unstale":"2023-12-19T16:17:22.161975+0000","last_undegraded":"2023-12-19T16:17:22.161975+0000","last_fullsized":"2023-12-19T16:17:22.161975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167226+0000","last_change":"2023-12-19T16:17:22.163715+0000","last_active":"2023-12-19T16:17:22.167226+0000","last_peered":"2023-12-19T16:17:22.167226+0000","last_clean":"2023-12-19T16:17:22.167226+0000","last_became_active":"2023-12-19T16:17:22.163411+0000","last_became_peered":"2023-12-19T16:17:22.163411+0000","last_unstale":"2023-12-19T16:17:22.167226+0000","last_undegraded":"2023-12-19T16:17:22.167226+0000","last_fullsized":"2023-12-19T16:17:22.167226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:41.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160945+0000","last_change":"2023-12-19T16:17:22.154892+0000","last_active":"2023-12-19T16:17:22.160945+0000","last_peered":"2023-12-19T16:17:22.160945+0000","last_clean":"2023-12-19T16:17:22.160945+0000","last_became_active":"2023-12-19T16:17:22.154466+0000","last_became_peered":"2023-12-19T16:17:22.154466+0000","last_unstale":"2023-12-19T16:17:22.160945+0000","last_undegraded":"2023-12-19T16:17:22.160945+0000","last_fullsized":"2023-12-19T16:17:22.160945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:45.655780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.163321+0000","last_change":"2023-12-19T16:17:22.159873+0000","last_active":"2023-12-19T16:17:22.163321+0000","last_peered":"2023-12-19T16:17:22.163321+0000","last_clean":"2023-12-19T16:17:22.163321+0000","last_became_active":"2023-12-19T16:17:22.159334+0000","last_became_peered":"2023-12-19T16:17:22.159334+0000","last_unstale":"2023-12-19T16:17:22.163321+0000","last_undegraded":"2023-12-19T16:17:22.163321+0000","last_fullsized":"2023-12-19T16:17:22.163321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135257+0000","last_change":"2023-12-19T16:17:22.159381+0000","last_active":"2023-12-19T16:17:23.135257+0000","last_peered":"2023-12-19T16:17:23.135257+0000","last_clean":"2023-12-19T16:17:23.135257+0000","last_became_active":"2023-12-19T16:17:22.159098+0000","last_became_peered":"2023-12-19T16:17:22.159098+0000","last_unstale":"2023-12-19T16:17:23.135257+0000","last_undegraded":"2023-12-19T16:17:23.135257+0000","last_fullsized":"2023-12-19T16:17:23.135257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160665+0000","last_change":"2023-12-19T16:17:22.154775+0000","last_active":"2023-12-19T16:17:22.160665+0000","last_peered":"2023-12-19T16:17:22.160665+0000","last_clean":"2023-12-19T16:17:22.160665+0000","last_became_active":"2023-12-19T16:17:22.154030+0000","last_became_peered":"2023-12-19T16:17:22.154030+0000","last_unstale":"2023-12-19T16:17:22.160665+0000","last_undegraded":"2023-12-19T16:17:22.160665+0000","last_fullsized":"2023-12-19T16:17:22.160665+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:55.606279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161535+0000","last_change":"2023-12-19T16:17:22.158100+0000","last_active":"2023-12-19T16:17:22.161535+0000","last_peered":"2023-12-19T16:17:22.161535+0000","last_clean":"2023-12-19T16:17:22.161535+0000","last_became_active":"2023-12-19T16:17:22.157849+0000","last_became_peered":"2023-12-19T16:17:22.157849+0000","last_unstale":"2023-12-19T16:17:22.161535+0000","last_undegraded":"2023-12-19T16:17:22.161535+0000","last_fullsized":"2023-12-19T16:17:22.161535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156098+0000","last_change":"2023-12-19T16:17:22.152299+0000","last_active":"2023-12-19T16:17:22.156098+0000","last_peered":"2023-12-19T16:17:22.156098+0000","last_clean":"2023-12-19T16:17:22.156098+0000","last_became_active":"2023-12-19T16:17:22.151817+0000","last_became_peered":"2023-12-19T16:17:22.151817+0000","last_unstale":"2023-12-19T16:17:22.156098+0000","last_undegraded":"2023-12-19T16:17:22.156098+0000","last_fullsized":"2023-12-19T16:17:22.156098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:51.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149605+0000","last_change":"2023-12-19T16:17:22.141954+0000","last_active":"2023-12-19T16:17:22.149605+0000","last_peered":"2023-12-19T16:17:22.149605+0000","last_clean":"2023-12-19T16:17:22.149605+0000","last_became_active":"2023-12-19T16:17:22.141589+0000","last_became_peered":"2023-12-19T16:17:22.141589+0000","last_unstale":"2023-12-19T16:17:22.149605+0000","last_undegraded":"2023-12-19T16:17:22.149605+0000","last_fullsized":"2023-12-19T16:17:22.149605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:56.610477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.148162+0000","last_change":"2023-12-19T16:17:22.142801+0000","last_active":"2023-12-19T16:17:22.148162+0000","last_peered":"2023-12-19T16:17:22.148162+0000","last_clean":"2023-12-19T16:17:22.148162+0000","last_became_active":"2023-12-19T16:17:22.142404+0000","last_became_peered":"2023-12-19T16:17:22.142404+0000","last_unstale":"2023-12-19T16:17:22.148162+0000","last_undegraded":"2023-12-19T16:17:22.148162+0000","last_fullsized":"2023-12-19T16:17:22.148162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:37.679998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134630+0000","last_change":"2023-12-19T16:17:22.155898+0000","last_active":"2023-12-19T16:17:23.134630+0000","last_peered":"2023-12-19T16:17:23.134630+0000","last_clean":"2023-12-19T16:17:23.134630+0000","last_became_active":"2023-12-19T16:17:22.155625+0000","last_became_peered":"2023-12-19T16:17:22.155625+0000","last_unstale":"2023-12-19T16:17:23.134630+0000","last_undegraded":"2023-12-19T16:17:23.134630+0000","last_fullsized":"2023-12-19T16:17:23.134630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160173+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160173+0000","last_peered":"2023-12-19T16:17:22.160173+0000","last_clean":"2023-12-19T16:17:22.160173+0000","last_became_active":"2023-12-19T16:17:22.154831+0000","last_became_peered":"2023-12-19T16:17:22.154831+0000","last_unstale":"2023-12-19T16:17:22.160173+0000","last_undegraded":"2023-12-19T16:17:22.160173+0000","last_fullsized":"2023-12-19T16:17:22.160173+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166936+0000","last_change":"2023-12-19T16:17:22.161976+0000","last_active":"2023-12-19T16:17:22.166936+0000","last_peered":"2023-12-19T16:17:22.166936+0000","last_clean":"2023-12-19T16:17:22.166936+0000","last_became_active":"2023-12-19T16:17:22.161253+0000","last_became_peered":"2023-12-19T16:17:22.161253+0000","last_unstale":"2023-12-19T16:17:22.166936+0000","last_undegraded":"2023-12-19T16:17:22.166936+0000","last_fullsized":"2023-12-19T16:17:22.166936+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141110+0000","last_change":"2023-12-19T16:17:22.133581+0000","last_active":"2023-12-19T16:17:22.141110+0000","last_peered":"2023-12-19T16:17:22.141110+0000","last_clean":"2023-12-19T16:17:22.141110+0000","last_became_active":"2023-12-19T16:17:22.133306+0000","last_became_peered":"2023-12-19T16:17:22.133306+0000","last_unstale":"2023-12-19T16:17:22.141110+0000","last_undegraded":"2023-12-19T16:17:22.141110+0000","last_fullsized":"2023-12-19T16:17:22.141110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:40.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143624+0000","last_change":"2023-12-19T16:17:22.139797+0000","last_active":"2023-12-19T16:17:22.143624+0000","last_peered":"2023-12-19T16:17:22.143624+0000","last_clean":"2023-12-19T16:17:22.143624+0000","last_became_active":"2023-12-19T16:17:22.139565+0000","last_became_peered":"2023-12-19T16:17:22.139565+0000","last_unstale":"2023-12-19T16:17:22.143624+0000","last_undegraded":"2023-12-19T16:17:22.143624+0000","last_fullsized":"2023-12-19T16:17:22.143624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:15.932295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153879+0000","last_change":"2023-12-19T16:17:22.145631+0000","last_active":"2023-12-19T16:17:22.153879+0000","last_peered":"2023-12-19T16:17:22.153879+0000","last_clean":"2023-12-19T16:17:22.153879+0000","last_became_active":"2023-12-19T16:17:22.145292+0000","last_became_peered":"2023-12-19T16:17:22.145292+0000","last_unstale":"2023-12-19T16:17:22.153879+0000","last_undegraded":"2023-12-19T16:17:22.153879+0000","last_fullsized":"2023-12-19T16:17:22.153879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134641+0000","last_change":"2023-12-19T16:17:22.142912+0000","last_active":"2023-12-19T16:17:23.134641+0000","last_peered":"2023-12-19T16:17:23.134641+0000","last_clean":"2023-12-19T16:17:23.134641+0000","last_became_active":"2023-12-19T16:17:22.142631+0000","last_became_peered":"2023-12-19T16:17:22.142631+0000","last_unstale":"2023-12-19T16:17:23.134641+0000","last_undegraded":"2023-12-19T16:17:23.134641+0000","last_fullsized":"2023-12-19T16:17:23.134641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165928+0000","last_change":"2023-12-19T16:17:22.158179+0000","last_active":"2023-12-19T16:17:22.165928+0000","last_peered":"2023-12-19T16:17:22.165928+0000","last_clean":"2023-12-19T16:17:22.165928+0000","last_became_active":"2023-12-19T16:17:22.157886+0000","last_became_peered":"2023-12-19T16:17:22.157886+0000","last_unstale":"2023-12-19T16:17:22.165928+0000","last_undegraded":"2023-12-19T16:17:22.165928+0000","last_fullsized":"2023-12-19T16:17:22.165928+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:35.956464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156734+0000","last_change":"2023-12-19T16:17:22.151320+0000","last_active":"2023-12-19T16:17:22.156734+0000","last_peered":"2023-12-19T16:17:22.156734+0000","last_clean":"2023-12-19T16:17:22.156734+0000","last_became_active":"2023-12-19T16:17:22.150541+0000","last_became_peered":"2023-12-19T16:17:22.150541+0000","last_unstale":"2023-12-19T16:17:22.156734+0000","last_undegraded":"2023-12-19T16:17:22.156734+0000","last_fullsized":"2023-12-19T16:17:22.156734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:28.033745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155355+0000","last_change":"2023-12-19T16:17:22.149896+0000","last_active":"2023-12-19T16:17:22.155355+0000","last_peered":"2023-12-19T16:17:22.155355+0000","last_clean":"2023-12-19T16:17:22.155355+0000","last_became_active":"2023-12-19T16:17:22.149454+0000","last_became_peered":"2023-12-19T16:17:22.149454+0000","last_unstale":"2023-12-19T16:17:22.155355+0000","last_undegraded":"2023-12-19T16:17:22.155355+0000","last_fullsized":"2023-12-19T16:17:22.155355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:45.196163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161358+0000","last_change":"2023-12-19T16:17:21.757846+0000","last_active":"2023-12-19T16:17:22.161358+0000","last_peered":"2023-12-19T16:17:22.161358+0000","last_clean":"2023-12-19T16:17:22.161358+0000","last_became_active":"2023-12-19T16:17:21.757491+0000","last_became_peered":"2023-12-19T16:17:21.757491+0000","last_unstale":"2023-12-19T16:17:22.161358+0000","last_undegraded":"2023-12-19T16:17:22.161358+0000","last_fullsized":"2023-12-19T16:17:22.161358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161319+0000","last_change":"2023-12-19T16:17:22.158007+0000","last_active":"2023-12-19T16:17:22.161319+0000","last_peered":"2023-12-19T16:17:22.161319+0000","last_clean":"2023-12-19T16:17:22.161319+0000","last_became_active":"2023-12-19T16:17:22.157731+0000","last_became_peered":"2023-12-19T16:17:22.157731+0000","last_unstale":"2023-12-19T16:17:22.161319+0000","last_undegraded":"2023-12-19T16:17:22.161319+0000","last_fullsized":"2023-12-19T16:17:22.161319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151665+0000","last_change":"2023-12-19T16:17:21.755136+0000","last_active":"2023-12-19T16:17:22.151665+0000","last_peered":"2023-12-19T16:17:22.151665+0000","last_clean":"2023-12-19T16:17:22.151665+0000","last_became_active":"2023-12-19T16:17:21.754811+0000","last_became_peered":"2023-12-19T16:17:21.754811+0000","last_unstale":"2023-12-19T16:17:22.151665+0000","last_undegraded":"2023-12-19T16:17:22.151665+0000","last_fullsized":"2023-12-19T16:17:22.151665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:21.178496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134945+0000","last_change":"2023-12-19T16:17:22.151779+0000","last_active":"2023-12-19T16:17:23.134945+0000","last_peered":"2023-12-19T16:17:23.134945+0000","last_clean":"2023-12-19T16:17:23.134945+0000","last_became_active":"2023-12-19T16:17:22.151531+0000","last_became_peered":"2023-12-19T16:17:22.151531+0000","last_unstale":"2023-12-19T16:17:23.134945+0000","last_undegraded":"2023-12-19T16:17:23.134945+0000","last_fullsized":"2023-12-19T16:17:23.134945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157539+0000","last_change":"2023-12-19T16:17:21.756962+0000","last_active":"2023-12-19T16:17:22.157539+0000","last_peered":"2023-12-19T16:17:22.157539+0000","last_clean":"2023-12-19T16:17:22.157539+0000","last_became_active":"2023-12-19T16:17:21.756429+0000","last_became_peered":"2023-12-19T16:17:21.756429+0000","last_unstale":"2023-12-19T16:17:22.157539+0000","last_undegraded":"2023-12-19T16:17:22.157539+0000","last_fullsized":"2023-12-19T16:17:22.157539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156016+0000","last_change":"2023-12-19T16:17:22.151997+0000","last_active":"2023-12-19T16:17:22.156016+0000","last_peered":"2023-12-19T16:17:22.156016+0000","last_clean":"2023-12-19T16:17:22.156016+0000","last_became_active":"2023-12-19T16:17:22.151660+0000","last_became_peered":"2023-12-19T16:17:22.151660+0000","last_unstale":"2023-12-19T16:17:22.156016+0000","last_undegraded":"2023-12-19T16:17:22.156016+0000","last_fullsized":"2023-12-19T16:17:22.156016+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:08.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143903+0000","last_change":"2023-12-19T16:17:21.751163+0000","last_active":"2023-12-19T16:17:22.143903+0000","last_peered":"2023-12-19T16:17:22.143903+0000","last_clean":"2023-12-19T16:17:22.143903+0000","last_became_active":"2023-12-19T16:17:21.750841+0000","last_became_peered":"2023-12-19T16:17:21.750841+0000","last_unstale":"2023-12-19T16:17:22.143903+0000","last_undegraded":"2023-12-19T16:17:22.143903+0000","last_fullsized":"2023-12-19T16:17:22.143903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:13.969787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143497+0000","last_change":"2023-12-19T16:17:22.138939+0000","last_active":"2023-12-19T16:17:22.143497+0000","last_peered":"2023-12-19T16:17:22.143497+0000","last_clean":"2023-12-19T16:17:22.143497+0000","last_became_active":"2023-12-19T16:17:22.136474+0000","last_became_peered":"2023-12-19T16:17:22.136474+0000","last_unstale":"2023-12-19T16:17:22.143497+0000","last_undegraded":"2023-12-19T16:17:22.143497+0000","last_fullsized":"2023-12-19T16:17:22.143497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:10.979687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156965+0000","last_change":"2023-12-19T16:17:21.761909+0000","last_active":"2023-12-19T16:17:22.156965+0000","last_peered":"2023-12-19T16:17:22.156965+0000","last_clean":"2023-12-19T16:17:22.156965+0000","last_became_active":"2023-12-19T16:17:21.761644+0000","last_became_peered":"2023-12-19T16:17:21.761644+0000","last_unstale":"2023-12-19T16:17:22.156965+0000","last_undegraded":"2023-12-19T16:17:22.156965+0000","last_fullsized":"2023-12-19T16:17:22.156965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.154258+0000","last_change":"2023-12-19T16:17:21.752834+0000","last_active":"2023-12-19T16:17:22.154258+0000","last_peered":"2023-12-19T16:17:22.154258+0000","last_clean":"2023-12-19T16:17:22.154258+0000","last_became_active":"2023-12-19T16:17:21.751522+0000","last_became_peered":"2023-12-19T16:17:21.751522+0000","last_unstale":"2023-12-19T16:17:22.154258+0000","last_undegraded":"2023-12-19T16:17:22.154258+0000","last_fullsized":"2023-12-19T16:17:22.154258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:27.026260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137520+0000","last_change":"2023-12-19T16:17:21.757958+0000","last_active":"2023-12-19T16:17:22.137520+0000","last_peered":"2023-12-19T16:17:22.137520+0000","last_clean":"2023-12-19T16:17:22.137520+0000","last_became_active":"2023-12-19T16:17:21.757638+0000","last_became_peered":"2023-12-19T16:17:21.757638+0000","last_unstale":"2023-12-19T16:17:22.137520+0000","last_undegraded":"2023-12-19T16:17:22.137520+0000","last_fullsized":"2023-12-19T16:17:22.137520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151506+0000","last_change":"2023-12-19T16:17:22.146956+0000","last_active":"2023-12-19T16:17:22.151506+0000","last_peered":"2023-12-19T16:17:22.151506+0000","last_clean":"2023-12-19T16:17:22.151506+0000","last_became_active":"2023-12-19T16:17:22.146235+0000","last_became_peered":"2023-12-19T16:17:22.146235+0000","last_unstale":"2023-12-19T16:17:22.151506+0000","last_undegraded":"2023-12-19T16:17:22.151506+0000","last_fullsized":"2023-12-19T16:17:22.151506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:40.626111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140193+0000","last_change":"2023-12-19T16:17:22.136135+0000","last_active":"2023-12-19T16:17:22.140193+0000","last_peered":"2023-12-19T16:17:22.140193+0000","last_clean":"2023-12-19T16:17:22.140193+0000","last_became_active":"2023-12-19T16:17:22.135881+0000","last_became_peered":"2023-12-19T16:17:22.135881+0000","last_unstale":"2023-12-19T16:17:22.140193+0000","last_undegraded":"2023-12-19T16:17:22.140193+0000","last_fullsized":"2023-12-19T16:17:22.140193+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:46.895243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129442+0000","last_change":"2023-12-19T16:17:21.758331+0000","last_active":"2023-12-19T16:17:22.129442+0000","last_peered":"2023-12-19T16:17:22.129442+0000","last_clean":"2023-12-19T16:17:22.129442+0000","last_became_active":"2023-12-19T16:17:21.758062+0000","last_became_peered":"2023-12-19T16:17:21.758062+0000","last_unstale":"2023-12-19T16:17:22.129442+0000","last_undegraded":"2023-12-19T16:17:22.129442+0000","last_fullsized":"2023-12-19T16:17:22.129442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:56:16.429059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162960+0000","last_change":"2023-12-19T16:17:22.157415+0000","last_active":"2023-12-19T16:17:22.162960+0000","last_peered":"2023-12-19T16:17:22.162960+0000","last_clean":"2023-12-19T16:17:22.162960+0000","last_became_active":"2023-12-19T16:17:22.157175+0000","last_became_peered":"2023-12-19T16:17:22.157175+0000","last_unstale":"2023-12-19T16:17:22.162960+0000","last_undegraded":"2023-12-19T16:17:22.162960+0000","last_fullsized":"2023-12-19T16:17:22.162960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:35.693932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733700+0000","last_change":"2023-12-19T16:17:20.733700+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733700+0000","last_undegraded":"2023-12-19T16:17:20.733700+0000","last_fullsized":"2023-12-19T16:17:20.733700+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167325+0000","last_change":"2023-12-19T16:17:22.164149+0000","last_active":"2023-12-19T16:17:22.167325+0000","last_peered":"2023-12-19T16:17:22.167325+0000","last_clean":"2023-12-19T16:17:22.167325+0000","last_became_active":"2023-12-19T16:17:22.163873+0000","last_became_peered":"2023-12-19T16:17:22.163873+0000","last_unstale":"2023-12-19T16:17:22.167325+0000","last_undegraded":"2023-12-19T16:17:22.167325+0000","last_fullsized":"2023-12-19T16:17:22.167325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135051+0000","last_change":"2023-12-19T16:17:21.760196+0000","last_active":"2023-12-19T16:17:23.135051+0000","last_peered":"2023-12-19T16:17:23.135051+0000","last_clean":"2023-12-19T16:17:23.135051+0000","last_became_active":"2023-12-19T16:17:21.759918+0000","last_became_peered":"2023-12-19T16:17:21.759918+0000","last_unstale":"2023-12-19T16:17:23.135051+0000","last_undegraded":"2023-12-19T16:17:23.135051+0000","last_fullsized":"2023-12-19T16:17:23.135051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158619+0000","last_change":"2023-12-19T16:17:22.156495+0000","last_active":"2023-12-19T16:17:22.158619+0000","last_peered":"2023-12-19T16:17:22.158619+0000","last_clean":"2023-12-19T16:17:22.158619+0000","last_became_active":"2023-12-19T16:17:22.156228+0000","last_became_peered":"2023-12-19T16:17:22.156228+0000","last_unstale":"2023-12-19T16:17:22.158619+0000","last_undegraded":"2023-12-19T16:17:22.158619+0000","last_fullsized":"2023-12-19T16:17:22.158619+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:36.662860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733675+0000","last_change":"2023-12-19T16:17:20.733675+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733675+0000","last_undegraded":"2023-12-19T16:17:20.733675+0000","last_fullsized":"2023-12-19T16:17:20.733675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162919+0000","last_change":"2023-12-19T16:17:22.157237+0000","last_active":"2023-12-19T16:17:22.162919+0000","last_peered":"2023-12-19T16:17:22.162919+0000","last_clean":"2023-12-19T16:17:22.162919+0000","last_became_active":"2023-12-19T16:17:22.156973+0000","last_became_peered":"2023-12-19T16:17:22.156973+0000","last_unstale":"2023-12-19T16:17:22.162919+0000","last_undegraded":"2023-12-19T16:17:22.162919+0000","last_fullsized":"2023-12-19T16:17:22.162919+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:31.895567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157483+0000","last_change":"2023-12-19T16:17:21.761048+0000","last_active":"2023-12-19T16:17:22.157483+0000","last_peered":"2023-12-19T16:17:22.157483+0000","last_clean":"2023-12-19T16:17:22.157483+0000","last_became_active":"2023-12-19T16:17:21.758547+0000","last_became_peered":"2023-12-19T16:17:21.758547+0000","last_unstale":"2023-12-19T16:17:22.157483+0000","last_undegraded":"2023-12-19T16:17:22.157483+0000","last_fullsized":"2023-12-19T16:17:22.157483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:15.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149532+0000","last_change":"2023-12-19T16:17:22.141474+0000","last_active":"2023-12-19T16:17:22.149532+0000","last_peered":"2023-12-19T16:17:22.149532+0000","last_clean":"2023-12-19T16:17:22.149532+0000","last_became_active":"2023-12-19T16:17:22.141183+0000","last_became_peered":"2023-12-19T16:17:22.141183+0000","last_unstale":"2023-12-19T16:17:22.149532+0000","last_undegraded":"2023-12-19T16:17:22.149532+0000","last_fullsized":"2023-12-19T16:17:22.149532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:10.623748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137461+0000","last_change":"2023-12-19T16:17:21.743866+0000","last_active":"2023-12-19T16:17:22.137461+0000","last_peered":"2023-12-19T16:17:22.137461+0000","last_clean":"2023-12-19T16:17:22.137461+0000","last_became_active":"2023-12-19T16:17:21.743597+0000","last_became_peered":"2023-12-19T16:17:21.743597+0000","last_unstale":"2023-12-19T16:17:22.137461+0000","last_undegraded":"2023-12-19T16:17:22.137461+0000","last_fullsized":"2023-12-19T16:17:22.137461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155323+0000","last_change":"2023-12-19T16:17:22.149800+0000","last_active":"2023-12-19T16:17:22.155323+0000","last_peered":"2023-12-19T16:17:22.155323+0000","last_clean":"2023-12-19T16:17:22.155323+0000","last_became_active":"2023-12-19T16:17:22.149385+0000","last_became_peered":"2023-12-19T16:17:22.149385+0000","last_unstale":"2023-12-19T16:17:22.155323+0000","last_undegraded":"2023-12-19T16:17:22.155323+0000","last_fullsized":"2023-12-19T16:17:22.155323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:57.924303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.139919+0000","last_change":"2023-12-19T16:17:21.761964+0000","last_active":"2023-12-19T16:17:22.139919+0000","last_peered":"2023-12-19T16:17:22.139919+0000","last_clean":"2023-12-19T16:17:22.139919+0000","last_became_active":"2023-12-19T16:17:21.760304+0000","last_became_peered":"2023-12-19T16:17:21.760304+0000","last_unstale":"2023-12-19T16:17:22.139919+0000","last_undegraded":"2023-12-19T16:17:22.139919+0000","last_fullsized":"2023-12-19T16:17:22.139919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:44.188677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134631+0000","last_change":"2023-12-19T16:17:22.148063+0000","last_active":"2023-12-19T16:17:23.134631+0000","last_peered":"2023-12-19T16:17:23.134631+0000","last_clean":"2023-12-19T16:17:23.134631+0000","last_became_active":"2023-12-19T16:17:22.147442+0000","last_became_peered":"2023-12-19T16:17:22.147442+0000","last_unstale":"2023-12-19T16:17:23.134631+0000","last_undegraded":"2023-12-19T16:17:23.134631+0000","last_fullsized":"2023-12-19T16:17:23.134631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.735466+0000","last_change":"2023-12-19T16:17:20.735466+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.735466+0000","last_undegraded":"2023-12-19T16:17:20.735466+0000","last_fullsized":"2023-12-19T16:17:20.735466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149280+0000","last_change":"2023-12-19T16:17:22.140926+0000","last_active":"2023-12-19T16:17:22.149280+0000","last_peered":"2023-12-19T16:17:22.149280+0000","last_clean":"2023-12-19T16:17:22.149280+0000","last_became_active":"2023-12-19T16:17:22.140652+0000","last_became_peered":"2023-12-19T16:17:22.140652+0000","last_unstale":"2023-12-19T16:17:22.149280+0000","last_undegraded":"2023-12-19T16:17:22.149280+0000","last_fullsized":"2023-12-19T16:17:22.149280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:29.710944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166720+0000","last_change":"2023-12-19T16:17:21.761218+0000","last_active":"2023-12-19T16:17:22.166720+0000","last_peered":"2023-12-19T16:17:22.166720+0000","last_clean":"2023-12-19T16:17:22.166720+0000","last_became_active":"2023-12-19T16:17:21.760858+0000","last_became_peered":"2023-12-19T16:17:21.760858+0000","last_unstale":"2023-12-19T16:17:22.166720+0000","last_undegraded":"2023-12-19T16:17:22.166720+0000","last_fullsized":"2023-12-19T16:17:22.166720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.150861+0000","last_change":"2023-12-19T16:17:22.148334+0000","last_active":"2023-12-19T16:17:22.150861+0000","last_peered":"2023-12-19T16:17:22.150861+0000","last_clean":"2023-12-19T16:17:22.150861+0000","last_became_active":"2023-12-19T16:17:22.148036+0000","last_became_peered":"2023-12-19T16:17:22.148036+0000","last_unstale":"2023-12-19T16:17:22.150861+0000","last_undegraded":"2023-12-19T16:17:22.150861+0000","last_fullsized":"2023-12-19T16:17:22.150861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:57.733309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158973+0000","last_change":"2023-12-19T16:17:21.759281+0000","last_active":"2023-12-19T16:17:22.158973+0000","last_peered":"2023-12-19T16:17:22.158973+0000","last_clean":"2023-12-19T16:17:22.158973+0000","last_became_active":"2023-12-19T16:17:21.758854+0000","last_became_peered":"2023-12-19T16:17:21.758854+0000","last_unstale":"2023-12-19T16:17:22.158973+0000","last_undegraded":"2023-12-19T16:17:22.158973+0000","last_fullsized":"2023-12-19T16:17:22.158973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:43.061583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134967+0000","last_change":"2023-12-19T16:17:22.157996+0000","last_active":"2023-12-19T16:17:23.134967+0000","last_peered":"2023-12-19T16:17:23.134967+0000","last_clean":"2023-12-19T16:17:23.134967+0000","last_became_active":"2023-12-19T16:17:22.157742+0000","last_became_peered":"2023-12-19T16:17:22.157742+0000","last_unstale":"2023-12-19T16:17:23.134967+0000","last_undegraded":"2023-12-19T16:17:23.134967+0000","last_fullsized":"2023-12-19T16:17:23.134967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165864+0000","last_change":"2023-12-19T16:17:21.755379+0000","last_active":"2023-12-19T16:17:22.165864+0000","last_peered":"2023-12-19T16:17:22.165864+0000","last_clean":"2023-12-19T16:17:22.165864+0000","last_became_active":"2023-12-19T16:17:21.754564+0000","last_became_peered":"2023-12-19T16:17:21.754564+0000","last_unstale":"2023-12-19T16:17:22.165864+0000","last_undegraded":"2023-12-19T16:17:22.165864+0000","last_fullsized":"2023-12-19T16:17:22.165864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:11.726871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149876+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.149876+0000","last_peered":"2023-12-19T16:17:22.149876+0000","last_clean":"2023-12-19T16:17:22.149876+0000","last_became_active":"2023-12-19T16:17:22.148868+0000","last_became_peered":"2023-12-19T16:17:22.148868+0000","last_unstale":"2023-12-19T16:17:22.149876+0000","last_undegraded":"2023-12-19T16:17:22.149876+0000","last_fullsized":"2023-12-19T16:17:22.149876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:14.946456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140783+0000","last_change":"2023-12-19T16:17:21.763539+0000","last_active":"2023-12-19T16:17:22.140783+0000","last_peered":"2023-12-19T16:17:22.140783+0000","last_clean":"2023-12-19T16:17:22.140783+0000","last_became_active":"2023-12-19T16:17:21.763131+0000","last_became_peered":"2023-12-19T16:17:21.763131+0000","last_unstale":"2023-12-19T16:17:22.140783+0000","last_undegraded":"2023-12-19T16:17:22.140783+0000","last_fullsized":"2023-12-19T16:17:22.140783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:56.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161993+0000","last_change":"2023-12-19T16:17:22.157501+0000","last_active":"2023-12-19T16:17:22.161993+0000","last_peered":"2023-12-19T16:17:22.161993+0000","last_clean":"2023-12-19T16:17:22.161993+0000","last_became_active":"2023-12-19T16:17:22.157209+0000","last_became_peered":"2023-12-19T16:17:22.157209+0000","last_unstale":"2023-12-19T16:17:22.161993+0000","last_undegraded":"2023-12-19T16:17:22.161993+0000","last_fullsized":"2023-12-19T16:17:22.161993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:22.093772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137345+0000","last_change":"2023-12-19T16:17:21.751942+0000","last_active":"2023-12-19T16:17:22.137345+0000","last_peered":"2023-12-19T16:17:22.137345+0000","last_clean":"2023-12-19T16:17:22.137345+0000","last_became_active":"2023-12-19T16:17:21.751600+0000","last_became_peered":"2023-12-19T16:17:21.751600+0000","last_unstale":"2023-12-19T16:17:22.137345+0000","last_undegraded":"2023-12-19T16:17:22.137345+0000","last_fullsized":"2023-12-19T16:17:22.137345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:47.234683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156753+0000","last_change":"2023-12-19T16:17:22.152347+0000","last_active":"2023-12-19T16:17:22.156753+0000","last_peered":"2023-12-19T16:17:22.156753+0000","last_clean":"2023-12-19T16:17:22.156753+0000","last_became_active":"2023-12-19T16:17:22.151834+0000","last_became_peered":"2023-12-19T16:17:22.151834+0000","last_unstale":"2023-12-19T16:17:22.156753+0000","last_undegraded":"2023-12-19T16:17:22.156753+0000","last_fullsized":"2023-12-19T16:17:22.156753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733673+0000","last_change":"2023-12-19T16:17:20.733673+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733673+0000","last_undegraded":"2023-12-19T16:17:20.733673+0000","last_fullsized":"2023-12-19T16:17:20.733673+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155943+0000","last_change":"2023-12-19T16:17:22.151111+0000","last_active":"2023-12-19T16:17:22.155943+0000","last_peered":"2023-12-19T16:17:22.155943+0000","last_clean":"2023-12-19T16:17:22.155943+0000","last_became_active":"2023-12-19T16:17:22.150803+0000","last_became_peered":"2023-12-19T16:17:22.150803+0000","last_unstale":"2023-12-19T16:17:22.155943+0000","last_undegraded":"2023-12-19T16:17:22.155943+0000","last_fullsized":"2023-12-19T16:17:22.155943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127328+0000","last_change":"2023-12-19T16:17:21.756215+0000","last_active":"2023-12-19T16:17:22.127328+0000","last_peered":"2023-12-19T16:17:22.127328+0000","last_clean":"2023-12-19T16:17:22.127328+0000","last_became_active":"2023-12-19T16:17:21.755911+0000","last_became_peered":"2023-12-19T16:17:21.755911+0000","last_unstale":"2023-12-19T16:17:22.127328+0000","last_undegraded":"2023-12-19T16:17:22.127328+0000","last_fullsized":"2023-12-19T16:17:22.127328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:40.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158663+0000","last_change":"2023-12-19T16:17:22.156498+0000","last_active":"2023-12-19T16:17:22.158663+0000","last_peered":"2023-12-19T16:17:22.158663+0000","last_clean":"2023-12-19T16:17:22.158663+0000","last_became_active":"2023-12-19T16:17:22.156255+0000","last_became_peered":"2023-12-19T16:17:22.156255+0000","last_unstale":"2023-12-19T16:17:22.158663+0000","last_undegraded":"2023-12-19T16:17:22.158663+0000","last_fullsized":"2023-12-19T16:17:22.158663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:06.241133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156451+0000","last_change":"2023-12-19T16:17:21.758755+0000","last_active":"2023-12-19T16:17:22.156451+0000","last_peered":"2023-12-19T16:17:22.156451+0000","last_clean":"2023-12-19T16:17:22.156451+0000","last_became_active":"2023-12-19T16:17:21.758489+0000","last_became_peered":"2023-12-19T16:17:21.758489+0000","last_unstale":"2023-12-19T16:17:22.156451+0000","last_undegraded":"2023-12-19T16:17:22.156451+0000","last_fullsized":"2023-12-19T16:17:22.156451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141669+0000","last_change":"2023-12-19T16:17:21.756779+0000","last_active":"2023-12-19T16:17:22.141669+0000","last_peered":"2023-12-19T16:17:22.141669+0000","last_clean":"2023-12-19T16:17:22.141669+0000","last_became_active":"2023-12-19T16:17:21.756421+0000","last_became_peered":"2023-12-19T16:17:21.756421+0000","last_unstale":"2023-12-19T16:17:22.141669+0000","last_undegraded":"2023-12-19T16:17:22.141669+0000","last_fullsized":"2023-12-19T16:17:22.141669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158640+0000","last_change":"2023-12-19T16:17:22.156581+0000","last_active":"2023-12-19T16:17:22.158640+0000","last_peered":"2023-12-19T16:17:22.158640+0000","last_clean":"2023-12-19T16:17:22.158640+0000","last_became_active":"2023-12-19T16:17:22.156314+0000","last_became_peered":"2023-12-19T16:17:22.156314+0000","last_unstale":"2023-12-19T16:17:22.158640+0000","last_undegraded":"2023-12-19T16:17:22.158640+0000","last_fullsized":"2023-12-19T16:17:22.158640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:47.136357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129951+0000","last_change":"2023-12-19T16:17:21.759011+0000","last_active":"2023-12-19T16:17:22.129951+0000","last_peered":"2023-12-19T16:17:22.129951+0000","last_clean":"2023-12-19T16:17:22.129951+0000","last_became_active":"2023-12-19T16:17:21.758694+0000","last_became_peered":"2023-12-19T16:17:21.758694+0000","last_unstale":"2023-12-19T16:17:22.129951+0000","last_undegraded":"2023-12-19T16:17:22.129951+0000","last_fullsized":"2023-12-19T16:17:22.129951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:32.774324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140708+0000","last_change":"2023-12-19T16:17:21.758295+0000","last_active":"2023-12-19T16:17:22.140708+0000","last_peered":"2023-12-19T16:17:22.140708+0000","last_clean":"2023-12-19T16:17:22.140708+0000","last_became_active":"2023-12-19T16:17:21.758035+0000","last_became_peered":"2023-12-19T16:17:21.758035+0000","last_unstale":"2023-12-19T16:17:22.140708+0000","last_undegraded":"2023-12-19T16:17:22.140708+0000","last_fullsized":"2023-12-19T16:17:22.140708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:59.521708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156076+0000","last_change":"2023-12-19T16:17:22.151966+0000","last_active":"2023-12-19T16:17:22.156076+0000","last_peered":"2023-12-19T16:17:22.156076+0000","last_clean":"2023-12-19T16:17:22.156076+0000","last_became_active":"2023-12-19T16:17:22.150479+0000","last_became_peered":"2023-12-19T16:17:22.150479+0000","last_unstale":"2023-12-19T16:17:22.156076+0000","last_undegraded":"2023-12-19T16:17:22.156076+0000","last_fullsized":"2023-12-19T16:17:22.156076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:25.579064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127836+0000","last_change":"2023-12-19T16:17:21.753501+0000","last_active":"2023-12-19T16:17:22.127836+0000","last_peered":"2023-12-19T16:17:22.127836+0000","last_clean":"2023-12-19T16:17:22.127836+0000","last_became_active":"2023-12-19T16:17:21.753228+0000","last_became_peered":"2023-12-19T16:17:21.753228+0000","last_unstale":"2023-12-19T16:17:22.127836+0000","last_undegraded":"2023-12-19T16:17:22.127836+0000","last_fullsized":"2023-12-19T16:17:22.127836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:16.857037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162995+0000","last_change":"2023-12-19T16:17:22.158201+0000","last_active":"2023-12-19T16:17:22.162995+0000","last_peered":"2023-12-19T16:17:22.162995+0000","last_clean":"2023-12-19T16:17:22.162995+0000","last_became_active":"2023-12-19T16:17:22.155301+0000","last_became_peered":"2023-12-19T16:17:22.155301+0000","last_unstale":"2023-12-19T16:17:22.162995+0000","last_undegraded":"2023-12-19T16:17:22.162995+0000","last_fullsized":"2023-12-19T16:17:22.162995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:34.957262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140060+0000","last_change":"2023-12-19T16:17:21.755941+0000","last_active":"2023-12-19T16:17:22.140060+0000","last_peered":"2023-12-19T16:17:22.140060+0000","last_clean":"2023-12-19T16:17:22.140060+0000","last_became_active":"2023-12-19T16:17:21.755557+0000","last_became_peered":"2023-12-19T16:17:21.755557+0000","last_unstale":"2023-12-19T16:17:22.140060+0000","last_undegraded":"2023-12-19T16:17:22.140060+0000","last_fullsized":"2023-12-19T16:17:22.140060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:56.916818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134632+0000","last_change":"2023-12-19T16:17:22.141268+0000","last_active":"2023-12-19T16:17:23.134632+0000","last_peered":"2023-12-19T16:17:23.134632+0000","last_clean":"2023-12-19T16:17:23.134632+0000","last_became_active":"2023-12-19T16:17:22.140999+0000","last_became_peered":"2023-12-19T16:17:22.140999+0000","last_unstale":"2023-12-19T16:17:23.134632+0000","last_undegraded":"2023-12-19T16:17:23.134632+0000","last_fullsized":"2023-12-19T16:17:23.134632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129706+0000","last_change":"2023-12-19T16:17:21.749542+0000","last_active":"2023-12-19T16:17:22.129706+0000","last_peered":"2023-12-19T16:17:22.129706+0000","last_clean":"2023-12-19T16:17:22.129706+0000","last_became_active":"2023-12-19T16:17:21.749270+0000","last_became_peered":"2023-12-19T16:17:21.749270+0000","last_unstale":"2023-12-19T16:17:22.129706+0000","last_undegraded":"2023-12-19T16:17:22.129706+0000","last_fullsized":"2023-12-19T16:17:22.129706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:30.862265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166669+0000","last_change":"2023-12-19T16:17:22.159978+0000","last_active":"2023-12-19T16:17:22.166669+0000","last_peered":"2023-12-19T16:17:22.166669+0000","last_clean":"2023-12-19T16:17:22.166669+0000","last_became_active":"2023-12-19T16:17:22.159594+0000","last_became_peered":"2023-12-19T16:17:22.159594+0000","last_unstale":"2023-12-19T16:17:22.166669+0000","last_undegraded":"2023-12-19T16:17:22.166669+0000","last_fullsized":"2023-12-19T16:17:22.166669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:14.977272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151286+0000","last_change":"2023-12-19T16:17:21.757859+0000","last_active":"2023-12-19T16:17:22.151286+0000","last_peered":"2023-12-19T16:17:22.151286+0000","last_clean":"2023-12-19T16:17:22.151286+0000","last_became_active":"2023-12-19T16:17:21.757542+0000","last_became_peered":"2023-12-19T16:17:21.757542+0000","last_unstale":"2023-12-19T16:17:22.151286+0000","last_undegraded":"2023-12-19T16:17:22.151286+0000","last_fullsized":"2023-12-19T16:17:22.151286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:07.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T16:17:21.742544+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:17:21.742544+0000","last_peered":"2023-12-19T16:17:21.742544+0000","last_clean":"2023-12-19T16:17:21.742544+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:17:21.742544+0000","last_undegraded":"2023-12-19T16:17:21.742544+0000","last_fullsized":"2023-12-19T16:17:21.742544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476763,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":242672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.071}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.97099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476763,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":241198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.32400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.496}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.622},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.70299999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476763,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":831546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.624},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":241780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.435},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.54600000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.62}]}]},{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.68100000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.629}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.72999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":577536,"data_stored":234333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1171456,"data_stored":824701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.435}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50700000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.501},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:26.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 Processor -- start 2023-12-19T16:17:26.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 -- start start 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c8fa0 0x7f16280c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16280b1690 0x7f16280b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280c9940 con 0x7f162815dfc0 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162806d720 con 0x7f16280c8fa0 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f162dd39640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162815e3a0 con 0x7f16280b1690 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c8fa0 0x7f16280c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16280c8fa0 0x7f16280c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36618/0 (socket says 172.21.15.73:36618) 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 -- 172.21.15.73:0/517000565 learned_addr learned my addr 172.21.15.73:0/517000565 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 -- 172.21.15.73:0/517000565 >> v2:172.21.15.162:3300/0 conn(0x7f16280b1690 msgr2=0x7f16280b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 --2- 172.21.15.73:0/517000565 >> v2:172.21.15.162:3300/0 conn(0x7f16280b1690 0x7f16280b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 -- 172.21.15.73:0/517000565 >> v1:172.21.15.162:6789/0 conn(0x7f162815dfc0 legacy=0x7f16280cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:26.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.738+0000 7f1626ffd640 1 -- 172.21.15.73:0/517000565 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162806c3a0 con 0x7f16280c8fa0 2023-12-19T16:17:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f1626ffd640 1 --2- 172.21.15.73:0/517000565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c8fa0 0x7f16280c9400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f162806e550 tx=0x7f161c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9728e77da097fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f16267fc640 1 -- 172.21.15.73:0/517000565 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0aa5f0 con 0x7f16280c8fa0 2023-12-19T16:17:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f16267fc640 1 -- 172.21.15.73:0/517000565 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c0aa750 con 0x7f16280c8fa0 2023-12-19T16:17:26.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f16267fc640 1 -- 172.21.15.73:0/517000565 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c0aaae0 con 0x7f16280c8fa0 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 -- 172.21.15.73:0/517000565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c8fa0 msgr2=0x7f16280c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 --2- 172.21.15.73:0/517000565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c8fa0 0x7f16280c9400 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f162806e550 tx=0x7f161c01c490 comp rx=0 tx=0).stop 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 -- 172.21.15.73:0/517000565 shutdown_connections 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 --2- 172.21.15.73:0/517000565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280c8fa0 0x7f16280c9400 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 --2- 172.21.15.73:0/517000565 >> v2:172.21.15.162:3300/0 conn(0x7f16280b1690 0x7f16280b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 -- 172.21.15.73:0/517000565 >> 172.21.15.73:0/517000565 conn(0x7f16280b0270 msgr2=0x7f16280b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 -- 172.21.15.73:0/517000565 shutdown_connections 2023-12-19T16:17:26.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.742+0000 7f162dd39640 1 -- 172.21.15.73:0/517000565 wait complete. 2023-12-19T16:17:26.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 Processor -- start 2023-12-19T16:17:26.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- start start 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280c8fa0 0x7f16280acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162815dfc0 0x7f16280c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1628141a30 con 0x7f16280b1690 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280ad650 con 0x7f16280c8fa0 2023-12-19T16:17:26.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280ad930 con 0x7f162815dfc0 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36632/0 (socket says 172.21.15.73:36632) 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 -- 172.21.15.73:0/2063034908 learned_addr learned my addr 172.21.15.73:0/2063034908 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f1626ffd640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280c8fa0 0x7f16280acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f1627fff640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162815dfc0 0x7f16280c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 -- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162815dfc0 msgr2=0x7f16280c0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162815dfc0 0x7f16280c0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 -- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280c8fa0 msgr2=0x7f16280acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280c8fa0 0x7f16280acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 -- 172.21.15.73:0/2063034908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0094d0 con 0x7f16280b1690 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f16277fe640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f161800b3e0 tx=0x7f161800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011830 con 0x7f16280b1690 2023-12-19T16:17:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180119b0 con 0x7f16280b1690 2023-12-19T16:17:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011d60 con 0x7f16280b1690 2023-12-19T16:17:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16280adc10 con 0x7f16280b1690 2023-12-19T16:17:26.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628154b50 con 0x7f16280b1690 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.746+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628141b70 con 0x7f16280b1690 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.750+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f161801a400 con 0x7f16280b1690 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.750+0000 7f160ffff640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 0x7f1614067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.750+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16180832b0 con 0x7f16280b1690 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.750+0000 7f1626ffd640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 0x7f1614067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:26.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.750+0000 7f1626ffd640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 0x7f1614067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f161c0ae000 tx=0x7f161c0b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:26.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.754+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1628141b70 con 0x7f16280b1690 2023-12-19T16:17:26.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.902+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f162806cf20 con 0x7f1614065a60 2023-12-19T16:17:26.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.910+0000 7f160ffff640 1 -- 172.21.15.73:0/2063034908 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288071 (secure 0 0 0) 0x7f161c0aa9c0 con 0x7f1614065a60 2023-12-19T16:17:26.920 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:26.922 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:17:26.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 msgr2=0x7f1614067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 0x7f1614067f20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f161c0ae000 tx=0x7f161c0b5040 comp rx=0 tx=0).stop 2023-12-19T16:17:26.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 msgr2=0x7f16281566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:26.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f161800b3e0 tx=0x7f161800b8a0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.923 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 shutdown_connections 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f162815dfc0 0x7f16280c0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16280c8fa0 0x7f16280acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1614065a60 0x7f1614067f20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 --2- 172.21.15.73:0/2063034908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16280b1690 0x7f16281566a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 >> 172.21.15.73:0/2063034908 conn(0x7f16280b0270 msgr2=0x7f16280b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:26.924 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 shutdown_connections 2023-12-19T16:17:26.925 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:26.914+0000 7f162dd39640 1 -- 172.21.15.73:0/2063034908 wait complete. 2023-12-19T16:17:26.939 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T16:17:26.469798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225436,"kb_used_data":5724,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749284,"statfs":{"total":773094113280,"available":772863266816,"internally_reserved":0,"allocated":5861376,"data_stored":3072346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742766"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160155+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160155+0000","last_peered":"2023-12-19T16:17:22.160155+0000","last_clean":"2023-12-19T16:17:22.160155+0000","last_became_active":"2023-12-19T16:17:22.155094+0000","last_became_peered":"2023-12-19T16:17:22.155094+0000","last_unstale":"2023-12-19T16:17:22.160155+0000","last_undegraded":"2023-12-19T16:17:22.160155+0000","last_fullsized":"2023-12-19T16:17:22.160155+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135072+0000","last_change":"2023-12-19T16:17:22.151796+0000","last_active":"2023-12-19T16:17:23.135072+0000","last_peered":"2023-12-19T16:17:23.135072+0000","last_clean":"2023-12-19T16:17:23.135072+0000","last_became_active":"2023-12-19T16:17:22.151376+0000","last_became_peered":"2023-12-19T16:17:22.151376+0000","last_unstale":"2023-12-19T16:17:23.135072+0000","last_undegraded":"2023-12-19T16:17:23.135072+0000","last_fullsized":"2023-12-19T16:17:23.135072+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.152979+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.152979+0000","last_peered":"2023-12-19T16:17:22.152979+0000","last_clean":"2023-12-19T16:17:22.152979+0000","last_became_active":"2023-12-19T16:17:22.148854+0000","last_became_peered":"2023-12-19T16:17:22.148854+0000","last_unstale":"2023-12-19T16:17:22.152979+0000","last_undegraded":"2023-12-19T16:17:22.152979+0000","last_fullsized":"2023-12-19T16:17:22.152979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:36.076596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160354+0000","last_change":"2023-12-19T16:17:22.153271+0000","last_active":"2023-12-19T16:17:22.160354+0000","last_peered":"2023-12-19T16:17:22.160354+0000","last_clean":"2023-12-19T16:17:22.160354+0000","last_became_active":"2023-12-19T16:17:22.152741+0000","last_became_peered":"2023-12-19T16:17:22.152741+0000","last_unstale":"2023-12-19T16:17:22.160354+0000","last_undegraded":"2023-12-19T16:17:22.160354+0000","last_fullsized":"2023-12-19T16:17:22.160354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:22.185982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153900+0000","last_change":"2023-12-19T16:17:22.146150+0000","last_active":"2023-12-19T16:17:22.153900+0000","last_peered":"2023-12-19T16:17:22.153900+0000","last_clean":"2023-12-19T16:17:22.153900+0000","last_became_active":"2023-12-19T16:17:22.145911+0000","last_became_peered":"2023-12-19T16:17:22.145911+0000","last_unstale":"2023-12-19T16:17:22.153900+0000","last_undegraded":"2023-12-19T16:17:22.153900+0000","last_fullsized":"2023-12-19T16:17:22.153900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166513+0000","last_change":"2023-12-19T16:17:22.159277+0000","last_active":"2023-12-19T16:17:22.166513+0000","last_peered":"2023-12-19T16:17:22.166513+0000","last_clean":"2023-12-19T16:17:22.166513+0000","last_became_active":"2023-12-19T16:17:22.157136+0000","last_became_peered":"2023-12-19T16:17:22.157136+0000","last_unstale":"2023-12-19T16:17:22.166513+0000","last_undegraded":"2023-12-19T16:17:22.166513+0000","last_fullsized":"2023-12-19T16:17:22.166513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.978621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158401+0000","last_change":"2023-12-19T16:17:22.152378+0000","last_active":"2023-12-19T16:17:22.158401+0000","last_peered":"2023-12-19T16:17:22.158401+0000","last_clean":"2023-12-19T16:17:22.158401+0000","last_became_active":"2023-12-19T16:17:22.152125+0000","last_became_peered":"2023-12-19T16:17:22.152125+0000","last_unstale":"2023-12-19T16:17:22.158401+0000","last_undegraded":"2023-12-19T16:17:22.158401+0000","last_fullsized":"2023-12-19T16:17:22.158401+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:57:59.015795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166868+0000","last_change":"2023-12-19T16:17:22.161522+0000","last_active":"2023-12-19T16:17:22.166868+0000","last_peered":"2023-12-19T16:17:22.166868+0000","last_clean":"2023-12-19T16:17:22.166868+0000","last_became_active":"2023-12-19T16:17:22.161247+0000","last_became_peered":"2023-12-19T16:17:22.161247+0000","last_unstale":"2023-12-19T16:17:22.166868+0000","last_undegraded":"2023-12-19T16:17:22.166868+0000","last_fullsized":"2023-12-19T16:17:22.166868+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:49.572099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167337+0000","last_change":"2023-12-19T16:17:22.164109+0000","last_active":"2023-12-19T16:17:22.167337+0000","last_peered":"2023-12-19T16:17:22.167337+0000","last_clean":"2023-12-19T16:17:22.167337+0000","last_became_active":"2023-12-19T16:17:22.163818+0000","last_became_peered":"2023-12-19T16:17:22.163818+0000","last_unstale":"2023-12-19T16:17:22.167337+0000","last_undegraded":"2023-12-19T16:17:22.167337+0000","last_fullsized":"2023-12-19T16:17:22.167337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167027+0000","last_change":"2023-12-19T16:17:22.162318+0000","last_active":"2023-12-19T16:17:22.167027+0000","last_peered":"2023-12-19T16:17:22.167027+0000","last_clean":"2023-12-19T16:17:22.167027+0000","last_became_active":"2023-12-19T16:17:22.161961+0000","last_became_peered":"2023-12-19T16:17:22.161961+0000","last_unstale":"2023-12-19T16:17:22.167027+0000","last_undegraded":"2023-12-19T16:17:22.167027+0000","last_fullsized":"2023-12-19T16:17:22.167027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:17.864523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134881+0000","last_change":"2023-12-19T16:17:22.147920+0000","last_active":"2023-12-19T16:17:23.134881+0000","last_peered":"2023-12-19T16:17:23.134881+0000","last_clean":"2023-12-19T16:17:23.134881+0000","last_became_active":"2023-12-19T16:17:22.147715+0000","last_became_peered":"2023-12-19T16:17:22.147715+0000","last_unstale":"2023-12-19T16:17:23.134881+0000","last_undegraded":"2023-12-19T16:17:23.134881+0000","last_fullsized":"2023-12-19T16:17:23.134881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161975+0000","last_change":"2023-12-19T16:17:22.157376+0000","last_active":"2023-12-19T16:17:22.161975+0000","last_peered":"2023-12-19T16:17:22.161975+0000","last_clean":"2023-12-19T16:17:22.161975+0000","last_became_active":"2023-12-19T16:17:22.157066+0000","last_became_peered":"2023-12-19T16:17:22.157066+0000","last_unstale":"2023-12-19T16:17:22.161975+0000","last_undegraded":"2023-12-19T16:17:22.161975+0000","last_fullsized":"2023-12-19T16:17:22.161975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167226+0000","last_change":"2023-12-19T16:17:22.163715+0000","last_active":"2023-12-19T16:17:22.167226+0000","last_peered":"2023-12-19T16:17:22.167226+0000","last_clean":"2023-12-19T16:17:22.167226+0000","last_became_active":"2023-12-19T16:17:22.163411+0000","last_became_peered":"2023-12-19T16:17:22.163411+0000","last_unstale":"2023-12-19T16:17:22.167226+0000","last_undegraded":"2023-12-19T16:17:22.167226+0000","last_fullsized":"2023-12-19T16:17:22.167226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:41.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160945+0000","last_change":"2023-12-19T16:17:22.154892+0000","last_active":"2023-12-19T16:17:22.160945+0000","last_peered":"2023-12-19T16:17:22.160945+0000","last_clean":"2023-12-19T16:17:22.160945+0000","last_became_active":"2023-12-19T16:17:22.154466+0000","last_became_peered":"2023-12-19T16:17:22.154466+0000","last_unstale":"2023-12-19T16:17:22.160945+0000","last_undegraded":"2023-12-19T16:17:22.160945+0000","last_fullsized":"2023-12-19T16:17:22.160945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:45.655780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.163321+0000","last_change":"2023-12-19T16:17:22.159873+0000","last_active":"2023-12-19T16:17:22.163321+0000","last_peered":"2023-12-19T16:17:22.163321+0000","last_clean":"2023-12-19T16:17:22.163321+0000","last_became_active":"2023-12-19T16:17:22.159334+0000","last_became_peered":"2023-12-19T16:17:22.159334+0000","last_unstale":"2023-12-19T16:17:22.163321+0000","last_undegraded":"2023-12-19T16:17:22.163321+0000","last_fullsized":"2023-12-19T16:17:22.163321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135257+0000","last_change":"2023-12-19T16:17:22.159381+0000","last_active":"2023-12-19T16:17:23.135257+0000","last_peered":"2023-12-19T16:17:23.135257+0000","last_clean":"2023-12-19T16:17:23.135257+0000","last_became_active":"2023-12-19T16:17:22.159098+0000","last_became_peered":"2023-12-19T16:17:22.159098+0000","last_unstale":"2023-12-19T16:17:23.135257+0000","last_undegraded":"2023-12-19T16:17:23.135257+0000","last_fullsized":"2023-12-19T16:17:23.135257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160665+0000","last_change":"2023-12-19T16:17:22.154775+0000","last_active":"2023-12-19T16:17:22.160665+0000","last_peered":"2023-12-19T16:17:22.160665+0000","last_clean":"2023-12-19T16:17:22.160665+0000","last_became_active":"2023-12-19T16:17:22.154030+0000","last_became_peered":"2023-12-19T16:17:22.154030+0000","last_unstale":"2023-12-19T16:17:22.160665+0000","last_undegraded":"2023-12-19T16:17:22.160665+0000","last_fullsized":"2023-12-19T16:17:22.160665+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:55.606279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161535+0000","last_change":"2023-12-19T16:17:22.158100+0000","last_active":"2023-12-19T16:17:22.161535+0000","last_peered":"2023-12-19T16:17:22.161535+0000","last_clean":"2023-12-19T16:17:22.161535+0000","last_became_active":"2023-12-19T16:17:22.157849+0000","last_became_peered":"2023-12-19T16:17:22.157849+0000","last_unstale":"2023-12-19T16:17:22.161535+0000","last_undegraded":"2023-12-19T16:17:22.161535+0000","last_fullsized":"2023-12-19T16:17:22.161535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156098+0000","last_change":"2023-12-19T16:17:22.152299+0000","last_active":"2023-12-19T16:17:22.156098+0000","last_peered":"2023-12-19T16:17:22.156098+0000","last_clean":"2023-12-19T16:17:22.156098+0000","last_became_active":"2023-12-19T16:17:22.151817+0000","last_became_peered":"2023-12-19T16:17:22.151817+0000","last_unstale":"2023-12-19T16:17:22.156098+0000","last_undegraded":"2023-12-19T16:17:22.156098+0000","last_fullsized":"2023-12-19T16:17:22.156098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:51.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149605+0000","last_change":"2023-12-19T16:17:22.141954+0000","last_active":"2023-12-19T16:17:22.149605+0000","last_peered":"2023-12-19T16:17:22.149605+0000","last_clean":"2023-12-19T16:17:22.149605+0000","last_became_active":"2023-12-19T16:17:22.141589+0000","last_became_peered":"2023-12-19T16:17:22.141589+0000","last_unstale":"2023-12-19T16:17:22.149605+0000","last_undegraded":"2023-12-19T16:17:22.149605+0000","last_fullsized":"2023-12-19T16:17:22.149605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:56.610477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.148162+0000","last_change":"2023-12-19T16:17:22.142801+0000","last_active":"2023-12-19T16:17:22.148162+0000","last_peered":"2023-12-19T16:17:22.148162+0000","last_clean":"2023-12-19T16:17:22.148162+0000","last_became_active":"2023-12-19T16:17:22.142404+0000","last_became_peered":"2023-12-19T16:17:22.142404+0000","last_unstale":"2023-12-19T16:17:22.148162+0000","last_undegraded":"2023-12-19T16:17:22.148162+0000","last_fullsized":"2023-12-19T16:17:22.148162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:37.679998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134630+0000","last_change":"2023-12-19T16:17:22.155898+0000","last_active":"2023-12-19T16:17:23.134630+0000","last_peered":"2023-12-19T16:17:23.134630+0000","last_clean":"2023-12-19T16:17:23.134630+0000","last_became_active":"2023-12-19T16:17:22.155625+0000","last_became_peered":"2023-12-19T16:17:22.155625+0000","last_unstale":"2023-12-19T16:17:23.134630+0000","last_undegraded":"2023-12-19T16:17:23.134630+0000","last_fullsized":"2023-12-19T16:17:23.134630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160173+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160173+0000","last_peered":"2023-12-19T16:17:22.160173+0000","last_clean":"2023-12-19T16:17:22.160173+0000","last_became_active":"2023-12-19T16:17:22.154831+0000","last_became_peered":"2023-12-19T16:17:22.154831+0000","last_unstale":"2023-12-19T16:17:22.160173+0000","last_undegraded":"2023-12-19T16:17:22.160173+0000","last_fullsized":"2023-12-19T16:17:22.160173+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166936+0000","last_change":"2023-12-19T16:17:22.161976+0000","last_active":"2023-12-19T16:17:22.166936+0000","last_peered":"2023-12-19T16:17:22.166936+0000","last_clean":"2023-12-19T16:17:22.166936+0000","last_became_active":"2023-12-19T16:17:22.161253+0000","last_became_peered":"2023-12-19T16:17:22.161253+0000","last_unstale":"2023-12-19T16:17:22.166936+0000","last_undegraded":"2023-12-19T16:17:22.166936+0000","last_fullsized":"2023-12-19T16:17:22.166936+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141110+0000","last_change":"2023-12-19T16:17:22.133581+0000","last_active":"2023-12-19T16:17:22.141110+0000","last_peered":"2023-12-19T16:17:22.141110+0000","last_clean":"2023-12-19T16:17:22.141110+0000","last_became_active":"2023-12-19T16:17:22.133306+0000","last_became_peered":"2023-12-19T16:17:22.133306+0000","last_unstale":"2023-12-19T16:17:22.141110+0000","last_undegraded":"2023-12-19T16:17:22.141110+0000","last_fullsized":"2023-12-19T16:17:22.141110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:40.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143624+0000","last_change":"2023-12-19T16:17:22.139797+0000","last_active":"2023-12-19T16:17:22.143624+0000","last_peered":"2023-12-19T16:17:22.143624+0000","last_clean":"2023-12-19T16:17:22.143624+0000","last_became_active":"2023-12-19T16:17:22.139565+0000","last_became_peered":"2023-12-19T16:17:22.139565+0000","last_unstale":"2023-12-19T16:17:22.143624+0000","last_undegraded":"2023-12-19T16:17:22.143624+0000","last_fullsized":"2023-12-19T16:17:22.143624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:15.932295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153879+0000","last_change":"2023-12-19T16:17:22.145631+0000","last_active":"2023-12-19T16:17:22.153879+0000","last_peered":"2023-12-19T16:17:22.153879+0000","last_clean":"2023-12-19T16:17:22.153879+0000","last_became_active":"2023-12-19T16:17:22.145292+0000","last_became_peered":"2023-12-19T16:17:22.145292+0000","last_unstale":"2023-12-19T16:17:22.153879+0000","last_undegraded":"2023-12-19T16:17:22.153879+0000","last_fullsized":"2023-12-19T16:17:22.153879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134641+0000","last_change":"2023-12-19T16:17:22.142912+0000","last_active":"2023-12-19T16:17:23.134641+0000","last_peered":"2023-12-19T16:17:23.134641+0000","last_clean":"2023-12-19T16:17:23.134641+0000","last_became_active":"2023-12-19T16:17:22.142631+0000","last_became_peered":"2023-12-19T16:17:22.142631+0000","last_unstale":"2023-12-19T16:17:23.134641+0000","last_undegraded":"2023-12-19T16:17:23.134641+0000","last_fullsized":"2023-12-19T16:17:23.134641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165928+0000","last_change":"2023-12-19T16:17:22.158179+0000","last_active":"2023-12-19T16:17:22.165928+0000","last_peered":"2023-12-19T16:17:22.165928+0000","last_clean":"2023-12-19T16:17:22.165928+0000","last_became_active":"2023-12-19T16:17:22.157886+0000","last_became_peered":"2023-12-19T16:17:22.157886+0000","last_unstale":"2023-12-19T16:17:22.165928+0000","last_undegraded":"2023-12-19T16:17:22.165928+0000","last_fullsized":"2023-12-19T16:17:22.165928+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:35.956464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156734+0000","last_change":"2023-12-19T16:17:22.151320+0000","last_active":"2023-12-19T16:17:22.156734+0000","last_peered":"2023-12-19T16:17:22.156734+0000","last_clean":"2023-12-19T16:17:22.156734+0000","last_became_active":"2023-12-19T16:17:22.150541+0000","last_became_peered":"2023-12-19T16:17:22.150541+0000","last_unstale":"2023-12-19T16:17:22.156734+0000","last_undegraded":"2023-12-19T16:17:22.156734+0000","last_fullsized":"2023-12-19T16:17:22.156734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:28.033745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155355+0000","last_change":"2023-12-19T16:17:22.149896+0000","last_active":"2023-12-19T16:17:22.155355+0000","last_peered":"2023-12-19T16:17:22.155355+0000","last_clean":"2023-12-19T16:17:22.155355+0000","last_became_active":"2023-12-19T16:17:22.149454+0000","last_became_peered":"2023-12-19T16:17:22.149454+0000","last_unstale":"2023-12-19T16:17:22.155355+0000","last_undegraded":"2023-12-19T16:17:22.155355+0000","last_fullsized":"2023-12-19T16:17:22.155355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:45.196163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161358+0000","last_change":"2023-12-19T16:17:21.757846+0000","last_active":"2023-12-19T16:17:22.161358+0000","last_peered":"2023-12-19T16:17:22.161358+0000","last_clean":"2023-12-19T16:17:22.161358+0000","last_became_active":"2023-12-19T16:17:21.757491+0000","last_became_peered":"2023-12-19T16:17:21.757491+0000","last_unstale":"2023-12-19T16:17:22.161358+0000","last_undegraded":"2023-12-19T16:17:22.161358+0000","last_fullsized":"2023-12-19T16:17:22.161358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161319+0000","last_change":"2023-12-19T16:17:22.158007+0000","last_active":"2023-12-19T16:17:22.161319+0000","last_peered":"2023-12-19T16:17:22.161319+0000","last_clean":"2023-12-19T16:17:22.161319+0000","last_became_active":"2023-12-19T16:17:22.157731+0000","last_became_peered":"2023-12-19T16:17:22.157731+0000","last_unstale":"2023-12-19T16:17:22.161319+0000","last_undegraded":"2023-12-19T16:17:22.161319+0000","last_fullsized":"2023-12-19T16:17:22.161319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151665+0000","last_change":"2023-12-19T16:17:21.755136+0000","last_active":"2023-12-19T16:17:22.151665+0000","last_peered":"2023-12-19T16:17:22.151665+0000","last_clean":"2023-12-19T16:17:22.151665+0000","last_became_active":"2023-12-19T16:17:21.754811+0000","last_became_peered":"2023-12-19T16:17:21.754811+0000","last_unstale":"2023-12-19T16:17:22.151665+0000","last_undegraded":"2023-12-19T16:17:22.151665+0000","last_fullsized":"2023-12-19T16:17:22.151665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:21.178496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134945+0000","last_change":"2023-12-19T16:17:22.151779+0000","last_active":"2023-12-19T16:17:23.134945+0000","last_peered":"2023-12-19T16:17:23.134945+0000","last_clean":"2023-12-19T16:17:23.134945+0000","last_became_active":"2023-12-19T16:17:22.151531+0000","last_became_peered":"2023-12-19T16:17:22.151531+0000","last_unstale":"2023-12-19T16:17:23.134945+0000","last_undegraded":"2023-12-19T16:17:23.134945+0000","last_fullsized":"2023-12-19T16:17:23.134945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157539+0000","last_change":"2023-12-19T16:17:21.756962+0000","last_active":"2023-12-19T16:17:22.157539+0000","last_peered":"2023-12-19T16:17:22.157539+0000","last_clean":"2023-12-19T16:17:22.157539+0000","last_became_active":"2023-12-19T16:17:21.756429+0000","last_became_peered":"2023-12-19T16:17:21.756429+0000","last_unstale":"2023-12-19T16:17:22.157539+0000","last_undegraded":"2023-12-19T16:17:22.157539+0000","last_fullsized":"2023-12-19T16:17:22.157539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156016+0000","last_change":"2023-12-19T16:17:22.151997+0000","last_active":"2023-12-19T16:17:22.156016+0000","last_peered":"2023-12-19T16:17:22.156016+0000","last_clean":"2023-12-19T16:17:22.156016+0000","last_became_active":"2023-12-19T16:17:22.151660+0000","last_became_peered":"2023-12-19T16:17:22.151660+0000","last_unstale":"2023-12-19T16:17:22.156016+0000","last_undegraded":"2023-12-19T16:17:22.156016+0000","last_fullsized":"2023-12-19T16:17:22.156016+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:08.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143903+0000","last_change":"2023-12-19T16:17:21.751163+0000","last_active":"2023-12-19T16:17:22.143903+0000","last_peered":"2023-12-19T16:17:22.143903+0000","last_clean":"2023-12-19T16:17:22.143903+0000","last_became_active":"2023-12-19T16:17:21.750841+0000","last_became_peered":"2023-12-19T16:17:21.750841+0000","last_unstale":"2023-12-19T16:17:22.143903+0000","last_undegraded":"2023-12-19T16:17:22.143903+0000","last_fullsized":"2023-12-19T16:17:22.143903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:13.969787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143497+0000","last_change":"2023-12-19T16:17:22.138939+0000","last_active":"2023-12-19T16:17:22.143497+0000","last_peered":"2023-12-19T16:17:22.143497+0000","last_clean":"2023-12-19T16:17:22.143497+0000","last_became_active":"2023-12-19T16:17:22.136474+0000","last_became_peered":"2023-12-19T16:17:22.136474+0000","last_unstale":"2023-12-19T16:17:22.143497+0000","last_undegraded":"2023-12-19T16:17:22.143497+0000","last_fullsized":"2023-12-19T16:17:22.143497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:10.979687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156965+0000","last_change":"2023-12-19T16:17:21.761909+0000","last_active":"2023-12-19T16:17:22.156965+0000","last_peered":"2023-12-19T16:17:22.156965+0000","last_clean":"2023-12-19T16:17:22.156965+0000","last_became_active":"2023-12-19T16:17:21.761644+0000","last_became_peered":"2023-12-19T16:17:21.761644+0000","last_unstale":"2023-12-19T16:17:22.156965+0000","last_undegraded":"2023-12-19T16:17:22.156965+0000","last_fullsized":"2023-12-19T16:17:22.156965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.154258+0000","last_change":"2023-12-19T16:17:21.752834+0000","last_active":"2023-12-19T16:17:22.154258+0000","last_peered":"2023-12-19T16:17:22.154258+0000","last_clean":"2023-12-19T16:17:22.154258+0000","last_became_active":"2023-12-19T16:17:21.751522+0000","last_became_peered":"2023-12-19T16:17:21.751522+0000","last_unstale":"2023-12-19T16:17:22.154258+0000","last_undegraded":"2023-12-19T16:17:22.154258+0000","last_fullsized":"2023-12-19T16:17:22.154258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:27.026260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137520+0000","last_change":"2023-12-19T16:17:21.757958+0000","last_active":"2023-12-19T16:17:22.137520+0000","last_peered":"2023-12-19T16:17:22.137520+0000","last_clean":"2023-12-19T16:17:22.137520+0000","last_became_active":"2023-12-19T16:17:21.757638+0000","last_became_peered":"2023-12-19T16:17:21.757638+0000","last_unstale":"2023-12-19T16:17:22.137520+0000","last_undegraded":"2023-12-19T16:17:22.137520+0000","last_fullsized":"2023-12-19T16:17:22.137520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151506+0000","last_change":"2023-12-19T16:17:22.146956+0000","last_active":"2023-12-19T16:17:22.151506+0000","last_peered":"2023-12-19T16:17:22.151506+0000","last_clean":"2023-12-19T16:17:22.151506+0000","last_became_active":"2023-12-19T16:17:22.146235+0000","last_became_peered":"2023-12-19T16:17:22.146235+0000","last_unstale":"2023-12-19T16:17:22.151506+0000","last_undegraded":"2023-12-19T16:17:22.151506+0000","last_fullsized":"2023-12-19T16:17:22.151506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:40.626111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140193+0000","last_change":"2023-12-19T16:17:22.136135+0000","last_active":"2023-12-19T16:17:22.140193+0000","last_peered":"2023-12-19T16:17:22.140193+0000","last_clean":"2023-12-19T16:17:22.140193+0000","last_became_active":"2023-12-19T16:17:22.135881+0000","last_became_peered":"2023-12-19T16:17:22.135881+0000","last_unstale":"2023-12-19T16:17:22.140193+0000","last_undegraded":"2023-12-19T16:17:22.140193+0000","last_fullsized":"2023-12-19T16:17:22.140193+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:46.895243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129442+0000","last_change":"2023-12-19T16:17:21.758331+0000","last_active":"2023-12-19T16:17:22.129442+0000","last_peered":"2023-12-19T16:17:22.129442+0000","last_clean":"2023-12-19T16:17:22.129442+0000","last_became_active":"2023-12-19T16:17:21.758062+0000","last_became_peered":"2023-12-19T16:17:21.758062+0000","last_unstale":"2023-12-19T16:17:22.129442+0000","last_undegraded":"2023-12-19T16:17:22.129442+0000","last_fullsized":"2023-12-19T16:17:22.129442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:56:16.429059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162960+0000","last_change":"2023-12-19T16:17:22.157415+0000","last_active":"2023-12-19T16:17:22.162960+0000","last_peered":"2023-12-19T16:17:22.162960+0000","last_clean":"2023-12-19T16:17:22.162960+0000","last_became_active":"2023-12-19T16:17:22.157175+0000","last_became_peered":"2023-12-19T16:17:22.157175+0000","last_unstale":"2023-12-19T16:17:22.162960+0000","last_undegraded":"2023-12-19T16:17:22.162960+0000","last_fullsized":"2023-12-19T16:17:22.162960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:35.693932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733700+0000","last_change":"2023-12-19T16:17:20.733700+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733700+0000","last_undegraded":"2023-12-19T16:17:20.733700+0000","last_fullsized":"2023-12-19T16:17:20.733700+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167325+0000","last_change":"2023-12-19T16:17:22.164149+0000","last_active":"2023-12-19T16:17:22.167325+0000","last_peered":"2023-12-19T16:17:22.167325+0000","last_clean":"2023-12-19T16:17:22.167325+0000","last_became_active":"2023-12-19T16:17:22.163873+0000","last_became_peered":"2023-12-19T16:17:22.163873+0000","last_unstale":"2023-12-19T16:17:22.167325+0000","last_undegraded":"2023-12-19T16:17:22.167325+0000","last_fullsized":"2023-12-19T16:17:22.167325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135051+0000","last_change":"2023-12-19T16:17:21.760196+0000","last_active":"2023-12-19T16:17:23.135051+0000","last_peered":"2023-12-19T16:17:23.135051+0000","last_clean":"2023-12-19T16:17:23.135051+0000","last_became_active":"2023-12-19T16:17:21.759918+0000","last_became_peered":"2023-12-19T16:17:21.759918+0000","last_unstale":"2023-12-19T16:17:23.135051+0000","last_undegraded":"2023-12-19T16:17:23.135051+0000","last_fullsized":"2023-12-19T16:17:23.135051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158619+0000","last_change":"2023-12-19T16:17:22.156495+0000","last_active":"2023-12-19T16:17:22.158619+0000","last_peered":"2023-12-19T16:17:22.158619+0000","last_clean":"2023-12-19T16:17:22.158619+0000","last_became_active":"2023-12-19T16:17:22.156228+0000","last_became_peered":"2023-12-19T16:17:22.156228+0000","last_unstale":"2023-12-19T16:17:22.158619+0000","last_undegraded":"2023-12-19T16:17:22.158619+0000","last_fullsized":"2023-12-19T16:17:22.158619+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:36.662860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733675+0000","last_change":"2023-12-19T16:17:20.733675+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733675+0000","last_undegraded":"2023-12-19T16:17:20.733675+0000","last_fullsized":"2023-12-19T16:17:20.733675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162919+0000","last_change":"2023-12-19T16:17:22.157237+0000","last_active":"2023-12-19T16:17:22.162919+0000","last_peered":"2023-12-19T16:17:22.162919+0000","last_clean":"2023-12-19T16:17:22.162919+0000","last_became_active":"2023-12-19T16:17:22.156973+0000","last_became_peered":"2023-12-19T16:17:22.156973+0000","last_unstale":"2023-12-19T16:17:22.162919+0000","last_undegraded":"2023-12-19T16:17:22.162919+0000","last_fullsized":"2023-12-19T16:17:22.162919+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:31.895567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157483+0000","last_change":"2023-12-19T16:17:21.761048+0000","last_active":"2023-12-19T16:17:22.157483+0000","last_peered":"2023-12-19T16:17:22.157483+0000","last_clean":"2023-12-19T16:17:22.157483+0000","last_became_active":"2023-12-19T16:17:21.758547+0000","last_became_peered":"2023-12-19T16:17:21.758547+0000","last_unstale":"2023-12-19T16:17:22.157483+0000","last_undegraded":"2023-12-19T16:17:22.157483+0000","last_fullsized":"2023-12-19T16:17:22.157483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:15.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149532+0000","last_change":"2023-12-19T16:17:22.141474+0000","last_active":"2023-12-19T16:17:22.149532+0000","last_peered":"2023-12-19T16:17:22.149532+0000","last_clean":"2023-12-19T16:17:22.149532+0000","last_became_active":"2023-12-19T16:17:22.141183+0000","last_became_peered":"2023-12-19T16:17:22.141183+0000","last_unstale":"2023-12-19T16:17:22.149532+0000","last_undegraded":"2023-12-19T16:17:22.149532+0000","last_fullsized":"2023-12-19T16:17:22.149532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:10.623748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137461+0000","last_change":"2023-12-19T16:17:21.743866+0000","last_active":"2023-12-19T16:17:22.137461+0000","last_peered":"2023-12-19T16:17:22.137461+0000","last_clean":"2023-12-19T16:17:22.137461+0000","last_became_active":"2023-12-19T16:17:21.743597+0000","last_became_peered":"2023-12-19T16:17:21.743597+0000","last_unstale":"2023-12-19T16:17:22.137461+0000","last_undegraded":"2023-12-19T16:17:22.137461+0000","last_fullsized":"2023-12-19T16:17:22.137461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155323+0000","last_change":"2023-12-19T16:17:22.149800+0000","last_active":"2023-12-19T16:17:22.155323+0000","last_peered":"2023-12-19T16:17:22.155323+0000","last_clean":"2023-12-19T16:17:22.155323+0000","last_became_active":"2023-12-19T16:17:22.149385+0000","last_became_peered":"2023-12-19T16:17:22.149385+0000","last_unstale":"2023-12-19T16:17:22.155323+0000","last_undegraded":"2023-12-19T16:17:22.155323+0000","last_fullsized":"2023-12-19T16:17:22.155323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:57.924303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.139919+0000","last_change":"2023-12-19T16:17:21.761964+0000","last_active":"2023-12-19T16:17:22.139919+0000","last_peered":"2023-12-19T16:17:22.139919+0000","last_clean":"2023-12-19T16:17:22.139919+0000","last_became_active":"2023-12-19T16:17:21.760304+0000","last_became_peered":"2023-12-19T16:17:21.760304+0000","last_unstale":"2023-12-19T16:17:22.139919+0000","last_undegraded":"2023-12-19T16:17:22.139919+0000","last_fullsized":"2023-12-19T16:17:22.139919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:44.188677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134631+0000","last_change":"2023-12-19T16:17:22.148063+0000","last_active":"2023-12-19T16:17:23.134631+0000","last_peered":"2023-12-19T16:17:23.134631+0000","last_clean":"2023-12-19T16:17:23.134631+0000","last_became_active":"2023-12-19T16:17:22.147442+0000","last_became_peered":"2023-12-19T16:17:22.147442+0000","last_unstale":"2023-12-19T16:17:23.134631+0000","last_undegraded":"2023-12-19T16:17:23.134631+0000","last_fullsized":"2023-12-19T16:17:23.134631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.735466+0000","last_change":"2023-12-19T16:17:20.735466+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.735466+0000","last_undegraded":"2023-12-19T16:17:20.735466+0000","last_fullsized":"2023-12-19T16:17:20.735466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149280+0000","last_change":"2023-12-19T16:17:22.140926+0000","last_active":"2023-12-19T16:17:22.149280+0000","last_peered":"2023-12-19T16:17:22.149280+0000","last_clean":"2023-12-19T16:17:22.149280+0000","last_became_active":"2023-12-19T16:17:22.140652+0000","last_became_peered":"2023-12-19T16:17:22.140652+0000","last_unstale":"2023-12-19T16:17:22.149280+0000","last_undegraded":"2023-12-19T16:17:22.149280+0000","last_fullsized":"2023-12-19T16:17:22.149280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:29.710944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166720+0000","last_change":"2023-12-19T16:17:21.761218+0000","last_active":"2023-12-19T16:17:22.166720+0000","last_peered":"2023-12-19T16:17:22.166720+0000","last_clean":"2023-12-19T16:17:22.166720+0000","last_became_active":"2023-12-19T16:17:21.760858+0000","last_became_peered":"2023-12-19T16:17:21.760858+0000","last_unstale":"2023-12-19T16:17:22.166720+0000","last_undegraded":"2023-12-19T16:17:22.166720+0000","last_fullsized":"2023-12-19T16:17:22.166720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.150861+0000","last_change":"2023-12-19T16:17:22.148334+0000","last_active":"2023-12-19T16:17:22.150861+0000","last_peered":"2023-12-19T16:17:22.150861+0000","last_clean":"2023-12-19T16:17:22.150861+0000","last_became_active":"2023-12-19T16:17:22.148036+0000","last_became_peered":"2023-12-19T16:17:22.148036+0000","last_unstale":"2023-12-19T16:17:22.150861+0000","last_undegraded":"2023-12-19T16:17:22.150861+0000","last_fullsized":"2023-12-19T16:17:22.150861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:57.733309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158973+0000","last_change":"2023-12-19T16:17:21.759281+0000","last_active":"2023-12-19T16:17:22.158973+0000","last_peered":"2023-12-19T16:17:22.158973+0000","last_clean":"2023-12-19T16:17:22.158973+0000","last_became_active":"2023-12-19T16:17:21.758854+0000","last_became_peered":"2023-12-19T16:17:21.758854+0000","last_unstale":"2023-12-19T16:17:22.158973+0000","last_undegraded":"2023-12-19T16:17:22.158973+0000","last_fullsized":"2023-12-19T16:17:22.158973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:43.061583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134967+0000","last_change":"2023-12-19T16:17:22.157996+0000","last_active":"2023-12-19T16:17:23.134967+0000","last_peered":"2023-12-19T16:17:23.134967+0000","last_clean":"2023-12-19T16:17:23.134967+0000","last_became_active":"2023-12-19T16:17:22.157742+0000","last_became_peered":"2023-12-19T16:17:22.157742+0000","last_unstale":"2023-12-19T16:17:23.134967+0000","last_undegraded":"2023-12-19T16:17:23.134967+0000","last_fullsized":"2023-12-19T16:17:23.134967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165864+0000","last_change":"2023-12-19T16:17:21.755379+0000","last_active":"2023-12-19T16:17:22.165864+0000","last_peered":"2023-12-19T16:17:22.165864+0000","last_clean":"2023-12-19T16:17:22.165864+0000","last_became_active":"2023-12-19T16:17:21.754564+0000","last_became_peered":"2023-12-19T16:17:21.754564+0000","last_unstale":"2023-12-19T16:17:22.165864+0000","last_undegraded":"2023-12-19T16:17:22.165864+0000","last_fullsized":"2023-12-19T16:17:22.165864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:11.726871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149876+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.149876+0000","last_peered":"2023-12-19T16:17:22.149876+0000","last_clean":"2023-12-19T16:17:22.149876+0000","last_became_active":"2023-12-19T16:17:22.148868+0000","last_became_peered":"2023-12-19T16:17:22.148868+0000","last_unstale":"2023-12-19T16:17:22.149876+0000","last_undegraded":"2023-12-19T16:17:22.149876+0000","last_fullsized":"2023-12-19T16:17:22.149876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:14.946456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140783+0000","last_change":"2023-12-19T16:17:21.763539+0000","last_active":"2023-12-19T16:17:22.140783+0000","last_peered":"2023-12-19T16:17:22.140783+0000","last_clean":"2023-12-19T16:17:22.140783+0000","last_became_active":"2023-12-19T16:17:21.763131+0000","last_became_peered":"2023-12-19T16:17:21.763131+0000","last_unstale":"2023-12-19T16:17:22.140783+0000","last_undegraded":"2023-12-19T16:17:22.140783+0000","last_fullsized":"2023-12-19T16:17:22.140783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:56.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161993+0000","last_change":"2023-12-19T16:17:22.157501+0000","last_active":"2023-12-19T16:17:22.161993+0000","last_peered":"2023-12-19T16:17:22.161993+0000","last_clean":"2023-12-19T16:17:22.161993+0000","last_became_active":"2023-12-19T16:17:22.157209+0000","last_became_peered":"2023-12-19T16:17:22.157209+0000","last_unstale":"2023-12-19T16:17:22.161993+0000","last_undegraded":"2023-12-19T16:17:22.161993+0000","last_fullsized":"2023-12-19T16:17:22.161993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:22.093772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137345+0000","last_change":"2023-12-19T16:17:21.751942+0000","last_active":"2023-12-19T16:17:22.137345+0000","last_peered":"2023-12-19T16:17:22.137345+0000","last_clean":"2023-12-19T16:17:22.137345+0000","last_became_active":"2023-12-19T16:17:21.751600+0000","last_became_peered":"2023-12-19T16:17:21.751600+0000","last_unstale":"2023-12-19T16:17:22.137345+0000","last_undegraded":"2023-12-19T16:17:22.137345+0000","last_fullsized":"2023-12-19T16:17:22.137345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:47.234683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156753+0000","last_change":"2023-12-19T16:17:22.152347+0000","last_active":"2023-12-19T16:17:22.156753+0000","last_peered":"2023-12-19T16:17:22.156753+0000","last_clean":"2023-12-19T16:17:22.156753+0000","last_became_active":"2023-12-19T16:17:22.151834+0000","last_became_peered":"2023-12-19T16:17:22.151834+0000","last_unstale":"2023-12-19T16:17:22.156753+0000","last_undegraded":"2023-12-19T16:17:22.156753+0000","last_fullsized":"2023-12-19T16:17:22.156753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733673+0000","last_change":"2023-12-19T16:17:20.733673+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733673+0000","last_undegraded":"2023-12-19T16:17:20.733673+0000","last_fullsized":"2023-12-19T16:17:20.733673+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155943+0000","last_change":"2023-12-19T16:17:22.151111+0000","last_active":"2023-12-19T16:17:22.155943+0000","last_peered":"2023-12-19T16:17:22.155943+0000","last_clean":"2023-12-19T16:17:22.155943+0000","last_became_active":"2023-12-19T16:17:22.150803+0000","last_became_peered":"2023-12-19T16:17:22.150803+0000","last_unstale":"2023-12-19T16:17:22.155943+0000","last_undegraded":"2023-12-19T16:17:22.155943+0000","last_fullsized":"2023-12-19T16:17:22.155943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127328+0000","last_change":"2023-12-19T16:17:21.756215+0000","last_active":"2023-12-19T16:17:22.127328+0000","last_peered":"2023-12-19T16:17:22.127328+0000","last_clean":"2023-12-19T16:17:22.127328+0000","last_became_active":"2023-12-19T16:17:21.755911+0000","last_became_peered":"2023-12-19T16:17:21.755911+0000","last_unstale":"2023-12-19T16:17:22.127328+0000","last_undegraded":"2023-12-19T16:17:22.127328+0000","last_fullsized":"2023-12-19T16:17:22.127328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:40.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158663+0000","last_change":"2023-12-19T16:17:22.156498+0000","last_active":"2023-12-19T16:17:22.158663+0000","last_peered":"2023-12-19T16:17:22.158663+0000","last_clean":"2023-12-19T16:17:22.158663+0000","last_became_active":"2023-12-19T16:17:22.156255+0000","last_became_peered":"2023-12-19T16:17:22.156255+0000","last_unstale":"2023-12-19T16:17:22.158663+0000","last_undegraded":"2023-12-19T16:17:22.158663+0000","last_fullsized":"2023-12-19T16:17:22.158663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:06.241133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156451+0000","last_change":"2023-12-19T16:17:21.758755+0000","last_active":"2023-12-19T16:17:22.156451+0000","last_peered":"2023-12-19T16:17:22.156451+0000","last_clean":"2023-12-19T16:17:22.156451+0000","last_became_active":"2023-12-19T16:17:21.758489+0000","last_became_peered":"2023-12-19T16:17:21.758489+0000","last_unstale":"2023-12-19T16:17:22.156451+0000","last_undegraded":"2023-12-19T16:17:22.156451+0000","last_fullsized":"2023-12-19T16:17:22.156451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141669+0000","last_change":"2023-12-19T16:17:21.756779+0000","last_active":"2023-12-19T16:17:22.141669+0000","last_peered":"2023-12-19T16:17:22.141669+0000","last_clean":"2023-12-19T16:17:22.141669+0000","last_became_active":"2023-12-19T16:17:21.756421+0000","last_became_peered":"2023-12-19T16:17:21.756421+0000","last_unstale":"2023-12-19T16:17:22.141669+0000","last_undegraded":"2023-12-19T16:17:22.141669+0000","last_fullsized":"2023-12-19T16:17:22.141669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158640+0000","last_change":"2023-12-19T16:17:22.156581+0000","last_active":"2023-12-19T16:17:22.158640+0000","last_peered":"2023-12-19T16:17:22.158640+0000","last_clean":"2023-12-19T16:17:22.158640+0000","last_became_active":"2023-12-19T16:17:22.156314+0000","last_became_peered":"2023-12-19T16:17:22.156314+0000","last_unstale":"2023-12-19T16:17:22.158640+0000","last_undegraded":"2023-12-19T16:17:22.158640+0000","last_fullsized":"2023-12-19T16:17:22.158640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:47.136357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129951+0000","last_change":"2023-12-19T16:17:21.759011+0000","last_active":"2023-12-19T16:17:22.129951+0000","last_peered":"2023-12-19T16:17:22.129951+0000","last_clean":"2023-12-19T16:17:22.129951+0000","last_became_active":"2023-12-19T16:17:21.758694+0000","last_became_peered":"2023-12-19T16:17:21.758694+0000","last_unstale":"2023-12-19T16:17:22.129951+0000","last_undegraded":"2023-12-19T16:17:22.129951+0000","last_fullsized":"2023-12-19T16:17:22.129951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:32.774324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140708+0000","last_change":"2023-12-19T16:17:21.758295+0000","last_active":"2023-12-19T16:17:22.140708+0000","last_peered":"2023-12-19T16:17:22.140708+0000","last_clean":"2023-12-19T16:17:22.140708+0000","last_became_active":"2023-12-19T16:17:21.758035+0000","last_became_peered":"2023-12-19T16:17:21.758035+0000","last_unstale":"2023-12-19T16:17:22.140708+0000","last_undegraded":"2023-12-19T16:17:22.140708+0000","last_fullsized":"2023-12-19T16:17:22.140708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:59.521708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156076+0000","last_change":"2023-12-19T16:17:22.151966+0000","last_active":"2023-12-19T16:17:22.156076+0000","last_peered":"2023-12-19T16:17:22.156076+0000","last_clean":"2023-12-19T16:17:22.156076+0000","last_became_active":"2023-12-19T16:17:22.150479+0000","last_became_peered":"2023-12-19T16:17:22.150479+0000","last_unstale":"2023-12-19T16:17:22.156076+0000","last_undegraded":"2023-12-19T16:17:22.156076+0000","last_fullsized":"2023-12-19T16:17:22.156076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:25.579064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127836+0000","last_change":"2023-12-19T16:17:21.753501+0000","last_active":"2023-12-19T16:17:22.127836+0000","last_peered":"2023-12-19T16:17:22.127836+0000","last_clean":"2023-12-19T16:17:22.127836+0000","last_became_active":"2023-12-19T16:17:21.753228+0000","last_became_peered":"2023-12-19T16:17:21.753228+0000","last_unstale":"2023-12-19T16:17:22.127836+0000","last_undegraded":"2023-12-19T16:17:22.127836+0000","last_fullsized":"2023-12-19T16:17:22.127836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:16.857037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162995+0000","last_change":"2023-12-19T16:17:22.158201+0000","last_active":"2023-12-19T16:17:22.162995+0000","last_peered":"2023-12-19T16:17:22.162995+0000","last_clean":"2023-12-19T16:17:22.162995+0000","last_became_active":"2023-12-19T16:17:22.155301+0000","last_became_peered":"2023-12-19T16:17:22.155301+0000","last_unstale":"2023-12-19T16:17:22.162995+0000","last_undegraded":"2023-12-19T16:17:22.162995+0000","last_fullsized":"2023-12-19T16:17:22.162995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:34.957262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140060+0000","last_change":"2023-12-19T16:17:21.755941+0000","last_active":"2023-12-19T16:17:22.140060+0000","last_peered":"2023-12-19T16:17:22.140060+0000","last_clean":"2023-12-19T16:17:22.140060+0000","last_became_active":"2023-12-19T16:17:21.755557+0000","last_became_peered":"2023-12-19T16:17:21.755557+0000","last_unstale":"2023-12-19T16:17:22.140060+0000","last_undegraded":"2023-12-19T16:17:22.140060+0000","last_fullsized":"2023-12-19T16:17:22.140060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:56.916818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134632+0000","last_change":"2023-12-19T16:17:22.141268+0000","last_active":"2023-12-19T16:17:23.134632+0000","last_peered":"2023-12-19T16:17:23.134632+0000","last_clean":"2023-12-19T16:17:23.134632+0000","last_became_active":"2023-12-19T16:17:22.140999+0000","last_became_peered":"2023-12-19T16:17:22.140999+0000","last_unstale":"2023-12-19T16:17:23.134632+0000","last_undegraded":"2023-12-19T16:17:23.134632+0000","last_fullsized":"2023-12-19T16:17:23.134632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129706+0000","last_change":"2023-12-19T16:17:21.749542+0000","last_active":"2023-12-19T16:17:22.129706+0000","last_peered":"2023-12-19T16:17:22.129706+0000","last_clean":"2023-12-19T16:17:22.129706+0000","last_became_active":"2023-12-19T16:17:21.749270+0000","last_became_peered":"2023-12-19T16:17:21.749270+0000","last_unstale":"2023-12-19T16:17:22.129706+0000","last_undegraded":"2023-12-19T16:17:22.129706+0000","last_fullsized":"2023-12-19T16:17:22.129706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:30.862265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166669+0000","last_change":"2023-12-19T16:17:22.159978+0000","last_active":"2023-12-19T16:17:22.166669+0000","last_peered":"2023-12-19T16:17:22.166669+0000","last_clean":"2023-12-19T16:17:22.166669+0000","last_became_active":"2023-12-19T16:17:22.159594+0000","last_became_peered":"2023-12-19T16:17:22.159594+0000","last_unstale":"2023-12-19T16:17:22.166669+0000","last_undegraded":"2023-12-19T16:17:22.166669+0000","last_fullsized":"2023-12-19T16:17:22.166669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:14.977272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151286+0000","last_change":"2023-12-19T16:17:21.757859+0000","last_active":"2023-12-19T16:17:22.151286+0000","last_peered":"2023-12-19T16:17:22.151286+0000","last_clean":"2023-12-19T16:17:22.151286+0000","last_became_active":"2023-12-19T16:17:21.757542+0000","last_became_peered":"2023-12-19T16:17:21.757542+0000","last_unstale":"2023-12-19T16:17:22.151286+0000","last_undegraded":"2023-12-19T16:17:22.151286+0000","last_fullsized":"2023-12-19T16:17:22.151286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:07.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T16:17:21.742544+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:17:21.742544+0000","last_peered":"2023-12-19T16:17:21.742544+0000","last_clean":"2023-12-19T16:17:21.742544+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:17:21.742544+0000","last_undegraded":"2023-12-19T16:17:21.742544+0000","last_fullsized":"2023-12-19T16:17:21.742544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476763,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":242672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.071}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.97099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476763,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":241198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.32400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.496}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.622},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.70299999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476763,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":831546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.624},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":241780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.435},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.54600000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.62}]}]},{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.68100000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.629}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.72999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":577536,"data_stored":234333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1171456,"data_stored":824701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.435}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50700000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.501},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-12-19T16:17:26.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-12-19T16:17:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-12-19T16:17:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.733663+0000', 'last_change': '2023-12-19T16:17:20.733663+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.733663+0000', 'last_undegraded': '2023-12-19T16:17:20.733663+0000', 'last_fullsized': '2023-12-19T16:17:20.733663+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-12-19T16:17:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.733700+0000', 'last_change': '2023-12-19T16:17:20.733700+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.733700+0000', 'last_undegraded': '2023-12-19T16:17:20.733700+0000', 'last_fullsized': '2023-12-19T16:17:20.733700+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-12-19T16:17:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.733675+0000', 'last_change': '2023-12-19T16:17:20.733675+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.733675+0000', 'last_undegraded': '2023-12-19T16:17:20.733675+0000', 'last_fullsized': '2023-12-19T16:17:20.733675+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-12-19T16:17:26.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.735466+0000', 'last_change': '2023-12-19T16:17:20.735466+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.735466+0000', 'last_undegraded': '2023-12-19T16:17:20.735466+0000', 'last_fullsized': '2023-12-19T16:17:20.735466+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.733663+0000', 'last_change': '2023-12-19T16:17:20.733663+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.733663+0000', 'last_undegraded': '2023-12-19T16:17:20.733663+0000', 'last_fullsized': '2023-12-19T16:17:20.733663+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-12-19T16:17:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 49, 'state': 'creating+peering', 'last_fresh': '2023-12-19T16:17:20.733673+0000', 'last_change': '2023-12-19T16:17:20.733673+0000', 'last_active': '2023-12-19T16:17:20.718859+0000', 'last_peered': '2023-12-19T16:17:20.718859+0000', 'last_clean': '2023-12-19T16:17:20.718859+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:20.733673+0000', 'last_undegraded': '2023-12-19T16:17:20.733673+0000', 'last_fullsized': '2023-12-19T16:17:20.733673+0000', 'mapping_epoch': 49, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 49, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:20.718859+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T16:17:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-12-19T16:17:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-12-19T16:17:26.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T16:17:21.726345+0000', 'last_change': '2023-12-19T16:17:21.726345+0000', 'last_active': '2023-12-19T16:17:21.726345+0000', 'last_peered': '2023-12-19T16:17:21.726345+0000', 'last_clean': '2023-12-19T16:17:21.726345+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T16:17:21.726345+0000', 'last_undegraded': '2023-12-19T16:17:21.726345+0000', 'last_fullsized': '2023-12-19T16:17:21.726345+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'last_clean_scrub_stamp': '2023-12-19T16:17:21.726345+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T16:17:26.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T16:17:27.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.110+0000 7fe01416d640 1 Processor -- start 2023-12-19T16:17:27.122 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.110+0000 7fe01416d640 1 -- start start 2023-12-19T16:17:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c143080 0x7fe00c0c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe00c143460 0x7fe00c0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.123 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe00c0b0de0 0x7fe00c15d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0b1270 con 0x7fe00c0b0de0 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe00c0710b0 con 0x7fe00c143460 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01416d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c5210 con 0x7fe00c143080 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe00c0b0de0 0x7fe00c15d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe00c0b0de0 0x7fe00c15d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36648/0 (socket says 172.21.15.73:36648) 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 -- 172.21.15.73:0/32064547 learned_addr learned my addr 172.21.15.73:0/32064547 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe011708640 1 --2- 172.21.15.73:0/32064547 >> v2:172.21.15.162:3300/0 conn(0x7fe00c143460 0x7fe00c0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe011f09640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c143080 0x7fe00c0c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 -- 172.21.15.73:0/32064547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c143080 msgr2=0x7fe00c0c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c143080 0x7fe00c0c4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 -- 172.21.15.73:0/32064547 >> v2:172.21.15.162:3300/0 conn(0x7fe00c143460 msgr2=0x7fe00c0b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 --2- 172.21.15.73:0/32064547 >> v2:172.21.15.162:3300/0 conn(0x7fe00c143460 0x7fe00c0b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.124 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.114+0000 7fe01270a640 1 -- 172.21.15.73:0/32064547 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0704a0 con 0x7fe00c0b0de0 2023-12-19T16:17:27.125 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01270a640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c0b0de0 0x7fe00c15d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe00c06fce0 tx=0x7fe00401c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9443777d61df073 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe010f07640 1 -- 172.21.15.73:0/32064547 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a64e0 con 0x7fe00c0b0de0 2023-12-19T16:17:27.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe010f07640 1 -- 172.21.15.73:0/32064547 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0040a6640 con 0x7fe00c0b0de0 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe010f07640 1 -- 172.21.15.73:0/32064547 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a69d0 con 0x7fe00c0b0de0 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- 172.21.15.73:0/32064547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c0b0de0 msgr2=0x7fe00c15d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c0b0de0 0x7fe00c15d3f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe00c06fce0 tx=0x7fe00401c650 comp rx=0 tx=0).stop 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- 172.21.15.73:0/32064547 shutdown_connections 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c0b0de0 0x7fe00c15d3f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 --2- 172.21.15.73:0/32064547 >> v2:172.21.15.162:3300/0 conn(0x7fe00c143460 0x7fe00c0b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 --2- 172.21.15.73:0/32064547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c143080 0x7fe00c0c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- 172.21.15.73:0/32064547 >> 172.21.15.73:0/32064547 conn(0x7fe00c0cb130 msgr2=0x7fe00c0cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- 172.21.15.73:0/32064547 shutdown_connections 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- 172.21.15.73:0/32064547 wait complete. 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 Processor -- start 2023-12-19T16:17:27.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.118+0000 7fe01416d640 1 -- start start 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 0x7fe00c15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 0x7fe00c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c6530 con 0x7fe00c143460 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c13b800 con 0x7fe00c143080 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c0c58b0 con 0x7fe00c0b0de0 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36662/0 (socket says 172.21.15.73:36662) 2023-12-19T16:17:27.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 -- 172.21.15.73:0/425391984 learned_addr learned my addr 172.21.15.73:0/425391984 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe011f09640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 0x7fe00c15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe011708640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 0x7fe00c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 -- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 msgr2=0x7fe00c15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 0x7fe00c15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 -- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 msgr2=0x7fe00c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 0x7fe00c15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 -- 172.21.15.73:0/425391984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe004009b30 con 0x7fe00c143460 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe011f09640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 0x7fe00c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe011708640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 0x7fe00c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01270a640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe00401ad00 tx=0x7fe0040193f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040b4070 con 0x7fe00c143460 2023-12-19T16:17:27.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004009150 con 0x7fe00c143460 2023-12-19T16:17:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040a69d0 con 0x7fe00c143460 2023-12-19T16:17:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c0c5b90 con 0x7fe00c143460 2023-12-19T16:17:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c0c6150 con 0x7fe00c143460 2023-12-19T16:17:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c0c6670 con 0x7fe00c143460 2023-12-19T16:17:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.122+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0040b8070 con 0x7fe00c143460 2023-12-19T16:17:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.126+0000 7fe0027fc640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 0x7fdff0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.126+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0040aa070 con 0x7fe00c143460 2023-12-19T16:17:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.126+0000 7fe011f09640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 0x7fdff0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.126+0000 7fe011f09640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 0x7fdff0067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe008007a70 tx=0x7fe008008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.136 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.130+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe00c0c6670 con 0x7fe00c143460 2023-12-19T16:17:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.330+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe00c0c6670 con 0x7fe00c143460 2023-12-19T16:17:27.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe0027fc640 1 -- 172.21.15.73:0/425391984 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1722 (secure 0 0 0) 0x7fe00c0c6670 con 0x7fe00c143460 2023-12-19T16:17:27.340 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:27.340 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":131,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1703002527,"num_in_osds":8,"osd_in_since":1703002518,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":84},{"state_name":"unknown","count":7},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591166,"bytes_used":230846464,"bytes_avail":772863266816,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":1961,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":30,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-19T16:16:30.457445+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 msgr2=0x7fdff0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 0x7fdff0067f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe008007a70 tx=0x7fe008008040 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 msgr2=0x7fe00c13b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe00401ad00 tx=0x7fe0040193f0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 shutdown_connections 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fdff0065a60 0x7fdff0067f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe00c143460 0x7fe00c13b2c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe00c143080 0x7fe00c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 --2- 172.21.15.73:0/425391984 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe00c0b0de0 0x7fe00c15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 >> 172.21.15.73:0/425391984 conn(0x7fe00c0cb130 msgr2=0x7fe00c0c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 shutdown_connections 2023-12-19T16:17:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.334+0000 7fe01416d640 1 -- 172.21.15.73:0/425391984 wait complete. 2023-12-19T16:17:27.360 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T16:17:27.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.490+0000 7f9b6eed1640 1 Processor -- start 2023-12-19T16:17:27.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.490+0000 7f9b6eed1640 1 -- start start 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b680cdc40 0x7f9b6815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 0x7f9b680ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6815ad00 con 0x7f9b68159830 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6815e110 con 0x7f9b680cdc40 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680ce2d0 con 0x7f9b680b40b0 2023-12-19T16:17:27.500 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6cc6d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b68159830 0x7f9b680cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41440/0 (socket says 172.21.15.73:41440) 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6cc6d640 1 -- 172.21.15.73:0/2213090495 learned_addr learned my addr 172.21.15.73:0/2213090495 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2213090495 >> v2:172.21.15.73:3300/0 conn(0x7f9b680cdc40 0x7f9b6815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6d46e640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 0x7f9b680ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2213090495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 msgr2=0x7f9b680ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5f7fe640 1 -- 172.21.15.73:0/2213090495 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214345918 0 0) 0x7f9b6815ad00 con 0x7f9b68159830 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 0x7f9b680ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2213090495 >> v1:172.21.15.73:6789/0 conn(0x7f9b68159830 legacy=0x7f9b680cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2213090495 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6815d490 con 0x7f9b680cdc40 2023-12-19T16:17:27.501 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6d46e640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 0x7f9b680ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b6815a7c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097c0 tx=0x7f9b5801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17173be8905fa40b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.503 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5f7fe640 1 -- 172.21.15.73:0/2213090495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580ac620 con 0x7f9b680cdc40 2023-12-19T16:17:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5f7fe640 1 -- 172.21.15.73:0/2213090495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580ac780 con 0x7f9b680cdc40 2023-12-19T16:17:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b5f7fe640 1 -- 172.21.15.73:0/2213090495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580acb10 con 0x7f9b680cdc40 2023-12-19T16:17:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2213090495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 msgr2=0x7f9b6815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.504 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b6815a7c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097c0 tx=0x7f9b5801c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2213090495 shutdown_connections 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b680b40b0 0x7f9b680ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2213090495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b6815a7c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2213090495 >> 172.21.15.73:0/2213090495 conn(0x7f9b680b0270 msgr2=0x7f9b680b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2213090495 shutdown_connections 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2213090495 wait complete. 2023-12-19T16:17:27.505 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 Processor -- start 2023-12-19T16:17:27.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- start start 2023-12-19T16:17:27.507 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b680b40b0 0x7f9b680c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b68159830 0x7f9b681534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b68154070 con 0x7f9b680cdc40 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680c2950 con 0x7f9b680b40b0 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.498+0000 7f9b6eed1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b680c2c30 con 0x7f9b68159830 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36676/0 (socket says 172.21.15.73:36676) 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2645706977 learned_addr learned my addr 172.21.15.73:0/2645706977 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b6cc6d640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b680b40b0 0x7f9b680c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b6d46e640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b68159830 0x7f9b681534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b68159830 msgr2=0x7f9b681534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b68159830 0x7f9b681534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b680b40b0 msgr2=0x7f9b680c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.508 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b680b40b0 0x7f9b680c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 -- 172.21.15.73:0/2645706977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b58009420 con 0x7f9b680cdc40 2023-12-19T16:17:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5ffff640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9b580af040 tx=0x7f9b5801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.509 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580b8650 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b580b87d0 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b680c2f10 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b580b8b80 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b680c34d0 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b68074050 con 0x7f9b680cdc40 2023-12-19T16:17:27.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.502+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b580aa070 con 0x7f9b680cdc40 2023-12-19T16:17:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.506+0000 7f9b5d7fa640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 0x7f9b54067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:27.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.506+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b5811da10 con 0x7f9b680cdc40 2023-12-19T16:17:27.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.506+0000 7f9b6cc6d640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 0x7f9b54067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:27.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.506+0000 7f9b6cc6d640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 0x7f9b54067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b64000f70 tx=0x7f9b64007c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:27.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.510+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b580eb3b0 con 0x7f9b680cdc40 2023-12-19T16:17:27.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.654+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b680c2da0 con 0x7f9b54065a60 2023-12-19T16:17:27.668 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.662+0000 7f9b5d7fa640 1 -- 172.21.15.73:0/2645706977 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288071 (secure 0 0 0) 0x7f9b680c2da0 con 0x7f9b54065a60 2023-12-19T16:17:27.671 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:27.673 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:17:27.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 msgr2=0x7f9b54067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 0x7f9b54067f20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b64000f70 tx=0x7f9b64007c90 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 msgr2=0x7f9b680c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9b580af040 tx=0x7f9b5801ac00 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 shutdown_connections 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9b68159830 0x7f9b681534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9b54065a60 0x7f9b54067f20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b680cdc40 0x7f9b680c2270 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 --2- 172.21.15.73:0/2645706977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b680b40b0 0x7f9b680c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 >> 172.21.15.73:0/2645706977 conn(0x7f9b680b0270 msgr2=0x7f9b6815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 shutdown_connections 2023-12-19T16:17:27.675 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:27.666+0000 7f9b6eed1640 1 -- 172.21.15.73:0/2645706977 wait complete. 2023-12-19T16:17:27.692 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T16:17:26.469798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225436,"kb_used_data":5724,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749284,"statfs":{"total":773094113280,"available":772863266816,"internally_reserved":0,"allocated":5861376,"data_stored":3072346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.742766"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160155+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160155+0000","last_peered":"2023-12-19T16:17:22.160155+0000","last_clean":"2023-12-19T16:17:22.160155+0000","last_became_active":"2023-12-19T16:17:22.155094+0000","last_became_peered":"2023-12-19T16:17:22.155094+0000","last_unstale":"2023-12-19T16:17:22.160155+0000","last_undegraded":"2023-12-19T16:17:22.160155+0000","last_fullsized":"2023-12-19T16:17:22.160155+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135072+0000","last_change":"2023-12-19T16:17:22.151796+0000","last_active":"2023-12-19T16:17:23.135072+0000","last_peered":"2023-12-19T16:17:23.135072+0000","last_clean":"2023-12-19T16:17:23.135072+0000","last_became_active":"2023-12-19T16:17:22.151376+0000","last_became_peered":"2023-12-19T16:17:22.151376+0000","last_unstale":"2023-12-19T16:17:23.135072+0000","last_undegraded":"2023-12-19T16:17:23.135072+0000","last_fullsized":"2023-12-19T16:17:23.135072+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.152979+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.152979+0000","last_peered":"2023-12-19T16:17:22.152979+0000","last_clean":"2023-12-19T16:17:22.152979+0000","last_became_active":"2023-12-19T16:17:22.148854+0000","last_became_peered":"2023-12-19T16:17:22.148854+0000","last_unstale":"2023-12-19T16:17:22.152979+0000","last_undegraded":"2023-12-19T16:17:22.152979+0000","last_fullsized":"2023-12-19T16:17:22.152979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:36.076596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160354+0000","last_change":"2023-12-19T16:17:22.153271+0000","last_active":"2023-12-19T16:17:22.160354+0000","last_peered":"2023-12-19T16:17:22.160354+0000","last_clean":"2023-12-19T16:17:22.160354+0000","last_became_active":"2023-12-19T16:17:22.152741+0000","last_became_peered":"2023-12-19T16:17:22.152741+0000","last_unstale":"2023-12-19T16:17:22.160354+0000","last_undegraded":"2023-12-19T16:17:22.160354+0000","last_fullsized":"2023-12-19T16:17:22.160354+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:22.185982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153900+0000","last_change":"2023-12-19T16:17:22.146150+0000","last_active":"2023-12-19T16:17:22.153900+0000","last_peered":"2023-12-19T16:17:22.153900+0000","last_clean":"2023-12-19T16:17:22.153900+0000","last_became_active":"2023-12-19T16:17:22.145911+0000","last_became_peered":"2023-12-19T16:17:22.145911+0000","last_unstale":"2023-12-19T16:17:22.153900+0000","last_undegraded":"2023-12-19T16:17:22.153900+0000","last_fullsized":"2023-12-19T16:17:22.153900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166513+0000","last_change":"2023-12-19T16:17:22.159277+0000","last_active":"2023-12-19T16:17:22.166513+0000","last_peered":"2023-12-19T16:17:22.166513+0000","last_clean":"2023-12-19T16:17:22.166513+0000","last_became_active":"2023-12-19T16:17:22.157136+0000","last_became_peered":"2023-12-19T16:17:22.157136+0000","last_unstale":"2023-12-19T16:17:22.166513+0000","last_undegraded":"2023-12-19T16:17:22.166513+0000","last_fullsized":"2023-12-19T16:17:22.166513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.978621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158401+0000","last_change":"2023-12-19T16:17:22.152378+0000","last_active":"2023-12-19T16:17:22.158401+0000","last_peered":"2023-12-19T16:17:22.158401+0000","last_clean":"2023-12-19T16:17:22.158401+0000","last_became_active":"2023-12-19T16:17:22.152125+0000","last_became_peered":"2023-12-19T16:17:22.152125+0000","last_unstale":"2023-12-19T16:17:22.158401+0000","last_undegraded":"2023-12-19T16:17:22.158401+0000","last_fullsized":"2023-12-19T16:17:22.158401+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:57:59.015795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166868+0000","last_change":"2023-12-19T16:17:22.161522+0000","last_active":"2023-12-19T16:17:22.166868+0000","last_peered":"2023-12-19T16:17:22.166868+0000","last_clean":"2023-12-19T16:17:22.166868+0000","last_became_active":"2023-12-19T16:17:22.161247+0000","last_became_peered":"2023-12-19T16:17:22.161247+0000","last_unstale":"2023-12-19T16:17:22.166868+0000","last_undegraded":"2023-12-19T16:17:22.166868+0000","last_fullsized":"2023-12-19T16:17:22.166868+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:49.572099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167337+0000","last_change":"2023-12-19T16:17:22.164109+0000","last_active":"2023-12-19T16:17:22.167337+0000","last_peered":"2023-12-19T16:17:22.167337+0000","last_clean":"2023-12-19T16:17:22.167337+0000","last_became_active":"2023-12-19T16:17:22.163818+0000","last_became_peered":"2023-12-19T16:17:22.163818+0000","last_unstale":"2023-12-19T16:17:22.167337+0000","last_undegraded":"2023-12-19T16:17:22.167337+0000","last_fullsized":"2023-12-19T16:17:22.167337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167027+0000","last_change":"2023-12-19T16:17:22.162318+0000","last_active":"2023-12-19T16:17:22.167027+0000","last_peered":"2023-12-19T16:17:22.167027+0000","last_clean":"2023-12-19T16:17:22.167027+0000","last_became_active":"2023-12-19T16:17:22.161961+0000","last_became_peered":"2023-12-19T16:17:22.161961+0000","last_unstale":"2023-12-19T16:17:22.167027+0000","last_undegraded":"2023-12-19T16:17:22.167027+0000","last_fullsized":"2023-12-19T16:17:22.167027+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:17.864523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134881+0000","last_change":"2023-12-19T16:17:22.147920+0000","last_active":"2023-12-19T16:17:23.134881+0000","last_peered":"2023-12-19T16:17:23.134881+0000","last_clean":"2023-12-19T16:17:23.134881+0000","last_became_active":"2023-12-19T16:17:22.147715+0000","last_became_peered":"2023-12-19T16:17:22.147715+0000","last_unstale":"2023-12-19T16:17:23.134881+0000","last_undegraded":"2023-12-19T16:17:23.134881+0000","last_fullsized":"2023-12-19T16:17:23.134881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161975+0000","last_change":"2023-12-19T16:17:22.157376+0000","last_active":"2023-12-19T16:17:22.161975+0000","last_peered":"2023-12-19T16:17:22.161975+0000","last_clean":"2023-12-19T16:17:22.161975+0000","last_became_active":"2023-12-19T16:17:22.157066+0000","last_became_peered":"2023-12-19T16:17:22.157066+0000","last_unstale":"2023-12-19T16:17:22.161975+0000","last_undegraded":"2023-12-19T16:17:22.161975+0000","last_fullsized":"2023-12-19T16:17:22.161975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167226+0000","last_change":"2023-12-19T16:17:22.163715+0000","last_active":"2023-12-19T16:17:22.167226+0000","last_peered":"2023-12-19T16:17:22.167226+0000","last_clean":"2023-12-19T16:17:22.167226+0000","last_became_active":"2023-12-19T16:17:22.163411+0000","last_became_peered":"2023-12-19T16:17:22.163411+0000","last_unstale":"2023-12-19T16:17:22.167226+0000","last_undegraded":"2023-12-19T16:17:22.167226+0000","last_fullsized":"2023-12-19T16:17:22.167226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:41.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160945+0000","last_change":"2023-12-19T16:17:22.154892+0000","last_active":"2023-12-19T16:17:22.160945+0000","last_peered":"2023-12-19T16:17:22.160945+0000","last_clean":"2023-12-19T16:17:22.160945+0000","last_became_active":"2023-12-19T16:17:22.154466+0000","last_became_peered":"2023-12-19T16:17:22.154466+0000","last_unstale":"2023-12-19T16:17:22.160945+0000","last_undegraded":"2023-12-19T16:17:22.160945+0000","last_fullsized":"2023-12-19T16:17:22.160945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:45.655780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.163321+0000","last_change":"2023-12-19T16:17:22.159873+0000","last_active":"2023-12-19T16:17:22.163321+0000","last_peered":"2023-12-19T16:17:22.163321+0000","last_clean":"2023-12-19T16:17:22.163321+0000","last_became_active":"2023-12-19T16:17:22.159334+0000","last_became_peered":"2023-12-19T16:17:22.159334+0000","last_unstale":"2023-12-19T16:17:22.163321+0000","last_undegraded":"2023-12-19T16:17:22.163321+0000","last_fullsized":"2023-12-19T16:17:22.163321+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135257+0000","last_change":"2023-12-19T16:17:22.159381+0000","last_active":"2023-12-19T16:17:23.135257+0000","last_peered":"2023-12-19T16:17:23.135257+0000","last_clean":"2023-12-19T16:17:23.135257+0000","last_became_active":"2023-12-19T16:17:22.159098+0000","last_became_peered":"2023-12-19T16:17:22.159098+0000","last_unstale":"2023-12-19T16:17:23.135257+0000","last_undegraded":"2023-12-19T16:17:23.135257+0000","last_fullsized":"2023-12-19T16:17:23.135257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160665+0000","last_change":"2023-12-19T16:17:22.154775+0000","last_active":"2023-12-19T16:17:22.160665+0000","last_peered":"2023-12-19T16:17:22.160665+0000","last_clean":"2023-12-19T16:17:22.160665+0000","last_became_active":"2023-12-19T16:17:22.154030+0000","last_became_peered":"2023-12-19T16:17:22.154030+0000","last_unstale":"2023-12-19T16:17:22.160665+0000","last_undegraded":"2023-12-19T16:17:22.160665+0000","last_fullsized":"2023-12-19T16:17:22.160665+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:55.606279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161535+0000","last_change":"2023-12-19T16:17:22.158100+0000","last_active":"2023-12-19T16:17:22.161535+0000","last_peered":"2023-12-19T16:17:22.161535+0000","last_clean":"2023-12-19T16:17:22.161535+0000","last_became_active":"2023-12-19T16:17:22.157849+0000","last_became_peered":"2023-12-19T16:17:22.157849+0000","last_unstale":"2023-12-19T16:17:22.161535+0000","last_undegraded":"2023-12-19T16:17:22.161535+0000","last_fullsized":"2023-12-19T16:17:22.161535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156098+0000","last_change":"2023-12-19T16:17:22.152299+0000","last_active":"2023-12-19T16:17:22.156098+0000","last_peered":"2023-12-19T16:17:22.156098+0000","last_clean":"2023-12-19T16:17:22.156098+0000","last_became_active":"2023-12-19T16:17:22.151817+0000","last_became_peered":"2023-12-19T16:17:22.151817+0000","last_unstale":"2023-12-19T16:17:22.156098+0000","last_undegraded":"2023-12-19T16:17:22.156098+0000","last_fullsized":"2023-12-19T16:17:22.156098+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:51.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149605+0000","last_change":"2023-12-19T16:17:22.141954+0000","last_active":"2023-12-19T16:17:22.149605+0000","last_peered":"2023-12-19T16:17:22.149605+0000","last_clean":"2023-12-19T16:17:22.149605+0000","last_became_active":"2023-12-19T16:17:22.141589+0000","last_became_peered":"2023-12-19T16:17:22.141589+0000","last_unstale":"2023-12-19T16:17:22.149605+0000","last_undegraded":"2023-12-19T16:17:22.149605+0000","last_fullsized":"2023-12-19T16:17:22.149605+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:56.610477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.148162+0000","last_change":"2023-12-19T16:17:22.142801+0000","last_active":"2023-12-19T16:17:22.148162+0000","last_peered":"2023-12-19T16:17:22.148162+0000","last_clean":"2023-12-19T16:17:22.148162+0000","last_became_active":"2023-12-19T16:17:22.142404+0000","last_became_peered":"2023-12-19T16:17:22.142404+0000","last_unstale":"2023-12-19T16:17:22.148162+0000","last_undegraded":"2023-12-19T16:17:22.148162+0000","last_fullsized":"2023-12-19T16:17:22.148162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:37.679998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134630+0000","last_change":"2023-12-19T16:17:22.155898+0000","last_active":"2023-12-19T16:17:23.134630+0000","last_peered":"2023-12-19T16:17:23.134630+0000","last_clean":"2023-12-19T16:17:23.134630+0000","last_became_active":"2023-12-19T16:17:22.155625+0000","last_became_peered":"2023-12-19T16:17:22.155625+0000","last_unstale":"2023-12-19T16:17:23.134630+0000","last_undegraded":"2023-12-19T16:17:23.134630+0000","last_fullsized":"2023-12-19T16:17:23.134630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.160173+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:22.160173+0000","last_peered":"2023-12-19T16:17:22.160173+0000","last_clean":"2023-12-19T16:17:22.160173+0000","last_became_active":"2023-12-19T16:17:22.154831+0000","last_became_peered":"2023-12-19T16:17:22.154831+0000","last_unstale":"2023-12-19T16:17:22.160173+0000","last_undegraded":"2023-12-19T16:17:22.160173+0000","last_fullsized":"2023-12-19T16:17:22.160173+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166936+0000","last_change":"2023-12-19T16:17:22.161976+0000","last_active":"2023-12-19T16:17:22.166936+0000","last_peered":"2023-12-19T16:17:22.166936+0000","last_clean":"2023-12-19T16:17:22.166936+0000","last_became_active":"2023-12-19T16:17:22.161253+0000","last_became_peered":"2023-12-19T16:17:22.161253+0000","last_unstale":"2023-12-19T16:17:22.166936+0000","last_undegraded":"2023-12-19T16:17:22.166936+0000","last_fullsized":"2023-12-19T16:17:22.166936+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141110+0000","last_change":"2023-12-19T16:17:22.133581+0000","last_active":"2023-12-19T16:17:22.141110+0000","last_peered":"2023-12-19T16:17:22.141110+0000","last_clean":"2023-12-19T16:17:22.141110+0000","last_became_active":"2023-12-19T16:17:22.133306+0000","last_became_peered":"2023-12-19T16:17:22.133306+0000","last_unstale":"2023-12-19T16:17:22.141110+0000","last_undegraded":"2023-12-19T16:17:22.141110+0000","last_fullsized":"2023-12-19T16:17:22.141110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:40.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143624+0000","last_change":"2023-12-19T16:17:22.139797+0000","last_active":"2023-12-19T16:17:22.143624+0000","last_peered":"2023-12-19T16:17:22.143624+0000","last_clean":"2023-12-19T16:17:22.143624+0000","last_became_active":"2023-12-19T16:17:22.139565+0000","last_became_peered":"2023-12-19T16:17:22.139565+0000","last_unstale":"2023-12-19T16:17:22.143624+0000","last_undegraded":"2023-12-19T16:17:22.143624+0000","last_fullsized":"2023-12-19T16:17:22.143624+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:15.932295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.153879+0000","last_change":"2023-12-19T16:17:22.145631+0000","last_active":"2023-12-19T16:17:22.153879+0000","last_peered":"2023-12-19T16:17:22.153879+0000","last_clean":"2023-12-19T16:17:22.153879+0000","last_became_active":"2023-12-19T16:17:22.145292+0000","last_became_peered":"2023-12-19T16:17:22.145292+0000","last_unstale":"2023-12-19T16:17:22.153879+0000","last_undegraded":"2023-12-19T16:17:22.153879+0000","last_fullsized":"2023-12-19T16:17:22.153879+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134641+0000","last_change":"2023-12-19T16:17:22.142912+0000","last_active":"2023-12-19T16:17:23.134641+0000","last_peered":"2023-12-19T16:17:23.134641+0000","last_clean":"2023-12-19T16:17:23.134641+0000","last_became_active":"2023-12-19T16:17:22.142631+0000","last_became_peered":"2023-12-19T16:17:22.142631+0000","last_unstale":"2023-12-19T16:17:23.134641+0000","last_undegraded":"2023-12-19T16:17:23.134641+0000","last_fullsized":"2023-12-19T16:17:23.134641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165928+0000","last_change":"2023-12-19T16:17:22.158179+0000","last_active":"2023-12-19T16:17:22.165928+0000","last_peered":"2023-12-19T16:17:22.165928+0000","last_clean":"2023-12-19T16:17:22.165928+0000","last_became_active":"2023-12-19T16:17:22.157886+0000","last_became_peered":"2023-12-19T16:17:22.157886+0000","last_unstale":"2023-12-19T16:17:22.165928+0000","last_undegraded":"2023-12-19T16:17:22.165928+0000","last_fullsized":"2023-12-19T16:17:22.165928+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:35.956464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156734+0000","last_change":"2023-12-19T16:17:22.151320+0000","last_active":"2023-12-19T16:17:22.156734+0000","last_peered":"2023-12-19T16:17:22.156734+0000","last_clean":"2023-12-19T16:17:22.156734+0000","last_became_active":"2023-12-19T16:17:22.150541+0000","last_became_peered":"2023-12-19T16:17:22.150541+0000","last_unstale":"2023-12-19T16:17:22.156734+0000","last_undegraded":"2023-12-19T16:17:22.156734+0000","last_fullsized":"2023-12-19T16:17:22.156734+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:28.033745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155355+0000","last_change":"2023-12-19T16:17:22.149896+0000","last_active":"2023-12-19T16:17:22.155355+0000","last_peered":"2023-12-19T16:17:22.155355+0000","last_clean":"2023-12-19T16:17:22.155355+0000","last_became_active":"2023-12-19T16:17:22.149454+0000","last_became_peered":"2023-12-19T16:17:22.149454+0000","last_unstale":"2023-12-19T16:17:22.155355+0000","last_undegraded":"2023-12-19T16:17:22.155355+0000","last_fullsized":"2023-12-19T16:17:22.155355+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:45.196163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161358+0000","last_change":"2023-12-19T16:17:21.757846+0000","last_active":"2023-12-19T16:17:22.161358+0000","last_peered":"2023-12-19T16:17:22.161358+0000","last_clean":"2023-12-19T16:17:22.161358+0000","last_became_active":"2023-12-19T16:17:21.757491+0000","last_became_peered":"2023-12-19T16:17:21.757491+0000","last_unstale":"2023-12-19T16:17:22.161358+0000","last_undegraded":"2023-12-19T16:17:22.161358+0000","last_fullsized":"2023-12-19T16:17:22.161358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161319+0000","last_change":"2023-12-19T16:17:22.158007+0000","last_active":"2023-12-19T16:17:22.161319+0000","last_peered":"2023-12-19T16:17:22.161319+0000","last_clean":"2023-12-19T16:17:22.161319+0000","last_became_active":"2023-12-19T16:17:22.157731+0000","last_became_peered":"2023-12-19T16:17:22.157731+0000","last_unstale":"2023-12-19T16:17:22.161319+0000","last_undegraded":"2023-12-19T16:17:22.161319+0000","last_fullsized":"2023-12-19T16:17:22.161319+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151665+0000","last_change":"2023-12-19T16:17:21.755136+0000","last_active":"2023-12-19T16:17:22.151665+0000","last_peered":"2023-12-19T16:17:22.151665+0000","last_clean":"2023-12-19T16:17:22.151665+0000","last_became_active":"2023-12-19T16:17:21.754811+0000","last_became_peered":"2023-12-19T16:17:21.754811+0000","last_unstale":"2023-12-19T16:17:22.151665+0000","last_undegraded":"2023-12-19T16:17:22.151665+0000","last_fullsized":"2023-12-19T16:17:22.151665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:21.178496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134945+0000","last_change":"2023-12-19T16:17:22.151779+0000","last_active":"2023-12-19T16:17:23.134945+0000","last_peered":"2023-12-19T16:17:23.134945+0000","last_clean":"2023-12-19T16:17:23.134945+0000","last_became_active":"2023-12-19T16:17:22.151531+0000","last_became_peered":"2023-12-19T16:17:22.151531+0000","last_unstale":"2023-12-19T16:17:23.134945+0000","last_undegraded":"2023-12-19T16:17:23.134945+0000","last_fullsized":"2023-12-19T16:17:23.134945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157539+0000","last_change":"2023-12-19T16:17:21.756962+0000","last_active":"2023-12-19T16:17:22.157539+0000","last_peered":"2023-12-19T16:17:22.157539+0000","last_clean":"2023-12-19T16:17:22.157539+0000","last_became_active":"2023-12-19T16:17:21.756429+0000","last_became_peered":"2023-12-19T16:17:21.756429+0000","last_unstale":"2023-12-19T16:17:22.157539+0000","last_undegraded":"2023-12-19T16:17:22.157539+0000","last_fullsized":"2023-12-19T16:17:22.157539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156016+0000","last_change":"2023-12-19T16:17:22.151997+0000","last_active":"2023-12-19T16:17:22.156016+0000","last_peered":"2023-12-19T16:17:22.156016+0000","last_clean":"2023-12-19T16:17:22.156016+0000","last_became_active":"2023-12-19T16:17:22.151660+0000","last_became_peered":"2023-12-19T16:17:22.151660+0000","last_unstale":"2023-12-19T16:17:22.156016+0000","last_undegraded":"2023-12-19T16:17:22.156016+0000","last_fullsized":"2023-12-19T16:17:22.156016+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:08.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143903+0000","last_change":"2023-12-19T16:17:21.751163+0000","last_active":"2023-12-19T16:17:22.143903+0000","last_peered":"2023-12-19T16:17:22.143903+0000","last_clean":"2023-12-19T16:17:22.143903+0000","last_became_active":"2023-12-19T16:17:21.750841+0000","last_became_peered":"2023-12-19T16:17:21.750841+0000","last_unstale":"2023-12-19T16:17:22.143903+0000","last_undegraded":"2023-12-19T16:17:22.143903+0000","last_fullsized":"2023-12-19T16:17:22.143903+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:13.969787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.143497+0000","last_change":"2023-12-19T16:17:22.138939+0000","last_active":"2023-12-19T16:17:22.143497+0000","last_peered":"2023-12-19T16:17:22.143497+0000","last_clean":"2023-12-19T16:17:22.143497+0000","last_became_active":"2023-12-19T16:17:22.136474+0000","last_became_peered":"2023-12-19T16:17:22.136474+0000","last_unstale":"2023-12-19T16:17:22.143497+0000","last_undegraded":"2023-12-19T16:17:22.143497+0000","last_fullsized":"2023-12-19T16:17:22.143497+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:10.979687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156965+0000","last_change":"2023-12-19T16:17:21.761909+0000","last_active":"2023-12-19T16:17:22.156965+0000","last_peered":"2023-12-19T16:17:22.156965+0000","last_clean":"2023-12-19T16:17:22.156965+0000","last_became_active":"2023-12-19T16:17:21.761644+0000","last_became_peered":"2023-12-19T16:17:21.761644+0000","last_unstale":"2023-12-19T16:17:22.156965+0000","last_undegraded":"2023-12-19T16:17:22.156965+0000","last_fullsized":"2023-12-19T16:17:22.156965+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.154258+0000","last_change":"2023-12-19T16:17:21.752834+0000","last_active":"2023-12-19T16:17:22.154258+0000","last_peered":"2023-12-19T16:17:22.154258+0000","last_clean":"2023-12-19T16:17:22.154258+0000","last_became_active":"2023-12-19T16:17:21.751522+0000","last_became_peered":"2023-12-19T16:17:21.751522+0000","last_unstale":"2023-12-19T16:17:22.154258+0000","last_undegraded":"2023-12-19T16:17:22.154258+0000","last_fullsized":"2023-12-19T16:17:22.154258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:27.026260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137520+0000","last_change":"2023-12-19T16:17:21.757958+0000","last_active":"2023-12-19T16:17:22.137520+0000","last_peered":"2023-12-19T16:17:22.137520+0000","last_clean":"2023-12-19T16:17:22.137520+0000","last_became_active":"2023-12-19T16:17:21.757638+0000","last_became_peered":"2023-12-19T16:17:21.757638+0000","last_unstale":"2023-12-19T16:17:22.137520+0000","last_undegraded":"2023-12-19T16:17:22.137520+0000","last_fullsized":"2023-12-19T16:17:22.137520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151506+0000","last_change":"2023-12-19T16:17:22.146956+0000","last_active":"2023-12-19T16:17:22.151506+0000","last_peered":"2023-12-19T16:17:22.151506+0000","last_clean":"2023-12-19T16:17:22.151506+0000","last_became_active":"2023-12-19T16:17:22.146235+0000","last_became_peered":"2023-12-19T16:17:22.146235+0000","last_unstale":"2023-12-19T16:17:22.151506+0000","last_undegraded":"2023-12-19T16:17:22.151506+0000","last_fullsized":"2023-12-19T16:17:22.151506+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:40.626111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140193+0000","last_change":"2023-12-19T16:17:22.136135+0000","last_active":"2023-12-19T16:17:22.140193+0000","last_peered":"2023-12-19T16:17:22.140193+0000","last_clean":"2023-12-19T16:17:22.140193+0000","last_became_active":"2023-12-19T16:17:22.135881+0000","last_became_peered":"2023-12-19T16:17:22.135881+0000","last_unstale":"2023-12-19T16:17:22.140193+0000","last_undegraded":"2023-12-19T16:17:22.140193+0000","last_fullsized":"2023-12-19T16:17:22.140193+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:46.895243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129442+0000","last_change":"2023-12-19T16:17:21.758331+0000","last_active":"2023-12-19T16:17:22.129442+0000","last_peered":"2023-12-19T16:17:22.129442+0000","last_clean":"2023-12-19T16:17:22.129442+0000","last_became_active":"2023-12-19T16:17:21.758062+0000","last_became_peered":"2023-12-19T16:17:21.758062+0000","last_unstale":"2023-12-19T16:17:22.129442+0000","last_undegraded":"2023-12-19T16:17:22.129442+0000","last_fullsized":"2023-12-19T16:17:22.129442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:56:16.429059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162960+0000","last_change":"2023-12-19T16:17:22.157415+0000","last_active":"2023-12-19T16:17:22.162960+0000","last_peered":"2023-12-19T16:17:22.162960+0000","last_clean":"2023-12-19T16:17:22.162960+0000","last_became_active":"2023-12-19T16:17:22.157175+0000","last_became_peered":"2023-12-19T16:17:22.157175+0000","last_unstale":"2023-12-19T16:17:22.162960+0000","last_undegraded":"2023-12-19T16:17:22.162960+0000","last_fullsized":"2023-12-19T16:17:22.162960+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:35.693932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733700+0000","last_change":"2023-12-19T16:17:20.733700+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733700+0000","last_undegraded":"2023-12-19T16:17:20.733700+0000","last_fullsized":"2023-12-19T16:17:20.733700+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.167325+0000","last_change":"2023-12-19T16:17:22.164149+0000","last_active":"2023-12-19T16:17:22.167325+0000","last_peered":"2023-12-19T16:17:22.167325+0000","last_clean":"2023-12-19T16:17:22.167325+0000","last_became_active":"2023-12-19T16:17:22.163873+0000","last_became_peered":"2023-12-19T16:17:22.163873+0000","last_unstale":"2023-12-19T16:17:22.167325+0000","last_undegraded":"2023-12-19T16:17:22.167325+0000","last_fullsized":"2023-12-19T16:17:22.167325+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135051+0000","last_change":"2023-12-19T16:17:21.760196+0000","last_active":"2023-12-19T16:17:23.135051+0000","last_peered":"2023-12-19T16:17:23.135051+0000","last_clean":"2023-12-19T16:17:23.135051+0000","last_became_active":"2023-12-19T16:17:21.759918+0000","last_became_peered":"2023-12-19T16:17:21.759918+0000","last_unstale":"2023-12-19T16:17:23.135051+0000","last_undegraded":"2023-12-19T16:17:23.135051+0000","last_fullsized":"2023-12-19T16:17:23.135051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158619+0000","last_change":"2023-12-19T16:17:22.156495+0000","last_active":"2023-12-19T16:17:22.158619+0000","last_peered":"2023-12-19T16:17:22.158619+0000","last_clean":"2023-12-19T16:17:22.158619+0000","last_became_active":"2023-12-19T16:17:22.156228+0000","last_became_peered":"2023-12-19T16:17:22.156228+0000","last_unstale":"2023-12-19T16:17:22.158619+0000","last_undegraded":"2023-12-19T16:17:22.158619+0000","last_fullsized":"2023-12-19T16:17:22.158619+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:36.662860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733675+0000","last_change":"2023-12-19T16:17:20.733675+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733675+0000","last_undegraded":"2023-12-19T16:17:20.733675+0000","last_fullsized":"2023-12-19T16:17:20.733675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162919+0000","last_change":"2023-12-19T16:17:22.157237+0000","last_active":"2023-12-19T16:17:22.162919+0000","last_peered":"2023-12-19T16:17:22.162919+0000","last_clean":"2023-12-19T16:17:22.162919+0000","last_became_active":"2023-12-19T16:17:22.156973+0000","last_became_peered":"2023-12-19T16:17:22.156973+0000","last_unstale":"2023-12-19T16:17:22.162919+0000","last_undegraded":"2023-12-19T16:17:22.162919+0000","last_fullsized":"2023-12-19T16:17:22.162919+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:31.895567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.157483+0000","last_change":"2023-12-19T16:17:21.761048+0000","last_active":"2023-12-19T16:17:22.157483+0000","last_peered":"2023-12-19T16:17:22.157483+0000","last_clean":"2023-12-19T16:17:22.157483+0000","last_became_active":"2023-12-19T16:17:21.758547+0000","last_became_peered":"2023-12-19T16:17:21.758547+0000","last_unstale":"2023-12-19T16:17:22.157483+0000","last_undegraded":"2023-12-19T16:17:22.157483+0000","last_fullsized":"2023-12-19T16:17:22.157483+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:15.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149532+0000","last_change":"2023-12-19T16:17:22.141474+0000","last_active":"2023-12-19T16:17:22.149532+0000","last_peered":"2023-12-19T16:17:22.149532+0000","last_clean":"2023-12-19T16:17:22.149532+0000","last_became_active":"2023-12-19T16:17:22.141183+0000","last_became_peered":"2023-12-19T16:17:22.141183+0000","last_unstale":"2023-12-19T16:17:22.149532+0000","last_undegraded":"2023-12-19T16:17:22.149532+0000","last_fullsized":"2023-12-19T16:17:22.149532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:10.623748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137461+0000","last_change":"2023-12-19T16:17:21.743866+0000","last_active":"2023-12-19T16:17:22.137461+0000","last_peered":"2023-12-19T16:17:22.137461+0000","last_clean":"2023-12-19T16:17:22.137461+0000","last_became_active":"2023-12-19T16:17:21.743597+0000","last_became_peered":"2023-12-19T16:17:21.743597+0000","last_unstale":"2023-12-19T16:17:22.137461+0000","last_undegraded":"2023-12-19T16:17:22.137461+0000","last_fullsized":"2023-12-19T16:17:22.137461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155323+0000","last_change":"2023-12-19T16:17:22.149800+0000","last_active":"2023-12-19T16:17:22.155323+0000","last_peered":"2023-12-19T16:17:22.155323+0000","last_clean":"2023-12-19T16:17:22.155323+0000","last_became_active":"2023-12-19T16:17:22.149385+0000","last_became_peered":"2023-12-19T16:17:22.149385+0000","last_unstale":"2023-12-19T16:17:22.155323+0000","last_undegraded":"2023-12-19T16:17:22.155323+0000","last_fullsized":"2023-12-19T16:17:22.155323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:57.924303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.139919+0000","last_change":"2023-12-19T16:17:21.761964+0000","last_active":"2023-12-19T16:17:22.139919+0000","last_peered":"2023-12-19T16:17:22.139919+0000","last_clean":"2023-12-19T16:17:22.139919+0000","last_became_active":"2023-12-19T16:17:21.760304+0000","last_became_peered":"2023-12-19T16:17:21.760304+0000","last_unstale":"2023-12-19T16:17:22.139919+0000","last_undegraded":"2023-12-19T16:17:22.139919+0000","last_fullsized":"2023-12-19T16:17:22.139919+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:44.188677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134631+0000","last_change":"2023-12-19T16:17:22.148063+0000","last_active":"2023-12-19T16:17:23.134631+0000","last_peered":"2023-12-19T16:17:23.134631+0000","last_clean":"2023-12-19T16:17:23.134631+0000","last_became_active":"2023-12-19T16:17:22.147442+0000","last_became_peered":"2023-12-19T16:17:22.147442+0000","last_unstale":"2023-12-19T16:17:23.134631+0000","last_undegraded":"2023-12-19T16:17:23.134631+0000","last_fullsized":"2023-12-19T16:17:23.134631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.735466+0000","last_change":"2023-12-19T16:17:20.735466+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.735466+0000","last_undegraded":"2023-12-19T16:17:20.735466+0000","last_fullsized":"2023-12-19T16:17:20.735466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149280+0000","last_change":"2023-12-19T16:17:22.140926+0000","last_active":"2023-12-19T16:17:22.149280+0000","last_peered":"2023-12-19T16:17:22.149280+0000","last_clean":"2023-12-19T16:17:22.149280+0000","last_became_active":"2023-12-19T16:17:22.140652+0000","last_became_peered":"2023-12-19T16:17:22.140652+0000","last_unstale":"2023-12-19T16:17:22.149280+0000","last_undegraded":"2023-12-19T16:17:22.149280+0000","last_fullsized":"2023-12-19T16:17:22.149280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:29.710944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166720+0000","last_change":"2023-12-19T16:17:21.761218+0000","last_active":"2023-12-19T16:17:22.166720+0000","last_peered":"2023-12-19T16:17:22.166720+0000","last_clean":"2023-12-19T16:17:22.166720+0000","last_became_active":"2023-12-19T16:17:21.760858+0000","last_became_peered":"2023-12-19T16:17:21.760858+0000","last_unstale":"2023-12-19T16:17:22.166720+0000","last_undegraded":"2023-12-19T16:17:22.166720+0000","last_fullsized":"2023-12-19T16:17:22.166720+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.150861+0000","last_change":"2023-12-19T16:17:22.148334+0000","last_active":"2023-12-19T16:17:22.150861+0000","last_peered":"2023-12-19T16:17:22.150861+0000","last_clean":"2023-12-19T16:17:22.150861+0000","last_became_active":"2023-12-19T16:17:22.148036+0000","last_became_peered":"2023-12-19T16:17:22.148036+0000","last_unstale":"2023-12-19T16:17:22.150861+0000","last_undegraded":"2023-12-19T16:17:22.150861+0000","last_fullsized":"2023-12-19T16:17:22.150861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:57.733309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158973+0000","last_change":"2023-12-19T16:17:21.759281+0000","last_active":"2023-12-19T16:17:22.158973+0000","last_peered":"2023-12-19T16:17:22.158973+0000","last_clean":"2023-12-19T16:17:22.158973+0000","last_became_active":"2023-12-19T16:17:21.758854+0000","last_became_peered":"2023-12-19T16:17:21.758854+0000","last_unstale":"2023-12-19T16:17:22.158973+0000","last_undegraded":"2023-12-19T16:17:22.158973+0000","last_fullsized":"2023-12-19T16:17:22.158973+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:43.061583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134967+0000","last_change":"2023-12-19T16:17:22.157996+0000","last_active":"2023-12-19T16:17:23.134967+0000","last_peered":"2023-12-19T16:17:23.134967+0000","last_clean":"2023-12-19T16:17:23.134967+0000","last_became_active":"2023-12-19T16:17:22.157742+0000","last_became_peered":"2023-12-19T16:17:22.157742+0000","last_unstale":"2023-12-19T16:17:23.134967+0000","last_undegraded":"2023-12-19T16:17:23.134967+0000","last_fullsized":"2023-12-19T16:17:23.134967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.165864+0000","last_change":"2023-12-19T16:17:21.755379+0000","last_active":"2023-12-19T16:17:22.165864+0000","last_peered":"2023-12-19T16:17:22.165864+0000","last_clean":"2023-12-19T16:17:22.165864+0000","last_became_active":"2023-12-19T16:17:21.754564+0000","last_became_peered":"2023-12-19T16:17:21.754564+0000","last_unstale":"2023-12-19T16:17:22.165864+0000","last_undegraded":"2023-12-19T16:17:22.165864+0000","last_fullsized":"2023-12-19T16:17:22.165864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:11.726871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.149876+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:22.149876+0000","last_peered":"2023-12-19T16:17:22.149876+0000","last_clean":"2023-12-19T16:17:22.149876+0000","last_became_active":"2023-12-19T16:17:22.148868+0000","last_became_peered":"2023-12-19T16:17:22.148868+0000","last_unstale":"2023-12-19T16:17:22.149876+0000","last_undegraded":"2023-12-19T16:17:22.149876+0000","last_fullsized":"2023-12-19T16:17:22.149876+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:14.946456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140783+0000","last_change":"2023-12-19T16:17:21.763539+0000","last_active":"2023-12-19T16:17:22.140783+0000","last_peered":"2023-12-19T16:17:22.140783+0000","last_clean":"2023-12-19T16:17:22.140783+0000","last_became_active":"2023-12-19T16:17:21.763131+0000","last_became_peered":"2023-12-19T16:17:21.763131+0000","last_unstale":"2023-12-19T16:17:22.140783+0000","last_undegraded":"2023-12-19T16:17:22.140783+0000","last_fullsized":"2023-12-19T16:17:22.140783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:56.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733663+0000","last_change":"2023-12-19T16:17:20.733663+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733663+0000","last_undegraded":"2023-12-19T16:17:20.733663+0000","last_fullsized":"2023-12-19T16:17:20.733663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.161993+0000","last_change":"2023-12-19T16:17:22.157501+0000","last_active":"2023-12-19T16:17:22.161993+0000","last_peered":"2023-12-19T16:17:22.161993+0000","last_clean":"2023-12-19T16:17:22.161993+0000","last_became_active":"2023-12-19T16:17:22.157209+0000","last_became_peered":"2023-12-19T16:17:22.157209+0000","last_unstale":"2023-12-19T16:17:22.161993+0000","last_undegraded":"2023-12-19T16:17:22.161993+0000","last_fullsized":"2023-12-19T16:17:22.161993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:22.093772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.137345+0000","last_change":"2023-12-19T16:17:21.751942+0000","last_active":"2023-12-19T16:17:22.137345+0000","last_peered":"2023-12-19T16:17:22.137345+0000","last_clean":"2023-12-19T16:17:22.137345+0000","last_became_active":"2023-12-19T16:17:21.751600+0000","last_became_peered":"2023-12-19T16:17:21.751600+0000","last_unstale":"2023-12-19T16:17:22.137345+0000","last_undegraded":"2023-12-19T16:17:22.137345+0000","last_fullsized":"2023-12-19T16:17:22.137345+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:47.234683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156753+0000","last_change":"2023-12-19T16:17:22.152347+0000","last_active":"2023-12-19T16:17:22.156753+0000","last_peered":"2023-12-19T16:17:22.156753+0000","last_clean":"2023-12-19T16:17:22.156753+0000","last_became_active":"2023-12-19T16:17:22.151834+0000","last_became_peered":"2023-12-19T16:17:22.151834+0000","last_unstale":"2023-12-19T16:17:22.156753+0000","last_undegraded":"2023-12-19T16:17:22.156753+0000","last_fullsized":"2023-12-19T16:17:22.156753+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2023-12-19T16:17:20.733673+0000","last_change":"2023-12-19T16:17:20.733673+0000","last_active":"2023-12-19T16:17:20.718859+0000","last_peered":"2023-12-19T16:17:20.718859+0000","last_clean":"2023-12-19T16:17:20.718859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:20.733673+0000","last_undegraded":"2023-12-19T16:17:20.733673+0000","last_fullsized":"2023-12-19T16:17:20.733673+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.155943+0000","last_change":"2023-12-19T16:17:22.151111+0000","last_active":"2023-12-19T16:17:22.155943+0000","last_peered":"2023-12-19T16:17:22.155943+0000","last_clean":"2023-12-19T16:17:22.155943+0000","last_became_active":"2023-12-19T16:17:22.150803+0000","last_became_peered":"2023-12-19T16:17:22.150803+0000","last_unstale":"2023-12-19T16:17:22.155943+0000","last_undegraded":"2023-12-19T16:17:22.155943+0000","last_fullsized":"2023-12-19T16:17:22.155943+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127328+0000","last_change":"2023-12-19T16:17:21.756215+0000","last_active":"2023-12-19T16:17:22.127328+0000","last_peered":"2023-12-19T16:17:22.127328+0000","last_clean":"2023-12-19T16:17:22.127328+0000","last_became_active":"2023-12-19T16:17:21.755911+0000","last_became_peered":"2023-12-19T16:17:21.755911+0000","last_unstale":"2023-12-19T16:17:22.127328+0000","last_undegraded":"2023-12-19T16:17:22.127328+0000","last_fullsized":"2023-12-19T16:17:22.127328+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:40.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158663+0000","last_change":"2023-12-19T16:17:22.156498+0000","last_active":"2023-12-19T16:17:22.158663+0000","last_peered":"2023-12-19T16:17:22.158663+0000","last_clean":"2023-12-19T16:17:22.158663+0000","last_became_active":"2023-12-19T16:17:22.156255+0000","last_became_peered":"2023-12-19T16:17:22.156255+0000","last_unstale":"2023-12-19T16:17:22.158663+0000","last_undegraded":"2023-12-19T16:17:22.158663+0000","last_fullsized":"2023-12-19T16:17:22.158663+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:06.241133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156451+0000","last_change":"2023-12-19T16:17:21.758755+0000","last_active":"2023-12-19T16:17:22.156451+0000","last_peered":"2023-12-19T16:17:22.156451+0000","last_clean":"2023-12-19T16:17:22.156451+0000","last_became_active":"2023-12-19T16:17:21.758489+0000","last_became_peered":"2023-12-19T16:17:21.758489+0000","last_unstale":"2023-12-19T16:17:22.156451+0000","last_undegraded":"2023-12-19T16:17:22.156451+0000","last_fullsized":"2023-12-19T16:17:22.156451+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.141669+0000","last_change":"2023-12-19T16:17:21.756779+0000","last_active":"2023-12-19T16:17:22.141669+0000","last_peered":"2023-12-19T16:17:22.141669+0000","last_clean":"2023-12-19T16:17:22.141669+0000","last_became_active":"2023-12-19T16:17:21.756421+0000","last_became_peered":"2023-12-19T16:17:21.756421+0000","last_unstale":"2023-12-19T16:17:22.141669+0000","last_undegraded":"2023-12-19T16:17:22.141669+0000","last_fullsized":"2023-12-19T16:17:22.141669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.158640+0000","last_change":"2023-12-19T16:17:22.156581+0000","last_active":"2023-12-19T16:17:22.158640+0000","last_peered":"2023-12-19T16:17:22.158640+0000","last_clean":"2023-12-19T16:17:22.158640+0000","last_became_active":"2023-12-19T16:17:22.156314+0000","last_became_peered":"2023-12-19T16:17:22.156314+0000","last_unstale":"2023-12-19T16:17:22.158640+0000","last_undegraded":"2023-12-19T16:17:22.158640+0000","last_fullsized":"2023-12-19T16:17:22.158640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:47.136357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129951+0000","last_change":"2023-12-19T16:17:21.759011+0000","last_active":"2023-12-19T16:17:22.129951+0000","last_peered":"2023-12-19T16:17:22.129951+0000","last_clean":"2023-12-19T16:17:22.129951+0000","last_became_active":"2023-12-19T16:17:21.758694+0000","last_became_peered":"2023-12-19T16:17:21.758694+0000","last_unstale":"2023-12-19T16:17:22.129951+0000","last_undegraded":"2023-12-19T16:17:22.129951+0000","last_fullsized":"2023-12-19T16:17:22.129951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:32.774324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T16:17:21.726345+0000","last_change":"2023-12-19T16:17:21.726345+0000","last_active":"2023-12-19T16:17:21.726345+0000","last_peered":"2023-12-19T16:17:21.726345+0000","last_clean":"2023-12-19T16:17:21.726345+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T16:17:21.726345+0000","last_undegraded":"2023-12-19T16:17:21.726345+0000","last_fullsized":"2023-12-19T16:17:21.726345+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140708+0000","last_change":"2023-12-19T16:17:21.758295+0000","last_active":"2023-12-19T16:17:22.140708+0000","last_peered":"2023-12-19T16:17:22.140708+0000","last_clean":"2023-12-19T16:17:22.140708+0000","last_became_active":"2023-12-19T16:17:21.758035+0000","last_became_peered":"2023-12-19T16:17:21.758035+0000","last_unstale":"2023-12-19T16:17:22.140708+0000","last_undegraded":"2023-12-19T16:17:22.140708+0000","last_fullsized":"2023-12-19T16:17:22.140708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:59.521708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.156076+0000","last_change":"2023-12-19T16:17:22.151966+0000","last_active":"2023-12-19T16:17:22.156076+0000","last_peered":"2023-12-19T16:17:22.156076+0000","last_clean":"2023-12-19T16:17:22.156076+0000","last_became_active":"2023-12-19T16:17:22.150479+0000","last_became_peered":"2023-12-19T16:17:22.150479+0000","last_unstale":"2023-12-19T16:17:22.156076+0000","last_undegraded":"2023-12-19T16:17:22.156076+0000","last_fullsized":"2023-12-19T16:17:22.156076+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:25.579064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127836+0000","last_change":"2023-12-19T16:17:21.753501+0000","last_active":"2023-12-19T16:17:22.127836+0000","last_peered":"2023-12-19T16:17:22.127836+0000","last_clean":"2023-12-19T16:17:22.127836+0000","last_became_active":"2023-12-19T16:17:21.753228+0000","last_became_peered":"2023-12-19T16:17:21.753228+0000","last_unstale":"2023-12-19T16:17:22.127836+0000","last_undegraded":"2023-12-19T16:17:22.127836+0000","last_fullsized":"2023-12-19T16:17:22.127836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:16.857037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.162995+0000","last_change":"2023-12-19T16:17:22.158201+0000","last_active":"2023-12-19T16:17:22.162995+0000","last_peered":"2023-12-19T16:17:22.162995+0000","last_clean":"2023-12-19T16:17:22.162995+0000","last_became_active":"2023-12-19T16:17:22.155301+0000","last_became_peered":"2023-12-19T16:17:22.155301+0000","last_unstale":"2023-12-19T16:17:22.162995+0000","last_undegraded":"2023-12-19T16:17:22.162995+0000","last_fullsized":"2023-12-19T16:17:22.162995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:34.957262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.140060+0000","last_change":"2023-12-19T16:17:21.755941+0000","last_active":"2023-12-19T16:17:22.140060+0000","last_peered":"2023-12-19T16:17:22.140060+0000","last_clean":"2023-12-19T16:17:22.140060+0000","last_became_active":"2023-12-19T16:17:21.755557+0000","last_became_peered":"2023-12-19T16:17:21.755557+0000","last_unstale":"2023-12-19T16:17:22.140060+0000","last_undegraded":"2023-12-19T16:17:22.140060+0000","last_fullsized":"2023-12-19T16:17:22.140060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:56.916818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134632+0000","last_change":"2023-12-19T16:17:22.141268+0000","last_active":"2023-12-19T16:17:23.134632+0000","last_peered":"2023-12-19T16:17:23.134632+0000","last_clean":"2023-12-19T16:17:23.134632+0000","last_became_active":"2023-12-19T16:17:22.140999+0000","last_became_peered":"2023-12-19T16:17:22.140999+0000","last_unstale":"2023-12-19T16:17:23.134632+0000","last_undegraded":"2023-12-19T16:17:23.134632+0000","last_fullsized":"2023-12-19T16:17:23.134632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.129706+0000","last_change":"2023-12-19T16:17:21.749542+0000","last_active":"2023-12-19T16:17:22.129706+0000","last_peered":"2023-12-19T16:17:22.129706+0000","last_clean":"2023-12-19T16:17:22.129706+0000","last_became_active":"2023-12-19T16:17:21.749270+0000","last_became_peered":"2023-12-19T16:17:21.749270+0000","last_unstale":"2023-12-19T16:17:22.129706+0000","last_undegraded":"2023-12-19T16:17:22.129706+0000","last_fullsized":"2023-12-19T16:17:22.129706+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:30.862265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166669+0000","last_change":"2023-12-19T16:17:22.159978+0000","last_active":"2023-12-19T16:17:22.166669+0000","last_peered":"2023-12-19T16:17:22.166669+0000","last_clean":"2023-12-19T16:17:22.166669+0000","last_became_active":"2023-12-19T16:17:22.159594+0000","last_became_peered":"2023-12-19T16:17:22.159594+0000","last_unstale":"2023-12-19T16:17:22.166669+0000","last_undegraded":"2023-12-19T16:17:22.166669+0000","last_fullsized":"2023-12-19T16:17:22.166669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:14.977272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.151286+0000","last_change":"2023-12-19T16:17:21.757859+0000","last_active":"2023-12-19T16:17:22.151286+0000","last_peered":"2023-12-19T16:17:22.151286+0000","last_clean":"2023-12-19T16:17:22.151286+0000","last_became_active":"2023-12-19T16:17:21.757542+0000","last_became_peered":"2023-12-19T16:17:21.757542+0000","last_unstale":"2023-12-19T16:17:22.151286+0000","last_undegraded":"2023-12-19T16:17:22.151286+0000","last_fullsized":"2023-12-19T16:17:22.151286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:07.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T16:17:21.742544+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:17:21.742544+0000","last_peered":"2023-12-19T16:17:21.742544+0000","last_clean":"2023-12-19T16:17:21.742544+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:17:21.742544+0000","last_undegraded":"2023-12-19T16:17:21.742544+0000","last_fullsized":"2023-12-19T16:17:21.742544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476763,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":602112,"data_stored":242672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.98699999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.84199999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":1.071}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.88},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.97099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476763,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":593920,"data_stored":241198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.32400000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.496}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52800000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.748},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.69399999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.622},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.70299999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476763,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1160,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1187840,"data_stored":831546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.40699999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.49299999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.45100000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.624},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.64300000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":16,"seq":68719476762,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":598016,"data_stored":241780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34300000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.435},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.54600000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.50600000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.62}]}]},{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.496},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.68100000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.56699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.629}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.72999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":564,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":577536,"data_stored":234333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45000000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.624},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.47999999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1171456,"data_stored":824701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.435}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50700000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.53700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":565248,"data_stored":228058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.58999999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.501},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.71199999999999997}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:27.723 INFO:tasks.ceph.mds.c.smithi073.stderr:2023-12-19T16:17:27.718+0000 7fa407717640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:17:30.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:17:30.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.846+0000 7fb609c2d640 1 Processor -- start 2023-12-19T16:17:30.851 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.846+0000 7fb609c2d640 1 -- start start 2023-12-19T16:17:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb609c2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb60406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb609c2d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6040ca6f0 con 0x7fb6040cd580 2023-12-19T16:17:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb609c2d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb604159530 con 0x7fb60406ddf0 2023-12-19T16:17:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb609c2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040cccb0 con 0x7fb6040cbe90 2023-12-19T16:17:30.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb6040cd580 0x7fb60406c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41454/0 (socket says 172.21.15.73:41454) 2023-12-19T16:17:30.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 -- 172.21.15.73:0/755545655 learned_addr learned my addr 172.21.15.73:0/755545655 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:30.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb603fff640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb60406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020979751 0 0) 0x7fb6040ca6f0 con 0x7fb6040cd580 2023-12-19T16:17:30.854 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5ec003530 con 0x7fb6040cd580 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867759943 0 0) 0x7fb5ec003530 con 0x7fb6040cd580 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 msgr2=0x7fb60406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb60406c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 >> v1:172.21.15.162:6789/0 conn(0x7fb60406ddf0 legacy=0x7fb6040cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040c9ae0 con 0x7fb6040cd580 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fb5f8001680 con 0x7fb6040cd580 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 >> v1:172.21.15.73:6789/0 conn(0x7fb6040cd580 legacy=0x7fb60406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb5ec004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb5ec005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec00dba0 con 0x7fb5ec004360 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec00dd10 con 0x7fb5ec0039b0 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec00ded0 con 0x7fb6040cbe90 2023-12-19T16:17:30.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb5ec004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb603fff640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb5ec005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb6037fe640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 -- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 msgr2=0x7fb5ec005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6040cbe90 0x7fb5ec005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 -- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec0039b0 msgr2=0x7fb5ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb5ec0039b0 0x7fb5ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:30.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.850+0000 7fb602ffd640 1 -- 172.21.15.73:0/755545655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec003530 con 0x7fb5ec004360 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb602ffd640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb5ec004830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c1c0 tx=0x7fb5f801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4843b2b188ece7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80a5b20 con 0x7fb5ec004360 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f80a5c80 con 0x7fb5ec004360 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb6027fc640 1 -- 172.21.15.73:0/755545655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f80058e0 con 0x7fb5ec004360 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 -- 172.21.15.73:0/755545655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 msgr2=0x7fb5ec004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 --2- 172.21.15.73:0/755545655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb5ec004830 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c1c0 tx=0x7fb5f801cc20 comp rx=0 tx=0).stop 2023-12-19T16:17:30.858 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb603fff640 1 -- 172.21.15.73:0/755545655 reap_dead start 2023-12-19T16:17:30.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 -- 172.21.15.73:0/755545655 shutdown_connections 2023-12-19T16:17:30.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 -- 172.21.15.73:0/755545655 >> 172.21.15.73:0/755545655 conn(0x7fb6040b0270 msgr2=0x7fb6040b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:30.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 -- 172.21.15.73:0/755545655 shutdown_connections 2023-12-19T16:17:30.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.854+0000 7fb609c2d640 1 -- 172.21.15.73:0/755545655 wait complete. 2023-12-19T16:17:30.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 Processor -- start 2023-12-19T16:17:30.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- start start 2023-12-19T16:17:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb604158720 0x7fb6040c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 0x7fb6040af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040c7f60 con 0x7fb5ec004360 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040c8240 con 0x7fb6040c7710 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6040c59b0 con 0x7fb604158720 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36690/0 (socket says 172.21.15.73:36690) 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 -- 172.21.15.73:0/91665833 learned_addr learned my addr 172.21.15.73:0/91665833 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb603fff640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 0x7fb6040af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb602ffd640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb604158720 0x7fb6040c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 -- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb604158720 msgr2=0x7fb6040c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb604158720 0x7fb6040c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 -- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 msgr2=0x7fb6040af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 0x7fb6040af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:30.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 -- 172.21.15.73:0/91665833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6040c5c90 con 0x7fb5ec004360 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb603fff640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 0x7fb6040af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb6037fe640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4010f40 tx=0x7fb5f400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4005270 con 0x7fb5ec004360 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f400d030 con 0x7fb5ec004360 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6040c5f70 con 0x7fb5ec004360 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400ee50 con 0x7fb5ec004360 2023-12-19T16:17:30.864 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.858+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6040afa40 con 0x7fb5ec004360 2023-12-19T16:17:30.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6040c57f0 con 0x7fb5ec004360 2023-12-19T16:17:30.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb5f4003600 con 0x7fb5ec004360 2023-12-19T16:17:30.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb5ebfff640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 0x7fb5f0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:30.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5f40869a0 con 0x7fb5ec004360 2023-12-19T16:17:30.865 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb602ffd640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 0x7fb5f0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:30.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.862+0000 7fb602ffd640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 0x7fb5f0067f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80ab000 tx=0x7fb5f80a7070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:30.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:30.866+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5f4054360 con 0x7fb5ec004360 2023-12-19T16:17:31.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.014+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6040c5b20 con 0x7fb5f0065a90 2023-12-19T16:17:31.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.022+0000 7fb5ebfff640 1 -- 172.21.15.73:0/91665833 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289428 (secure 0 0 0) 0x7fb6040c5b20 con 0x7fb5f0065a90 2023-12-19T16:17:31.026 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:31.028 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:17:31.029 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 msgr2=0x7fb5f0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 0x7fb5f0067f50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80ab000 tx=0x7fb5f80a7070 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 msgr2=0x7fb6041581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4010f40 tx=0x7fb5f400e530 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 shutdown_connections 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6040c7710 0x7fb6040af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb604158720 0x7fb6040c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb5f0065a90 0x7fb5f0067f50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 --2- 172.21.15.73:0/91665833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb5ec004360 0x7fb6041581b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 >> 172.21.15.73:0/91665833 conn(0x7fb6040b0270 msgr2=0x7fb604070110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 shutdown_connections 2023-12-19T16:17:31.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.026+0000 7fb609c2d640 1 -- 172.21.15.73:0/91665833 wait complete. 2023-12-19T16:17:31.046 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T16:17:30.470544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225640,"kb_used_data":5928,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754749080,"statfs":{"total":773094113280,"available":772863057920,"internally_reserved":0,"allocated":6070272,"data_stored":3164724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.345142"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478849+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:23.478849+0000","last_peered":"2023-12-19T16:17:23.478849+0000","last_clean":"2023-12-19T16:17:23.478849+0000","last_became_active":"2023-12-19T16:17:22.155094+0000","last_became_peered":"2023-12-19T16:17:22.155094+0000","last_unstale":"2023-12-19T16:17:23.478849+0000","last_undegraded":"2023-12-19T16:17:23.478849+0000","last_fullsized":"2023-12-19T16:17:23.478849+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135072+0000","last_change":"2023-12-19T16:17:22.151796+0000","last_active":"2023-12-19T16:17:23.135072+0000","last_peered":"2023-12-19T16:17:23.135072+0000","last_clean":"2023-12-19T16:17:23.135072+0000","last_became_active":"2023-12-19T16:17:22.151376+0000","last_became_peered":"2023-12-19T16:17:22.151376+0000","last_unstale":"2023-12-19T16:17:23.135072+0000","last_undegraded":"2023-12-19T16:17:23.135072+0000","last_fullsized":"2023-12-19T16:17:23.135072+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479227+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:23.479227+0000","last_peered":"2023-12-19T16:17:23.479227+0000","last_clean":"2023-12-19T16:17:23.479227+0000","last_became_active":"2023-12-19T16:17:22.148854+0000","last_became_peered":"2023-12-19T16:17:22.148854+0000","last_unstale":"2023-12-19T16:17:23.479227+0000","last_undegraded":"2023-12-19T16:17:23.479227+0000","last_fullsized":"2023-12-19T16:17:23.479227+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:48:36.076596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474519+0000","last_change":"2023-12-19T16:17:22.153271+0000","last_active":"2023-12-19T16:17:22.474519+0000","last_peered":"2023-12-19T16:17:22.474519+0000","last_clean":"2023-12-19T16:17:22.474519+0000","last_became_active":"2023-12-19T16:17:22.152741+0000","last_became_peered":"2023-12-19T16:17:22.152741+0000","last_unstale":"2023-12-19T16:17:22.474519+0000","last_undegraded":"2023-12-19T16:17:22.474519+0000","last_fullsized":"2023-12-19T16:17:22.474519+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:22.185982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478785+0000","last_change":"2023-12-19T16:17:22.146150+0000","last_active":"2023-12-19T16:17:23.478785+0000","last_peered":"2023-12-19T16:17:23.478785+0000","last_clean":"2023-12-19T16:17:23.478785+0000","last_became_active":"2023-12-19T16:17:22.145911+0000","last_became_peered":"2023-12-19T16:17:22.145911+0000","last_unstale":"2023-12-19T16:17:23.478785+0000","last_undegraded":"2023-12-19T16:17:23.478785+0000","last_fullsized":"2023-12-19T16:17:23.478785+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474669+0000","last_change":"2023-12-19T16:17:22.159277+0000","last_active":"2023-12-19T16:17:22.474669+0000","last_peered":"2023-12-19T16:17:22.474669+0000","last_clean":"2023-12-19T16:17:22.474669+0000","last_became_active":"2023-12-19T16:17:22.157136+0000","last_became_peered":"2023-12-19T16:17:22.157136+0000","last_unstale":"2023-12-19T16:17:22.474669+0000","last_undegraded":"2023-12-19T16:17:22.474669+0000","last_fullsized":"2023-12-19T16:17:22.474669+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.978621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476455+0000","last_change":"2023-12-19T16:17:22.152378+0000","last_active":"2023-12-19T16:17:23.476455+0000","last_peered":"2023-12-19T16:17:23.476455+0000","last_clean":"2023-12-19T16:17:23.476455+0000","last_became_active":"2023-12-19T16:17:22.152125+0000","last_became_peered":"2023-12-19T16:17:22.152125+0000","last_unstale":"2023-12-19T16:17:23.476455+0000","last_undegraded":"2023-12-19T16:17:23.476455+0000","last_fullsized":"2023-12-19T16:17:23.476455+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:57:59.015795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474380+0000","last_change":"2023-12-19T16:17:22.161522+0000","last_active":"2023-12-19T16:17:22.474380+0000","last_peered":"2023-12-19T16:17:22.474380+0000","last_clean":"2023-12-19T16:17:22.474380+0000","last_became_active":"2023-12-19T16:17:22.161247+0000","last_became_peered":"2023-12-19T16:17:22.161247+0000","last_unstale":"2023-12-19T16:17:22.474380+0000","last_undegraded":"2023-12-19T16:17:22.474380+0000","last_fullsized":"2023-12-19T16:17:22.474380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:47:49.572099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474742+0000","last_change":"2023-12-19T16:17:22.164109+0000","last_active":"2023-12-19T16:17:22.474742+0000","last_peered":"2023-12-19T16:17:22.474742+0000","last_clean":"2023-12-19T16:17:22.474742+0000","last_became_active":"2023-12-19T16:17:22.163818+0000","last_became_peered":"2023-12-19T16:17:22.163818+0000","last_unstale":"2023-12-19T16:17:22.474742+0000","last_undegraded":"2023-12-19T16:17:22.474742+0000","last_fullsized":"2023-12-19T16:17:22.474742+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134509+0000","last_change":"2023-12-19T16:17:22.153317+0000","last_active":"2023-12-19T16:17:23.134509+0000","last_peered":"2023-12-19T16:17:23.134509+0000","last_clean":"2023-12-19T16:17:23.134509+0000","last_became_active":"2023-12-19T16:17:22.153006+0000","last_became_peered":"2023-12-19T16:17:22.153006+0000","last_unstale":"2023-12-19T16:17:23.134509+0000","last_undegraded":"2023-12-19T16:17:23.134509+0000","last_fullsized":"2023-12-19T16:17:23.134509+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:50.369899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474550+0000","last_change":"2023-12-19T16:17:22.162318+0000","last_active":"2023-12-19T16:17:22.474550+0000","last_peered":"2023-12-19T16:17:22.474550+0000","last_clean":"2023-12-19T16:17:22.474550+0000","last_became_active":"2023-12-19T16:17:22.161961+0000","last_became_peered":"2023-12-19T16:17:22.161961+0000","last_unstale":"2023-12-19T16:17:22.474550+0000","last_undegraded":"2023-12-19T16:17:22.474550+0000","last_fullsized":"2023-12-19T16:17:22.474550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:17.864523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134881+0000","last_change":"2023-12-19T16:17:22.147920+0000","last_active":"2023-12-19T16:17:23.134881+0000","last_peered":"2023-12-19T16:17:23.134881+0000","last_clean":"2023-12-19T16:17:23.134881+0000","last_became_active":"2023-12-19T16:17:22.147715+0000","last_became_peered":"2023-12-19T16:17:22.147715+0000","last_unstale":"2023-12-19T16:17:23.134881+0000","last_undegraded":"2023-12-19T16:17:23.134881+0000","last_fullsized":"2023-12-19T16:17:23.134881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:40:52.930407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474685+0000","last_change":"2023-12-19T16:17:22.157376+0000","last_active":"2023-12-19T16:17:22.474685+0000","last_peered":"2023-12-19T16:17:22.474685+0000","last_clean":"2023-12-19T16:17:22.474685+0000","last_became_active":"2023-12-19T16:17:22.157066+0000","last_became_peered":"2023-12-19T16:17:22.157066+0000","last_unstale":"2023-12-19T16:17:22.474685+0000","last_undegraded":"2023-12-19T16:17:22.474685+0000","last_fullsized":"2023-12-19T16:17:22.474685+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474469+0000","last_change":"2023-12-19T16:17:22.163715+0000","last_active":"2023-12-19T16:17:22.474469+0000","last_peered":"2023-12-19T16:17:22.474469+0000","last_clean":"2023-12-19T16:17:22.474469+0000","last_became_active":"2023-12-19T16:17:22.163411+0000","last_became_peered":"2023-12-19T16:17:22.163411+0000","last_unstale":"2023-12-19T16:17:22.474469+0000","last_undegraded":"2023-12-19T16:17:22.474469+0000","last_fullsized":"2023-12-19T16:17:22.474469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:41.097338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474434+0000","last_change":"2023-12-19T16:17:22.154892+0000","last_active":"2023-12-19T16:17:22.474434+0000","last_peered":"2023-12-19T16:17:22.474434+0000","last_clean":"2023-12-19T16:17:22.474434+0000","last_became_active":"2023-12-19T16:17:22.154466+0000","last_became_peered":"2023-12-19T16:17:22.154466+0000","last_unstale":"2023-12-19T16:17:22.474434+0000","last_undegraded":"2023-12-19T16:17:22.474434+0000","last_fullsized":"2023-12-19T16:17:22.474434+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:45.655780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478733+0000","last_change":"2023-12-19T16:17:22.159873+0000","last_active":"2023-12-19T16:17:23.478733+0000","last_peered":"2023-12-19T16:17:23.478733+0000","last_clean":"2023-12-19T16:17:23.478733+0000","last_became_active":"2023-12-19T16:17:22.159334+0000","last_became_peered":"2023-12-19T16:17:22.159334+0000","last_unstale":"2023-12-19T16:17:23.478733+0000","last_undegraded":"2023-12-19T16:17:23.478733+0000","last_fullsized":"2023-12-19T16:17:23.478733+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135257+0000","last_change":"2023-12-19T16:17:22.159381+0000","last_active":"2023-12-19T16:17:23.135257+0000","last_peered":"2023-12-19T16:17:23.135257+0000","last_clean":"2023-12-19T16:17:23.135257+0000","last_became_active":"2023-12-19T16:17:22.159098+0000","last_became_peered":"2023-12-19T16:17:22.159098+0000","last_unstale":"2023-12-19T16:17:23.135257+0000","last_undegraded":"2023-12-19T16:17:23.135257+0000","last_fullsized":"2023-12-19T16:17:23.135257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479255+0000","last_change":"2023-12-19T16:17:22.154775+0000","last_active":"2023-12-19T16:17:23.479255+0000","last_peered":"2023-12-19T16:17:23.479255+0000","last_clean":"2023-12-19T16:17:23.479255+0000","last_became_active":"2023-12-19T16:17:22.154030+0000","last_became_peered":"2023-12-19T16:17:22.154030+0000","last_unstale":"2023-12-19T16:17:23.479255+0000","last_undegraded":"2023-12-19T16:17:23.479255+0000","last_fullsized":"2023-12-19T16:17:23.479255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:42:55.606279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478814+0000","last_change":"2023-12-19T16:17:22.158100+0000","last_active":"2023-12-19T16:17:23.478814+0000","last_peered":"2023-12-19T16:17:23.478814+0000","last_clean":"2023-12-19T16:17:23.478814+0000","last_became_active":"2023-12-19T16:17:22.157849+0000","last_became_peered":"2023-12-19T16:17:22.157849+0000","last_unstale":"2023-12-19T16:17:23.478814+0000","last_undegraded":"2023-12-19T16:17:23.478814+0000","last_fullsized":"2023-12-19T16:17:23.478814+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134380+0000","last_change":"2023-12-19T16:17:22.157483+0000","last_active":"2023-12-19T16:17:23.134380+0000","last_peered":"2023-12-19T16:17:23.134380+0000","last_clean":"2023-12-19T16:17:23.134380+0000","last_became_active":"2023-12-19T16:17:22.157178+0000","last_became_peered":"2023-12-19T16:17:22.157178+0000","last_unstale":"2023-12-19T16:17:23.134380+0000","last_undegraded":"2023-12-19T16:17:23.134380+0000","last_fullsized":"2023-12-19T16:17:23.134380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:34.711585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474502+0000","last_change":"2023-12-19T16:17:22.152299+0000","last_active":"2023-12-19T16:17:22.474502+0000","last_peered":"2023-12-19T16:17:22.474502+0000","last_clean":"2023-12-19T16:17:22.474502+0000","last_became_active":"2023-12-19T16:17:22.151817+0000","last_became_peered":"2023-12-19T16:17:22.151817+0000","last_unstale":"2023-12-19T16:17:22.474502+0000","last_undegraded":"2023-12-19T16:17:22.474502+0000","last_fullsized":"2023-12-19T16:17:22.474502+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:34:51.175211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473465+0000","last_change":"2023-12-19T16:17:22.141954+0000","last_active":"2023-12-19T16:17:22.473465+0000","last_peered":"2023-12-19T16:17:22.473465+0000","last_clean":"2023-12-19T16:17:22.473465+0000","last_became_active":"2023-12-19T16:17:22.141589+0000","last_became_peered":"2023-12-19T16:17:22.141589+0000","last_unstale":"2023-12-19T16:17:22.473465+0000","last_undegraded":"2023-12-19T16:17:22.473465+0000","last_fullsized":"2023-12-19T16:17:22.473465+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:56.610477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476475+0000","last_change":"2023-12-19T16:17:22.142801+0000","last_active":"2023-12-19T16:17:23.476475+0000","last_peered":"2023-12-19T16:17:23.476475+0000","last_clean":"2023-12-19T16:17:23.476475+0000","last_became_active":"2023-12-19T16:17:22.142404+0000","last_became_peered":"2023-12-19T16:17:22.142404+0000","last_unstale":"2023-12-19T16:17:23.476475+0000","last_undegraded":"2023-12-19T16:17:23.476475+0000","last_fullsized":"2023-12-19T16:17:23.476475+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:43:37.679998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134630+0000","last_change":"2023-12-19T16:17:22.155898+0000","last_active":"2023-12-19T16:17:23.134630+0000","last_peered":"2023-12-19T16:17:23.134630+0000","last_clean":"2023-12-19T16:17:23.134630+0000","last_became_active":"2023-12-19T16:17:22.155625+0000","last_became_peered":"2023-12-19T16:17:22.155625+0000","last_unstale":"2023-12-19T16:17:23.134630+0000","last_undegraded":"2023-12-19T16:17:23.134630+0000","last_fullsized":"2023-12-19T16:17:23.134630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478867+0000","last_change":"2023-12-19T16:17:22.155675+0000","last_active":"2023-12-19T16:17:23.478867+0000","last_peered":"2023-12-19T16:17:23.478867+0000","last_clean":"2023-12-19T16:17:23.478867+0000","last_became_active":"2023-12-19T16:17:22.154831+0000","last_became_peered":"2023-12-19T16:17:22.154831+0000","last_unstale":"2023-12-19T16:17:23.478867+0000","last_undegraded":"2023-12-19T16:17:23.478867+0000","last_fullsized":"2023-12-19T16:17:23.478867+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474583+0000","last_change":"2023-12-19T16:17:22.161976+0000","last_active":"2023-12-19T16:17:22.474583+0000","last_peered":"2023-12-19T16:17:22.474583+0000","last_clean":"2023-12-19T16:17:22.474583+0000","last_became_active":"2023-12-19T16:17:22.161253+0000","last_became_peered":"2023-12-19T16:17:22.161253+0000","last_unstale":"2023-12-19T16:17:22.474583+0000","last_undegraded":"2023-12-19T16:17:22.474583+0000","last_fullsized":"2023-12-19T16:17:22.474583+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476569+0000","last_change":"2023-12-19T16:17:22.133581+0000","last_active":"2023-12-19T16:17:23.476569+0000","last_peered":"2023-12-19T16:17:23.476569+0000","last_clean":"2023-12-19T16:17:23.476569+0000","last_became_active":"2023-12-19T16:17:22.133306+0000","last_became_peered":"2023-12-19T16:17:22.133306+0000","last_unstale":"2023-12-19T16:17:23.476569+0000","last_undegraded":"2023-12-19T16:17:23.476569+0000","last_fullsized":"2023-12-19T16:17:23.476569+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:59:40.258684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476539+0000","last_change":"2023-12-19T16:17:22.139797+0000","last_active":"2023-12-19T16:17:23.476539+0000","last_peered":"2023-12-19T16:17:23.476539+0000","last_clean":"2023-12-19T16:17:23.476539+0000","last_became_active":"2023-12-19T16:17:22.139565+0000","last_became_peered":"2023-12-19T16:17:22.139565+0000","last_unstale":"2023-12-19T16:17:23.476539+0000","last_undegraded":"2023-12-19T16:17:23.476539+0000","last_fullsized":"2023-12-19T16:17:23.476539+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:37:15.932295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478794+0000","last_change":"2023-12-19T16:17:22.145631+0000","last_active":"2023-12-19T16:17:23.478794+0000","last_peered":"2023-12-19T16:17:23.478794+0000","last_clean":"2023-12-19T16:17:23.478794+0000","last_became_active":"2023-12-19T16:17:22.145292+0000","last_became_peered":"2023-12-19T16:17:22.145292+0000","last_unstale":"2023-12-19T16:17:23.478794+0000","last_undegraded":"2023-12-19T16:17:23.478794+0000","last_fullsized":"2023-12-19T16:17:23.478794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134641+0000","last_change":"2023-12-19T16:17:22.142912+0000","last_active":"2023-12-19T16:17:23.134641+0000","last_peered":"2023-12-19T16:17:23.134641+0000","last_clean":"2023-12-19T16:17:23.134641+0000","last_became_active":"2023-12-19T16:17:22.142631+0000","last_became_peered":"2023-12-19T16:17:22.142631+0000","last_unstale":"2023-12-19T16:17:23.134641+0000","last_undegraded":"2023-12-19T16:17:23.134641+0000","last_fullsized":"2023-12-19T16:17:23.134641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:16.987791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474634+0000","last_change":"2023-12-19T16:17:22.158179+0000","last_active":"2023-12-19T16:17:22.474634+0000","last_peered":"2023-12-19T16:17:22.474634+0000","last_clean":"2023-12-19T16:17:22.474634+0000","last_became_active":"2023-12-19T16:17:22.157886+0000","last_became_peered":"2023-12-19T16:17:22.157886+0000","last_unstale":"2023-12-19T16:17:22.474634+0000","last_undegraded":"2023-12-19T16:17:22.474634+0000","last_fullsized":"2023-12-19T16:17:22.474634+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:09:35.956464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474401+0000","last_change":"2023-12-19T16:17:22.151320+0000","last_active":"2023-12-19T16:17:22.474401+0000","last_peered":"2023-12-19T16:17:22.474401+0000","last_clean":"2023-12-19T16:17:22.474401+0000","last_became_active":"2023-12-19T16:17:22.150541+0000","last_became_peered":"2023-12-19T16:17:22.150541+0000","last_unstale":"2023-12-19T16:17:22.474401+0000","last_undegraded":"2023-12-19T16:17:22.474401+0000","last_fullsized":"2023-12-19T16:17:22.474401+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:28.033745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473522+0000","last_change":"2023-12-19T16:17:22.149896+0000","last_active":"2023-12-19T16:17:22.473522+0000","last_peered":"2023-12-19T16:17:22.473522+0000","last_clean":"2023-12-19T16:17:22.473522+0000","last_became_active":"2023-12-19T16:17:22.149454+0000","last_became_peered":"2023-12-19T16:17:22.149454+0000","last_unstale":"2023-12-19T16:17:22.473522+0000","last_undegraded":"2023-12-19T16:17:22.473522+0000","last_fullsized":"2023-12-19T16:17:22.473522+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:45.196163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474751+0000","last_change":"2023-12-19T16:17:21.757846+0000","last_active":"2023-12-19T16:17:22.474751+0000","last_peered":"2023-12-19T16:17:22.474751+0000","last_clean":"2023-12-19T16:17:22.474751+0000","last_became_active":"2023-12-19T16:17:21.757491+0000","last_became_peered":"2023-12-19T16:17:21.757491+0000","last_unstale":"2023-12-19T16:17:22.474751+0000","last_undegraded":"2023-12-19T16:17:22.474751+0000","last_fullsized":"2023-12-19T16:17:22.474751+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478882+0000","last_change":"2023-12-19T16:17:22.158007+0000","last_active":"2023-12-19T16:17:23.478882+0000","last_peered":"2023-12-19T16:17:23.478882+0000","last_clean":"2023-12-19T16:17:23.478882+0000","last_became_active":"2023-12-19T16:17:22.157731+0000","last_became_peered":"2023-12-19T16:17:22.157731+0000","last_unstale":"2023-12-19T16:17:23.478882+0000","last_undegraded":"2023-12-19T16:17:23.478882+0000","last_fullsized":"2023-12-19T16:17:23.478882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476599+0000","last_change":"2023-12-19T16:17:21.755136+0000","last_active":"2023-12-19T16:17:23.476599+0000","last_peered":"2023-12-19T16:17:23.476599+0000","last_clean":"2023-12-19T16:17:23.476599+0000","last_became_active":"2023-12-19T16:17:21.754811+0000","last_became_peered":"2023-12-19T16:17:21.754811+0000","last_unstale":"2023-12-19T16:17:23.476599+0000","last_undegraded":"2023-12-19T16:17:23.476599+0000","last_fullsized":"2023-12-19T16:17:23.476599+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:21.178496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134945+0000","last_change":"2023-12-19T16:17:22.151779+0000","last_active":"2023-12-19T16:17:23.134945+0000","last_peered":"2023-12-19T16:17:23.134945+0000","last_clean":"2023-12-19T16:17:23.134945+0000","last_became_active":"2023-12-19T16:17:22.151531+0000","last_became_peered":"2023-12-19T16:17:22.151531+0000","last_unstale":"2023-12-19T16:17:23.134945+0000","last_undegraded":"2023-12-19T16:17:23.134945+0000","last_fullsized":"2023-12-19T16:17:23.134945+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:32.295566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474731+0000","last_change":"2023-12-19T16:17:21.756962+0000","last_active":"2023-12-19T16:17:22.474731+0000","last_peered":"2023-12-19T16:17:22.474731+0000","last_clean":"2023-12-19T16:17:22.474731+0000","last_became_active":"2023-12-19T16:17:21.756429+0000","last_became_peered":"2023-12-19T16:17:21.756429+0000","last_unstale":"2023-12-19T16:17:22.474731+0000","last_undegraded":"2023-12-19T16:17:22.474731+0000","last_fullsized":"2023-12-19T16:17:22.474731+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474566+0000","last_change":"2023-12-19T16:17:22.151997+0000","last_active":"2023-12-19T16:17:22.474566+0000","last_peered":"2023-12-19T16:17:22.474566+0000","last_clean":"2023-12-19T16:17:22.474566+0000","last_became_active":"2023-12-19T16:17:22.151660+0000","last_became_peered":"2023-12-19T16:17:22.151660+0000","last_unstale":"2023-12-19T16:17:22.474566+0000","last_undegraded":"2023-12-19T16:17:22.474566+0000","last_fullsized":"2023-12-19T16:17:22.474566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:08.218394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476556+0000","last_change":"2023-12-19T16:17:21.751163+0000","last_active":"2023-12-19T16:17:23.476556+0000","last_peered":"2023-12-19T16:17:23.476556+0000","last_clean":"2023-12-19T16:17:23.476556+0000","last_became_active":"2023-12-19T16:17:21.750841+0000","last_became_peered":"2023-12-19T16:17:21.750841+0000","last_unstale":"2023-12-19T16:17:23.476556+0000","last_undegraded":"2023-12-19T16:17:23.476556+0000","last_fullsized":"2023-12-19T16:17:23.476556+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:13.969787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476483+0000","last_change":"2023-12-19T16:17:22.138939+0000","last_active":"2023-12-19T16:17:23.476483+0000","last_peered":"2023-12-19T16:17:23.476483+0000","last_clean":"2023-12-19T16:17:23.476483+0000","last_became_active":"2023-12-19T16:17:22.136474+0000","last_became_peered":"2023-12-19T16:17:22.136474+0000","last_unstale":"2023-12-19T16:17:23.476483+0000","last_undegraded":"2023-12-19T16:17:23.476483+0000","last_fullsized":"2023-12-19T16:17:23.476483+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:10.979687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474708+0000","last_change":"2023-12-19T16:17:21.761909+0000","last_active":"2023-12-19T16:17:22.474708+0000","last_peered":"2023-12-19T16:17:22.474708+0000","last_clean":"2023-12-19T16:17:22.474708+0000","last_became_active":"2023-12-19T16:17:21.761644+0000","last_became_peered":"2023-12-19T16:17:21.761644+0000","last_unstale":"2023-12-19T16:17:22.474708+0000","last_undegraded":"2023-12-19T16:17:22.474708+0000","last_fullsized":"2023-12-19T16:17:22.474708+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134645+0000","last_change":"2023-12-19T16:17:22.153558+0000","last_active":"2023-12-19T16:17:23.134645+0000","last_peered":"2023-12-19T16:17:23.134645+0000","last_clean":"2023-12-19T16:17:23.134645+0000","last_became_active":"2023-12-19T16:17:22.152909+0000","last_became_peered":"2023-12-19T16:17:22.152909+0000","last_unstale":"2023-12-19T16:17:23.134645+0000","last_undegraded":"2023-12-19T16:17:23.134645+0000","last_fullsized":"2023-12-19T16:17:23.134645+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:57.793528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476498+0000","last_change":"2023-12-19T16:17:21.752834+0000","last_active":"2023-12-19T16:17:23.476498+0000","last_peered":"2023-12-19T16:17:23.476498+0000","last_clean":"2023-12-19T16:17:23.476498+0000","last_became_active":"2023-12-19T16:17:21.751522+0000","last_became_peered":"2023-12-19T16:17:21.751522+0000","last_unstale":"2023-12-19T16:17:23.476498+0000","last_undegraded":"2023-12-19T16:17:23.476498+0000","last_fullsized":"2023-12-19T16:17:23.476498+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:27.026260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134075+0000","last_change":"2023-12-19T16:17:22.145103+0000","last_active":"2023-12-19T16:17:23.134075+0000","last_peered":"2023-12-19T16:17:23.134075+0000","last_clean":"2023-12-19T16:17:23.134075+0000","last_became_active":"2023-12-19T16:17:22.144731+0000","last_became_peered":"2023-12-19T16:17:22.144731+0000","last_unstale":"2023-12-19T16:17:23.134075+0000","last_undegraded":"2023-12-19T16:17:23.134075+0000","last_fullsized":"2023-12-19T16:17:23.134075+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:13:13.842974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478752+0000","last_change":"2023-12-19T16:17:21.757958+0000","last_active":"2023-12-19T16:17:23.478752+0000","last_peered":"2023-12-19T16:17:23.478752+0000","last_clean":"2023-12-19T16:17:23.478752+0000","last_became_active":"2023-12-19T16:17:21.757638+0000","last_became_peered":"2023-12-19T16:17:21.757638+0000","last_unstale":"2023-12-19T16:17:23.478752+0000","last_undegraded":"2023-12-19T16:17:23.478752+0000","last_fullsized":"2023-12-19T16:17:23.478752+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476466+0000","last_change":"2023-12-19T16:17:22.146956+0000","last_active":"2023-12-19T16:17:23.476466+0000","last_peered":"2023-12-19T16:17:23.476466+0000","last_clean":"2023-12-19T16:17:23.476466+0000","last_became_active":"2023-12-19T16:17:22.146235+0000","last_became_peered":"2023-12-19T16:17:22.146235+0000","last_unstale":"2023-12-19T16:17:23.476466+0000","last_undegraded":"2023-12-19T16:17:23.476466+0000","last_fullsized":"2023-12-19T16:17:23.476466+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:40.626111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.135031+0000","last_change":"2023-12-19T16:17:21.761882+0000","last_active":"2023-12-19T16:17:22.135031+0000","last_peered":"2023-12-19T16:17:22.135031+0000","last_clean":"2023-12-19T16:17:22.135031+0000","last_became_active":"2023-12-19T16:17:21.761601+0000","last_became_peered":"2023-12-19T16:17:21.761601+0000","last_unstale":"2023-12-19T16:17:22.135031+0000","last_undegraded":"2023-12-19T16:17:22.135031+0000","last_fullsized":"2023-12-19T16:17:22.135031+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:00.332402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479265+0000","last_change":"2023-12-19T16:17:22.136135+0000","last_active":"2023-12-19T16:17:23.479265+0000","last_peered":"2023-12-19T16:17:23.479265+0000","last_clean":"2023-12-19T16:17:23.479265+0000","last_became_active":"2023-12-19T16:17:22.135881+0000","last_became_peered":"2023-12-19T16:17:22.135881+0000","last_unstale":"2023-12-19T16:17:23.479265+0000","last_undegraded":"2023-12-19T16:17:23.479265+0000","last_fullsized":"2023-12-19T16:17:23.479265+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:46.895243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479299+0000","last_change":"2023-12-19T16:17:21.758331+0000","last_active":"2023-12-19T16:17:23.479299+0000","last_peered":"2023-12-19T16:17:23.479299+0000","last_clean":"2023-12-19T16:17:23.479299+0000","last_became_active":"2023-12-19T16:17:21.758062+0000","last_became_peered":"2023-12-19T16:17:21.758062+0000","last_unstale":"2023-12-19T16:17:23.479299+0000","last_undegraded":"2023-12-19T16:17:23.479299+0000","last_fullsized":"2023-12-19T16:17:23.479299+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:56:16.429059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479283+0000","last_change":"2023-12-19T16:17:22.157415+0000","last_active":"2023-12-19T16:17:23.479283+0000","last_peered":"2023-12-19T16:17:23.479283+0000","last_clean":"2023-12-19T16:17:23.479283+0000","last_became_active":"2023-12-19T16:17:22.157175+0000","last_became_peered":"2023-12-19T16:17:22.157175+0000","last_unstale":"2023-12-19T16:17:23.479283+0000","last_undegraded":"2023-12-19T16:17:23.479283+0000","last_fullsized":"2023-12-19T16:17:23.479283+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:35.693932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.135260+0000","last_change":"2023-12-19T16:17:21.754377+0000","last_active":"2023-12-19T16:17:22.135260+0000","last_peered":"2023-12-19T16:17:22.135260+0000","last_clean":"2023-12-19T16:17:22.135260+0000","last_became_active":"2023-12-19T16:17:21.753596+0000","last_became_peered":"2023-12-19T16:17:21.753596+0000","last_unstale":"2023-12-19T16:17:22.135260+0000","last_undegraded":"2023-12-19T16:17:22.135260+0000","last_fullsized":"2023-12-19T16:17:22.135260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:36:58.556696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474534+0000","last_change":"2023-12-19T16:17:22.164149+0000","last_active":"2023-12-19T16:17:22.474534+0000","last_peered":"2023-12-19T16:17:22.474534+0000","last_clean":"2023-12-19T16:17:22.474534+0000","last_became_active":"2023-12-19T16:17:22.163873+0000","last_became_peered":"2023-12-19T16:17:22.163873+0000","last_unstale":"2023-12-19T16:17:22.474534+0000","last_undegraded":"2023-12-19T16:17:22.474534+0000","last_fullsized":"2023-12-19T16:17:22.474534+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:14.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.135051+0000","last_change":"2023-12-19T16:17:21.760196+0000","last_active":"2023-12-19T16:17:23.135051+0000","last_peered":"2023-12-19T16:17:23.135051+0000","last_clean":"2023-12-19T16:17:23.135051+0000","last_became_active":"2023-12-19T16:17:21.759918+0000","last_became_peered":"2023-12-19T16:17:21.759918+0000","last_unstale":"2023-12-19T16:17:23.135051+0000","last_undegraded":"2023-12-19T16:17:23.135051+0000","last_fullsized":"2023-12-19T16:17:23.135051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476578+0000","last_change":"2023-12-19T16:17:22.156495+0000","last_active":"2023-12-19T16:17:23.476578+0000","last_peered":"2023-12-19T16:17:23.476578+0000","last_clean":"2023-12-19T16:17:23.476578+0000","last_became_active":"2023-12-19T16:17:22.156228+0000","last_became_peered":"2023-12-19T16:17:22.156228+0000","last_unstale":"2023-12-19T16:17:23.476578+0000","last_undegraded":"2023-12-19T16:17:23.476578+0000","last_fullsized":"2023-12-19T16:17:23.476578+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:36.662860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"51'6","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.168667+0000","last_change":"2023-12-19T16:17:21.751341+0000","last_active":"2023-12-19T16:17:22.168667+0000","last_peered":"2023-12-19T16:17:22.168667+0000","last_clean":"2023-12-19T16:17:22.168667+0000","last_became_active":"2023-12-19T16:17:21.749357+0000","last_became_peered":"2023-12-19T16:17:21.749357+0000","last_unstale":"2023-12-19T16:17:22.168667+0000","last_undegraded":"2023-12-19T16:17:22.168667+0000","last_fullsized":"2023-12-19T16:17:22.168667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:00:55.965298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479216+0000","last_change":"2023-12-19T16:17:22.157237+0000","last_active":"2023-12-19T16:17:23.479216+0000","last_peered":"2023-12-19T16:17:23.479216+0000","last_clean":"2023-12-19T16:17:23.479216+0000","last_became_active":"2023-12-19T16:17:22.156973+0000","last_became_peered":"2023-12-19T16:17:22.156973+0000","last_unstale":"2023-12-19T16:17:23.479216+0000","last_undegraded":"2023-12-19T16:17:23.479216+0000","last_fullsized":"2023-12-19T16:17:23.479216+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:23:31.895567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473484+0000","last_change":"2023-12-19T16:17:21.761048+0000","last_active":"2023-12-19T16:17:22.473484+0000","last_peered":"2023-12-19T16:17:22.473484+0000","last_clean":"2023-12-19T16:17:22.473484+0000","last_became_active":"2023-12-19T16:17:21.758547+0000","last_became_peered":"2023-12-19T16:17:21.758547+0000","last_unstale":"2023-12-19T16:17:22.473484+0000","last_undegraded":"2023-12-19T16:17:22.473484+0000","last_fullsized":"2023-12-19T16:17:22.473484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:15.170420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473474+0000","last_change":"2023-12-19T16:17:22.141474+0000","last_active":"2023-12-19T16:17:22.473474+0000","last_peered":"2023-12-19T16:17:22.473474+0000","last_clean":"2023-12-19T16:17:22.473474+0000","last_became_active":"2023-12-19T16:17:22.141183+0000","last_became_peered":"2023-12-19T16:17:22.141183+0000","last_unstale":"2023-12-19T16:17:22.473474+0000","last_undegraded":"2023-12-19T16:17:22.473474+0000","last_fullsized":"2023-12-19T16:17:22.473474+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:10.623748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478774+0000","last_change":"2023-12-19T16:17:21.743866+0000","last_active":"2023-12-19T16:17:23.478774+0000","last_peered":"2023-12-19T16:17:23.478774+0000","last_clean":"2023-12-19T16:17:23.478774+0000","last_became_active":"2023-12-19T16:17:21.743597+0000","last_became_peered":"2023-12-19T16:17:21.743597+0000","last_unstale":"2023-12-19T16:17:23.478774+0000","last_undegraded":"2023-12-19T16:17:23.478774+0000","last_fullsized":"2023-12-19T16:17:23.478774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473439+0000","last_change":"2023-12-19T16:17:22.149800+0000","last_active":"2023-12-19T16:17:22.473439+0000","last_peered":"2023-12-19T16:17:22.473439+0000","last_clean":"2023-12-19T16:17:22.473439+0000","last_became_active":"2023-12-19T16:17:22.149385+0000","last_became_peered":"2023-12-19T16:17:22.149385+0000","last_unstale":"2023-12-19T16:17:22.473439+0000","last_undegraded":"2023-12-19T16:17:22.473439+0000","last_fullsized":"2023-12-19T16:17:22.473439+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:57.924303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474648+0000","last_change":"2023-12-19T16:17:21.761964+0000","last_active":"2023-12-19T16:17:22.474648+0000","last_peered":"2023-12-19T16:17:22.474648+0000","last_clean":"2023-12-19T16:17:22.474648+0000","last_became_active":"2023-12-19T16:17:21.760304+0000","last_became_peered":"2023-12-19T16:17:21.760304+0000","last_unstale":"2023-12-19T16:17:22.474648+0000","last_undegraded":"2023-12-19T16:17:22.474648+0000","last_fullsized":"2023-12-19T16:17:22.474648+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:53:44.188677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134631+0000","last_change":"2023-12-19T16:17:22.148063+0000","last_active":"2023-12-19T16:17:23.134631+0000","last_peered":"2023-12-19T16:17:23.134631+0000","last_clean":"2023-12-19T16:17:23.134631+0000","last_became_active":"2023-12-19T16:17:22.147442+0000","last_became_peered":"2023-12-19T16:17:22.147442+0000","last_unstale":"2023-12-19T16:17:23.134631+0000","last_undegraded":"2023-12-19T16:17:23.134631+0000","last_fullsized":"2023-12-19T16:17:23.134631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:26.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"51'8","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166480+0000","last_change":"2023-12-19T16:17:21.753744+0000","last_active":"2023-12-19T16:17:22.166480+0000","last_peered":"2023-12-19T16:17:22.166480+0000","last_clean":"2023-12-19T16:17:22.166480+0000","last_became_active":"2023-12-19T16:17:21.753526+0000","last_became_peered":"2023-12-19T16:17:21.753526+0000","last_unstale":"2023-12-19T16:17:22.166480+0000","last_undegraded":"2023-12-19T16:17:22.166480+0000","last_fullsized":"2023-12-19T16:17:22.166480+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.247710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473531+0000","last_change":"2023-12-19T16:17:22.140926+0000","last_active":"2023-12-19T16:17:22.473531+0000","last_peered":"2023-12-19T16:17:22.473531+0000","last_clean":"2023-12-19T16:17:22.473531+0000","last_became_active":"2023-12-19T16:17:22.140652+0000","last_became_peered":"2023-12-19T16:17:22.140652+0000","last_unstale":"2023-12-19T16:17:22.473531+0000","last_undegraded":"2023-12-19T16:17:22.473531+0000","last_fullsized":"2023-12-19T16:17:22.473531+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:29.710944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474629+0000","last_change":"2023-12-19T16:17:21.761218+0000","last_active":"2023-12-19T16:17:22.474629+0000","last_peered":"2023-12-19T16:17:22.474629+0000","last_clean":"2023-12-19T16:17:22.474629+0000","last_became_active":"2023-12-19T16:17:21.760858+0000","last_became_peered":"2023-12-19T16:17:21.760858+0000","last_unstale":"2023-12-19T16:17:22.474629+0000","last_undegraded":"2023-12-19T16:17:22.474629+0000","last_fullsized":"2023-12-19T16:17:22.474629+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:42:28.703458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473542+0000","last_change":"2023-12-19T16:17:22.148334+0000","last_active":"2023-12-19T16:17:22.473542+0000","last_peered":"2023-12-19T16:17:22.473542+0000","last_clean":"2023-12-19T16:17:22.473542+0000","last_became_active":"2023-12-19T16:17:22.148036+0000","last_became_peered":"2023-12-19T16:17:22.148036+0000","last_unstale":"2023-12-19T16:17:22.473542+0000","last_undegraded":"2023-12-19T16:17:22.473542+0000","last_fullsized":"2023-12-19T16:17:22.473542+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:57.733309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479274+0000","last_change":"2023-12-19T16:17:21.759281+0000","last_active":"2023-12-19T16:17:23.479274+0000","last_peered":"2023-12-19T16:17:23.479274+0000","last_clean":"2023-12-19T16:17:23.479274+0000","last_became_active":"2023-12-19T16:17:21.758854+0000","last_became_peered":"2023-12-19T16:17:21.758854+0000","last_unstale":"2023-12-19T16:17:23.479274+0000","last_undegraded":"2023-12-19T16:17:23.479274+0000","last_fullsized":"2023-12-19T16:17:23.479274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:43.061583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134967+0000","last_change":"2023-12-19T16:17:22.157996+0000","last_active":"2023-12-19T16:17:23.134967+0000","last_peered":"2023-12-19T16:17:23.134967+0000","last_clean":"2023-12-19T16:17:23.134967+0000","last_became_active":"2023-12-19T16:17:22.157742+0000","last_became_peered":"2023-12-19T16:17:22.157742+0000","last_unstale":"2023-12-19T16:17:23.134967+0000","last_undegraded":"2023-12-19T16:17:23.134967+0000","last_fullsized":"2023-12-19T16:17:23.134967+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:29.818578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479245+0000","last_change":"2023-12-19T16:17:21.755379+0000","last_active":"2023-12-19T16:17:23.479245+0000","last_peered":"2023-12-19T16:17:23.479245+0000","last_clean":"2023-12-19T16:17:23.479245+0000","last_became_active":"2023-12-19T16:17:21.754564+0000","last_became_peered":"2023-12-19T16:17:21.754564+0000","last_unstale":"2023-12-19T16:17:23.479245+0000","last_undegraded":"2023-12-19T16:17:23.479245+0000","last_fullsized":"2023-12-19T16:17:23.479245+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:11.726871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479236+0000","last_change":"2023-12-19T16:17:22.149125+0000","last_active":"2023-12-19T16:17:23.479236+0000","last_peered":"2023-12-19T16:17:23.479236+0000","last_clean":"2023-12-19T16:17:23.479236+0000","last_became_active":"2023-12-19T16:17:22.148868+0000","last_became_peered":"2023-12-19T16:17:22.148868+0000","last_unstale":"2023-12-19T16:17:23.479236+0000","last_undegraded":"2023-12-19T16:17:23.479236+0000","last_fullsized":"2023-12-19T16:17:23.479236+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:14.946456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474718+0000","last_change":"2023-12-19T16:17:21.763539+0000","last_active":"2023-12-19T16:17:22.474718+0000","last_peered":"2023-12-19T16:17:22.474718+0000","last_clean":"2023-12-19T16:17:22.474718+0000","last_became_active":"2023-12-19T16:17:21.763131+0000","last_became_peered":"2023-12-19T16:17:21.763131+0000","last_unstale":"2023-12-19T16:17:22.474718+0000","last_undegraded":"2023-12-19T16:17:22.474718+0000","last_fullsized":"2023-12-19T16:17:22.474718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:07:56.725824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134519+0000","last_change":"2023-12-19T16:17:22.163218+0000","last_active":"2023-12-19T16:17:23.134519+0000","last_peered":"2023-12-19T16:17:23.134519+0000","last_clean":"2023-12-19T16:17:23.134519+0000","last_became_active":"2023-12-19T16:17:22.162902+0000","last_became_peered":"2023-12-19T16:17:22.162902+0000","last_unstale":"2023-12-19T16:17:23.134519+0000","last_undegraded":"2023-12-19T16:17:23.134519+0000","last_fullsized":"2023-12-19T16:17:23.134519+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:26.504508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.166273+0000","last_change":"2023-12-19T16:17:21.753800+0000","last_active":"2023-12-19T16:17:22.166273+0000","last_peered":"2023-12-19T16:17:22.166273+0000","last_clean":"2023-12-19T16:17:22.166273+0000","last_became_active":"2023-12-19T16:17:21.753296+0000","last_became_peered":"2023-12-19T16:17:21.753296+0000","last_unstale":"2023-12-19T16:17:22.166273+0000","last_undegraded":"2023-12-19T16:17:22.166273+0000","last_fullsized":"2023-12-19T16:17:22.166273+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:01:04.206228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474697+0000","last_change":"2023-12-19T16:17:22.157501+0000","last_active":"2023-12-19T16:17:22.474697+0000","last_peered":"2023-12-19T16:17:22.474697+0000","last_clean":"2023-12-19T16:17:22.474697+0000","last_became_active":"2023-12-19T16:17:22.157209+0000","last_became_peered":"2023-12-19T16:17:22.157209+0000","last_unstale":"2023-12-19T16:17:22.474697+0000","last_undegraded":"2023-12-19T16:17:22.474697+0000","last_fullsized":"2023-12-19T16:17:22.474697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:53:22.093772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478764+0000","last_change":"2023-12-19T16:17:21.751942+0000","last_active":"2023-12-19T16:17:23.478764+0000","last_peered":"2023-12-19T16:17:23.478764+0000","last_clean":"2023-12-19T16:17:23.478764+0000","last_became_active":"2023-12-19T16:17:21.751600+0000","last_became_peered":"2023-12-19T16:17:21.751600+0000","last_unstale":"2023-12-19T16:17:23.478764+0000","last_undegraded":"2023-12-19T16:17:23.478764+0000","last_fullsized":"2023-12-19T16:17:23.478764+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:47.234683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474418+0000","last_change":"2023-12-19T16:17:22.152347+0000","last_active":"2023-12-19T16:17:22.474418+0000","last_peered":"2023-12-19T16:17:22.474418+0000","last_clean":"2023-12-19T16:17:22.474418+0000","last_became_active":"2023-12-19T16:17:22.151834+0000","last_became_peered":"2023-12-19T16:17:22.151834+0000","last_unstale":"2023-12-19T16:17:22.474418+0000","last_undegraded":"2023-12-19T16:17:22.474418+0000","last_fullsized":"2023-12-19T16:17:22.474418+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:47:24.644411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.134692+0000","last_change":"2023-12-19T16:17:21.743863+0000","last_active":"2023-12-19T16:17:22.134692+0000","last_peered":"2023-12-19T16:17:22.134692+0000","last_clean":"2023-12-19T16:17:22.134692+0000","last_became_active":"2023-12-19T16:17:21.743484+0000","last_became_peered":"2023-12-19T16:17:21.743484+0000","last_unstale":"2023-12-19T16:17:22.134692+0000","last_undegraded":"2023-12-19T16:17:22.134692+0000","last_fullsized":"2023-12-19T16:17:22.134692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:12.482591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474450+0000","last_change":"2023-12-19T16:17:22.151111+0000","last_active":"2023-12-19T16:17:22.474450+0000","last_peered":"2023-12-19T16:17:22.474450+0000","last_clean":"2023-12-19T16:17:22.474450+0000","last_became_active":"2023-12-19T16:17:22.150803+0000","last_became_peered":"2023-12-19T16:17:22.150803+0000","last_unstale":"2023-12-19T16:17:22.474450+0000","last_undegraded":"2023-12-19T16:17:22.474450+0000","last_fullsized":"2023-12-19T16:17:22.474450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:25:54.987456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476438+0000","last_change":"2023-12-19T16:17:21.756215+0000","last_active":"2023-12-19T16:17:23.476438+0000","last_peered":"2023-12-19T16:17:23.476438+0000","last_clean":"2023-12-19T16:17:23.476438+0000","last_became_active":"2023-12-19T16:17:21.755911+0000","last_became_peered":"2023-12-19T16:17:21.755911+0000","last_unstale":"2023-12-19T16:17:23.476438+0000","last_undegraded":"2023-12-19T16:17:23.476438+0000","last_fullsized":"2023-12-19T16:17:23.476438+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:21:40.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476608+0000","last_change":"2023-12-19T16:17:22.156498+0000","last_active":"2023-12-19T16:17:23.476608+0000","last_peered":"2023-12-19T16:17:23.476608+0000","last_clean":"2023-12-19T16:17:23.476608+0000","last_became_active":"2023-12-19T16:17:22.156255+0000","last_became_peered":"2023-12-19T16:17:22.156255+0000","last_unstale":"2023-12-19T16:17:23.476608+0000","last_undegraded":"2023-12-19T16:17:23.476608+0000","last_fullsized":"2023-12-19T16:17:23.476608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:19:06.241133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"52'1","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.550199+0000","last_change":"2023-12-19T16:17:21.758755+0000","last_active":"2023-12-19T16:17:23.550199+0000","last_peered":"2023-12-19T16:17:23.550199+0000","last_clean":"2023-12-19T16:17:23.550199+0000","last_became_active":"2023-12-19T16:17:21.758489+0000","last_became_peered":"2023-12-19T16:17:21.758489+0000","last_unstale":"2023-12-19T16:17:23.550199+0000","last_undegraded":"2023-12-19T16:17:23.550199+0000","last_fullsized":"2023-12-19T16:17:23.550199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:47:55.602991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134483+0000","last_change":"2023-12-19T16:17:22.144930+0000","last_active":"2023-12-19T16:17:23.134483+0000","last_peered":"2023-12-19T16:17:23.134483+0000","last_clean":"2023-12-19T16:17:23.134483+0000","last_became_active":"2023-12-19T16:17:22.144655+0000","last_became_peered":"2023-12-19T16:17:22.144655+0000","last_unstale":"2023-12-19T16:17:23.134483+0000","last_undegraded":"2023-12-19T16:17:23.134483+0000","last_fullsized":"2023-12-19T16:17:23.134483+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:18.552579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478831+0000","last_change":"2023-12-19T16:17:21.756779+0000","last_active":"2023-12-19T16:17:23.478831+0000","last_peered":"2023-12-19T16:17:23.478831+0000","last_clean":"2023-12-19T16:17:23.478831+0000","last_became_active":"2023-12-19T16:17:21.756421+0000","last_became_peered":"2023-12-19T16:17:21.756421+0000","last_unstale":"2023-12-19T16:17:23.478831+0000","last_undegraded":"2023-12-19T16:17:23.478831+0000","last_fullsized":"2023-12-19T16:17:23.478831+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:09.616262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476587+0000","last_change":"2023-12-19T16:17:22.156581+0000","last_active":"2023-12-19T16:17:23.476587+0000","last_peered":"2023-12-19T16:17:23.476587+0000","last_clean":"2023-12-19T16:17:23.476587+0000","last_became_active":"2023-12-19T16:17:22.156314+0000","last_became_peered":"2023-12-19T16:17:22.156314+0000","last_unstale":"2023-12-19T16:17:23.476587+0000","last_undegraded":"2023-12-19T16:17:23.476587+0000","last_fullsized":"2023-12-19T16:17:23.476587+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:47.136357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473494+0000","last_change":"2023-12-19T16:17:21.759011+0000","last_active":"2023-12-19T16:17:22.473494+0000","last_peered":"2023-12-19T16:17:22.473494+0000","last_clean":"2023-12-19T16:17:22.473494+0000","last_became_active":"2023-12-19T16:17:21.758694+0000","last_became_peered":"2023-12-19T16:17:21.758694+0000","last_unstale":"2023-12-19T16:17:22.473494+0000","last_undegraded":"2023-12-19T16:17:22.473494+0000","last_fullsized":"2023-12-19T16:17:22.473494+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:32.774324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134598+0000","last_change":"2023-12-19T16:17:22.162849+0000","last_active":"2023-12-19T16:17:23.134598+0000","last_peered":"2023-12-19T16:17:23.134598+0000","last_clean":"2023-12-19T16:17:23.134598+0000","last_became_active":"2023-12-19T16:17:22.162469+0000","last_became_peered":"2023-12-19T16:17:22.162469+0000","last_unstale":"2023-12-19T16:17:23.134598+0000","last_undegraded":"2023-12-19T16:17:23.134598+0000","last_fullsized":"2023-12-19T16:17:23.134598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:41:14.714236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.478803+0000","last_change":"2023-12-19T16:17:21.758295+0000","last_active":"2023-12-19T16:17:23.478803+0000","last_peered":"2023-12-19T16:17:23.478803+0000","last_clean":"2023-12-19T16:17:23.478803+0000","last_became_active":"2023-12-19T16:17:21.758035+0000","last_became_peered":"2023-12-19T16:17:21.758035+0000","last_unstale":"2023-12-19T16:17:23.478803+0000","last_undegraded":"2023-12-19T16:17:23.478803+0000","last_fullsized":"2023-12-19T16:17:23.478803+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:59.521708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474486+0000","last_change":"2023-12-19T16:17:22.151966+0000","last_active":"2023-12-19T16:17:22.474486+0000","last_peered":"2023-12-19T16:17:22.474486+0000","last_clean":"2023-12-19T16:17:22.474486+0000","last_became_active":"2023-12-19T16:17:22.150479+0000","last_became_peered":"2023-12-19T16:17:22.150479+0000","last_unstale":"2023-12-19T16:17:22.474486+0000","last_undegraded":"2023-12-19T16:17:22.474486+0000","last_fullsized":"2023-12-19T16:17:22.474486+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:25.579064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476521+0000","last_change":"2023-12-19T16:17:21.753501+0000","last_active":"2023-12-19T16:17:23.476521+0000","last_peered":"2023-12-19T16:17:23.476521+0000","last_clean":"2023-12-19T16:17:23.476521+0000","last_became_active":"2023-12-19T16:17:21.753228+0000","last_became_peered":"2023-12-19T16:17:21.753228+0000","last_unstale":"2023-12-19T16:17:23.476521+0000","last_undegraded":"2023-12-19T16:17:23.476521+0000","last_fullsized":"2023-12-19T16:17:23.476521+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:16.857037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.479194+0000","last_change":"2023-12-19T16:17:22.158201+0000","last_active":"2023-12-19T16:17:23.479194+0000","last_peered":"2023-12-19T16:17:23.479194+0000","last_clean":"2023-12-19T16:17:23.479194+0000","last_became_active":"2023-12-19T16:17:22.155301+0000","last_became_peered":"2023-12-19T16:17:22.155301+0000","last_unstale":"2023-12-19T16:17:23.479194+0000","last_undegraded":"2023-12-19T16:17:23.479194+0000","last_fullsized":"2023-12-19T16:17:23.479194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:34.957262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474659+0000","last_change":"2023-12-19T16:17:21.755941+0000","last_active":"2023-12-19T16:17:22.474659+0000","last_peered":"2023-12-19T16:17:22.474659+0000","last_clean":"2023-12-19T16:17:22.474659+0000","last_became_active":"2023-12-19T16:17:21.755557+0000","last_became_peered":"2023-12-19T16:17:21.755557+0000","last_unstale":"2023-12-19T16:17:22.474659+0000","last_undegraded":"2023-12-19T16:17:22.474659+0000","last_fullsized":"2023-12-19T16:17:22.474659+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:04:56.916818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.134632+0000","last_change":"2023-12-19T16:17:22.141268+0000","last_active":"2023-12-19T16:17:23.134632+0000","last_peered":"2023-12-19T16:17:23.134632+0000","last_clean":"2023-12-19T16:17:23.134632+0000","last_became_active":"2023-12-19T16:17:22.140999+0000","last_became_peered":"2023-12-19T16:17:22.140999+0000","last_unstale":"2023-12-19T16:17:23.134632+0000","last_undegraded":"2023-12-19T16:17:23.134632+0000","last_fullsized":"2023-12-19T16:17:23.134632+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:04:17.763093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.473453+0000","last_change":"2023-12-19T16:17:21.749542+0000","last_active":"2023-12-19T16:17:22.473453+0000","last_peered":"2023-12-19T16:17:22.473453+0000","last_clean":"2023-12-19T16:17:22.473453+0000","last_became_active":"2023-12-19T16:17:21.749270+0000","last_became_peered":"2023-12-19T16:17:21.749270+0000","last_unstale":"2023-12-19T16:17:22.473453+0000","last_undegraded":"2023-12-19T16:17:22.473453+0000","last_fullsized":"2023-12-19T16:17:22.473453+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:30.862265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.474597+0000","last_change":"2023-12-19T16:17:22.159978+0000","last_active":"2023-12-19T16:17:22.474597+0000","last_peered":"2023-12-19T16:17:22.474597+0000","last_clean":"2023-12-19T16:17:22.474597+0000","last_became_active":"2023-12-19T16:17:22.159594+0000","last_became_peered":"2023-12-19T16:17:22.159594+0000","last_unstale":"2023-12-19T16:17:22.474597+0000","last_undegraded":"2023-12-19T16:17:22.474597+0000","last_fullsized":"2023-12-19T16:17:22.474597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:21.726345+0000","last_clean_scrub_stamp":"2023-12-19T16:17:21.726345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:14.977272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:23.476617+0000","last_change":"2023-12-19T16:17:21.757859+0000","last_active":"2023-12-19T16:17:23.476617+0000","last_peered":"2023-12-19T16:17:23.476617+0000","last_clean":"2023-12-19T16:17:23.476617+0000","last_became_active":"2023-12-19T16:17:21.757542+0000","last_became_peered":"2023-12-19T16:17:21.757542+0000","last_unstale":"2023-12-19T16:17:23.476617+0000","last_undegraded":"2023-12-19T16:17:23.476617+0000","last_fullsized":"2023-12-19T16:17:23.476617+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:17:20.718859+0000","last_clean_scrub_stamp":"2023-12-19T16:17:20.718859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:07.210909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-12-19T16:17:22.127213+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:17:22.127213+0000","last_peered":"2023-12-19T16:17:22.127213+0000","last_clean":"2023-12-19T16:17:22.127213+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:17:22.127213+0000","last_undegraded":"2023-12-19T16:17:22.127213+0000","last_fullsized":"2023-12-19T16:17:22.127213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476764,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":614400,"data_stored":248972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.315},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.40500000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.441}]},{"osd":4,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.626}]},{"osd":7,"last update":"Tue Dec 19 16:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.65300000000000002}]}]},{"osd":2,"up_from":16,"seq":68719476764,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":247498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.51300000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.33500000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.9089999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.501}]},{"osd":4,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.5670000000000002,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.76000000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9729999999999999,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.2309999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.77200000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476764,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1200128,"data_stored":837846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.40400000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.3170000000000002,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.374}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":3.0059999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.85799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.3659999999999997,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.8879999999999999,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9860000000000002,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.88},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.80300000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.92600000000000005}]}]},{"osd":0,"up_from":16,"seq":68719476763,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":248080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.41699999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.505},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.371},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.57399999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.625},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55100000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.56399999999999995}]}]},{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":606208,"data_stored":247442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":0.57699999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.623},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.53800000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.72499999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.751},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.66200000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":610304,"data_stored":248024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.59199999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51900000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.505}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.66200000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61899999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28124,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343716,"statfs":{"total":96636764160,"available":96607965184,"internally_reserved":0,"allocated":1200128,"data_stored":837798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.3860000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.1959999999999997,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.78100000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.5259999999999998,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.505},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":3.8820000000000001,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":3.3940000000000001,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.5609999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.80000000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.84599999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31656,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340184,"statfs":{"total":96636764160,"available":96604348416,"internally_reserved":0,"allocated":622592,"data_stored":249064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":5.6769999999999996,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.75}]},{"osd":2,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.7919999999999998,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.69499999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:16:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7610000000000001,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":8.4329999999999998,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.82299999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:16:27 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:17:31.051 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T16:17:31.051 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T16:17:31.234 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.230+0000 7f1aacb6d640 1 Processor -- start 2023-12-19T16:17:31.235 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.230+0000 7f1aacb6d640 1 -- start start 2023-12-19T16:17:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aacb6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 0x7f1aa815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aacb6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1aa80afec0 0x7f1aa806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aacb6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa806c550 con 0x7f1aa80c9550 2023-12-19T16:17:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aacb6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa815d200 con 0x7f1aa80afec0 2023-12-19T16:17:31.236 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aacb6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa815d480 con 0x7f1aa80afae0 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1aa80afec0 0x7f1aa806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1aa80afec0 0x7f1aa806ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36702/0 (socket says 172.21.15.73:36702) 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3182801476 learned_addr learned my addr 172.21.15.73:0/3182801476 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3182801476 >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 0x7f1aa815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3182801476 >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 msgr2=0x7f1aa815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 --2- 172.21.15.73:0/3182801476 >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 0x7f1aa815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3182801476 >> v1:172.21.15.162:6789/0 conn(0x7f1aa80c9550 legacy=0x7f1aa80b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3182801476 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa815d760 con 0x7f1aa80afec0 2023-12-19T16:17:31.237 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.234+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3182801476 >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 0x7f1aa815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1a9dd9b640 1 --2- 172.21.15.73:0/3182801476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa806ccc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1aa806e330 tx=0x7f1a9001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18f7f0f418372e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aa5d9b640 1 -- 172.21.15.73:0/3182801476 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900ab600 con 0x7f1aa80afec0 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aa5d9b640 1 -- 172.21.15.73:0/3182801476 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900a7050 con 0x7f1aa80afec0 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aa5d9b640 1 -- 172.21.15.73:0/3182801476 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900ab980 con 0x7f1aa80afec0 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3182801476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 msgr2=0x7f1aa806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3182801476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa806ccc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1aa806e330 tx=0x7f1a9001c400 comp rx=0 tx=0).stop 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3182801476 shutdown_connections 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3182801476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa806ccc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3182801476 >> v2:172.21.15.162:3300/0 conn(0x7f1aa80afae0 0x7f1aa815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3182801476 >> 172.21.15.73:0/3182801476 conn(0x7f1aa80b0490 msgr2=0x7f1aa80b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3182801476 shutdown_connections 2023-12-19T16:17:31.241 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3182801476 wait complete. 2023-12-19T16:17:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 Processor -- start 2023-12-19T16:17:31.242 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 -- start start 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 0x7f1aa8150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.238+0000 7f1aacb6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 0x7f1aa8152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa8167140 con 0x7f1aa80afec0 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa8167b10 con 0x7f1aa80c9550 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa8166530 con 0x7f1aa80afae0 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36718/0 (socket says 172.21.15.73:36718) 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3149435236 learned_addr learned my addr 172.21.15.73:0/3149435236 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 0x7f1aa8150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aa6d9d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 0x7f1aa8152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 msgr2=0x7f1aa8150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 0x7f1aa8150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 msgr2=0x7f1aa8152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 0x7f1aa8152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 -- 172.21.15.73:0/3149435236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900094d0 con 0x7f1aa80afec0 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aa6d9d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 0x7f1aa8152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 0x7f1aa8150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:31.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9dd9b640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a900ae040 tx=0x7f1a900191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900b8070 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900b3690 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900b3a60 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa8166810 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa8166dd0 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa81672b0 con 0x7f1aa80afec0 2023-12-19T16:17:31.246 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.242+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a900b2070 con 0x7f1aa80afec0 2023-12-19T16:17:31.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.246+0000 7f1a9f7fe640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 0x7f1a88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.246+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a9011cc50 con 0x7f1aa80afec0 2023-12-19T16:17:31.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.246+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 0x7f1a88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.246+0000 7f1aa659c640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 0x7f1a88067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006fd0 tx=0x7f1a98008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.250+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1a900ea600 con 0x7f1aa80afec0 2023-12-19T16:17:31.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.450+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1aa804e070 con 0x7f1aa80afec0 2023-12-19T16:17:31.458 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.454+0000 7f1a9f7fe640 1 -- 172.21.15.73:0/3149435236 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1a900edc20 con 0x7f1aa80afec0 2023-12-19T16:17:31.459 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 msgr2=0x7f1a88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 0x7f1a88067f20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1a98006fd0 tx=0x7f1a98008040 comp rx=0 tx=0).stop 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 msgr2=0x7f1aa81675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a900ae040 tx=0x7f1a900191a0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 shutdown_connections 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1aa80c9550 0x7f1aa8152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1a88065a60 0x7f1a88067f20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1aa80afec0 0x7f1aa81675d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 --2- 172.21.15.73:0/3149435236 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1aa80afae0 0x7f1aa8150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 >> 172.21.15.73:0/3149435236 conn(0x7f1aa80b0490 msgr2=0x7f1aa80b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:31.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 shutdown_connections 2023-12-19T16:17:31.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.458+0000 7f1aacb6d640 1 -- 172.21.15.73:0/3149435236 wait complete. 2023-12-19T16:17:31.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:31.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 Processor -- start 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 -- start start 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39d015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d015ad00 con 0x7f39d00b40b0 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00ce2d0 con 0x7f39d00cdc40 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.614+0000 7f39d5066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015e110 con 0x7f39d0159830 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39c7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f39d00b40b0 0x7f39d00cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41470/0 (socket says 172.21.15.73:41470) 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39c7fff640 1 -- 172.21.15.73:0/800467457 learned_addr learned my addr 172.21.15.73:0/800467457 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ced9d640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39d015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339345117 0 0) 0x7f39d015ad00 con 0x7f39d00b40b0 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39bc005740 con 0x7f39d00b40b0 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 77081572 0 0) 0x7f39bc005740 con 0x7f39d00b40b0 2023-12-19T16:17:31.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 msgr2=0x7f39d015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39d015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 >> v1:172.21.15.162:6789/0 conn(0x7f39d00cdc40 legacy=0x7f39d00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d015d490 con 0x7f39d00b40b0 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f39b8001680 con 0x7f39d00b40b0 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 >> v1:172.21.15.73:6789/0 conn(0x7f39d00b40b0 legacy=0x7f39d00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39bc005bc0 0x7f39bc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39bc0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39bc006f20 0x7f39bc0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015e110 con 0x7f39bc006f20 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc00dc50 con 0x7f39bc005bc0 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc00de10 con 0x7f39d0159830 2023-12-19T16:17:31.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39bc006f20 0x7f39bc0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39c7fff640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39bc0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39ced9d640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39bc005bc0 0x7f39bc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 -- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 msgr2=0x7f39bc0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39d0159830 0x7f39bc0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 -- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39bc005bc0 msgr2=0x7f39bc005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39bc005bc0 0x7f39bc005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.618+0000 7f39cf59e640 1 -- 172.21.15.73:0/800467457 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc005740 con 0x7f39bc006f20 2023-12-19T16:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39cf59e640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39bc006f20 0x7f39bc0073a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f39c8001f60 tx=0x7f39c801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf944226deb879b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80a6620 con 0x7f39bc006f20 2023-12-19T16:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c80a6780 con 0x7f39bc006f20 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39ce59c640 1 -- 172.21.15.73:0/800467457 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80a6b30 con 0x7f39bc006f20 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- 172.21.15.73:0/800467457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39bc006f20 msgr2=0x7f39bc0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 --2- 172.21.15.73:0/800467457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39bc006f20 0x7f39bc0073a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f39c8001f60 tx=0x7f39c801c830 comp rx=0 tx=0).stop 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39cf59e640 1 -- 172.21.15.73:0/800467457 reap_dead start 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- 172.21.15.73:0/800467457 shutdown_connections 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- 172.21.15.73:0/800467457 >> 172.21.15.73:0/800467457 conn(0x7f39d00b0270 msgr2=0x7f39d00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- 172.21.15.73:0/800467457 shutdown_connections 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- 172.21.15.73:0/800467457 wait complete. 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 Processor -- start 2023-12-19T16:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.622+0000 7f39d5066640 1 -- start start 2023-12-19T16:17:31.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 0x7f39d0148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d00b1740 0x7f39d0157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d014bb90 con 0x7f39d0144ff0 2023-12-19T16:17:31.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00b2050 con 0x7f39d00b1740 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00b1d70 con 0x7f39bc006f20 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36724/0 (socket says 172.21.15.73:36724) 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 -- 172.21.15.73:0/1044338348 learned_addr learned my addr 172.21.15.73:0/1044338348 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39ced9d640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 0x7f39d0148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39cf59e640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d00b1740 0x7f39d0157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 -- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 msgr2=0x7f39d0148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 0x7f39d0148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 -- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d00b1740 msgr2=0x7f39d0157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d00b1740 0x7f39d0157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 -- 172.21.15.73:0/1044338348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0147970 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39ced9d640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 0x7f39d0148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c7fff640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f39b8001ec0 tx=0x7f39b800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800c6c0 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b800c820 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800cbd0 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0147c50 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d0145470 con 0x7f39d0144ff0 2023-12-19T16:17:31.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d00b1b20 con 0x7f39d0144ff0 2023-12-19T16:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.626+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39b801d460 con 0x7f39d0144ff0 2023-12-19T16:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.630+0000 7f39c77fe640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.630+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b80832a0 con 0x7f39d0144ff0 2023-12-19T16:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.630+0000 7f39ced9d640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.630+0000 7f39ced9d640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 0x7f39b0067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009be0 tx=0x7f39c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.630+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39b8050c50 con 0x7f39d0144ff0 2023-12-19T16:17:31.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.814+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39d0074050 con 0x7f39d0144ff0 2023-12-19T16:17:31.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.814+0000 7f39c77fe640 1 -- 172.21.15.73:0/1044338348 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4715 (secure 0 0 0) 0x7f39b8054270 con 0x7f39d0144ff0 2023-12-19T16:17:31.818 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:31.818 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":30,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1099449589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1099449589},{"type":"v1","addr":"172.21.15.162:6833","nonce":1099449589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2309978342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2309978342},{"type":"v1","addr":"172.21.15.162:6835","nonce":2309978342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5433,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1926317864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1926317864},{"type":"v1","addr":"172.21.15.73:6836","nonce":1926317864}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:25.133270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5439":{"gid":5439,"name":"c","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6837/2630347924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2630347924},{"type":"v1","addr":"172.21.15.73:6837","nonce":2630347924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:31.819 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 30 2023-12-19T16:17:31.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 msgr2=0x7f39b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 0x7f39b0067f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009be0 tx=0x7f39c0008040 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 msgr2=0x7f39d00b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f39b8001ec0 tx=0x7f39b800eb90 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 shutdown_connections 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d00b1740 0x7f39d0157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f39b0065a60 0x7f39b0067f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39d0144ff0 0x7f39d00b1200 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 --2- 172.21.15.73:0/1044338348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39bc006f20 0x7f39d0148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 >> 172.21.15.73:0/1044338348 conn(0x7f39d00b0270 msgr2=0x7f39d006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 shutdown_connections 2023-12-19T16:17:31.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:31.818+0000 7f39d5066640 1 -- 172.21.15.73:0/1044338348 wait complete. 2023-12-19T16:17:32.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:22.120066+0000', 'modified': '2023-12-19T16:17:25.133270+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5439}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5439': {'gid': 5439, 'name': 'c', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6837/2630347924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2630347924}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2630347924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:32.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:17:32.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T16:17:32.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 Processor -- start 2023-12-19T16:17:32.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 -- start start 2023-12-19T16:17:32.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 0x7f90d815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90d80b40b0 0x7f90d80cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d815ad00 con 0x7f90d80cda70 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d815e110 con 0x7f90d80b40b0 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90dd7c0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80cdf00 con 0x7f90d8159830 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90d80b40b0 0x7f90d80cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f90d80b40b0 0x7f90d80cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36732/0 (socket says 172.21.15.73:36732) 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 -- 172.21.15.73:0/1285011354 learned_addr learned my addr 172.21.15.73:0/1285011354 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/1285011354 >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 0x7f90d815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 -- 172.21.15.73:0/1285011354 >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 msgr2=0x7f90d815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/1285011354 >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 0x7f90d815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 -- 172.21.15.73:0/1285011354 >> v1:172.21.15.162:6789/0 conn(0x7f90d80cda70 legacy=0x7f90d80cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90ce7fc640 1 -- 172.21.15.73:0/1285011354 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80ce2d0 con 0x7f90d80b40b0 2023-12-19T16:17:32.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.382+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/1285011354 >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 0x7f90d815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/1285011354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b40b0 0x7f90d80cd530 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90d806bf10 tx=0x7f90c001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3875204c423df7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90d67fc640 1 -- 172.21.15.73:0/1285011354 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00a57d0 con 0x7f90d80b40b0 2023-12-19T16:17:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90d67fc640 1 -- 172.21.15.73:0/1285011354 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00a5930 con 0x7f90d80b40b0 2023-12-19T16:17:32.389 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90d67fc640 1 -- 172.21.15.73:0/1285011354 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00a5cc0 con 0x7f90d80b40b0 2023-12-19T16:17:32.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 -- 172.21.15.73:0/1285011354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b40b0 msgr2=0x7f90d80cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/1285011354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b40b0 0x7f90d80cd530 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f90d806bf10 tx=0x7f90c001c910 comp rx=0 tx=0).stop 2023-12-19T16:17:32.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 -- 172.21.15.73:0/1285011354 shutdown_connections 2023-12-19T16:17:32.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/1285011354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b40b0 0x7f90d80cd530 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/1285011354 >> v2:172.21.15.162:3300/0 conn(0x7f90d8159830 0x7f90d815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 -- 172.21.15.73:0/1285011354 >> 172.21.15.73:0/1285011354 conn(0x7f90d80b0270 msgr2=0x7f90d80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 -- 172.21.15.73:0/1285011354 shutdown_connections 2023-12-19T16:17:32.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.386+0000 7f90dd7c0640 1 -- 172.21.15.73:0/1285011354 wait complete. 2023-12-19T16:17:32.391 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 Processor -- start 2023-12-19T16:17:32.392 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- start start 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90d80b40b0 0x7f90d80c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 0x7f90d81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c51f0 con 0x7f90d80cda70 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c28c0 con 0x7f90d8159830 2023-12-19T16:17:32.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c25e0 con 0x7f90d80b40b0 2023-12-19T16:17:32.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36748/0 (socket says 172.21.15.73:36748) 2023-12-19T16:17:32.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 -- 172.21.15.73:0/3548148198 learned_addr learned my addr 172.21.15.73:0/3548148198 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90d80b40b0 0x7f90d80c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90d77fe640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 0x7f90d81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 -- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90d80b40b0 msgr2=0x7f90d80c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90d80b40b0 0x7f90d80c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 -- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 msgr2=0x7f90d81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 0x7f90d81582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 -- 172.21.15.73:0/3548148198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c0009b30 con 0x7f90d80cda70 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90d77fe640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 0x7f90d81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f90c0019520 tx=0x7f90c00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90cffff640 1 -- 172.21.15.73:0/3548148198 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00b8670 con 0x7f90d80cda70 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90cffff640 1 -- 172.21.15.73:0/3548148198 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00b87d0 con 0x7f90d80cda70 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d8157800 con 0x7f90d80cda70 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90cffff640 1 -- 172.21.15.73:0/3548148198 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00b8b80 con 0x7f90d80cda70 2023-12-19T16:17:32.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.390+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8157dc0 con 0x7f90d80cda70 2023-12-19T16:17:32.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90cffff640 1 -- 172.21.15.73:0/3548148198 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f90c00b8ce0 con 0x7f90d80cda70 2023-12-19T16:17:32.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90cffff640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 0x7f90b8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90cffff640 1 -- 172.21.15.73:0/3548148198 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c011e710 con 0x7f90d80cda70 2023-12-19T16:17:32.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 0x7f90b8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90e0b34000 1 Processor -- start 2023-12-19T16:17:32.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90e0b34000 1 -- start start 2023-12-19T16:17:32.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.394+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 0x7f90b8067f50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90d8159110 tx=0x7f90c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460070 0x561753460450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 0x5617534165a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561753239c90 con 0x561753460990 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56175326b220 con 0x5617534161c0 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617532687f0 con 0x561753460070 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36752/0 (socket says 172.21.15.73:36752) 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2006061765 learned_addr learned my addr 172.21.15.73:0/2006061765 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460070 0x561753460450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90d77fe640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 0x5617534165a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460070 msgr2=0x561753460450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460070 0x561753460450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 msgr2=0x5617534165a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 0x5617534165a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2006061765 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561752f60890 con 0x561753460990 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90d77fe640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 0x5617534165a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f90c00f79f0 tx=0x7f90c0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fca65a422c3732 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ccff9640 1 -- 172.21.15.73:0/2006061765 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00eff40 con 0x561753460990 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ccff9640 1 -- 172.21.15.73:0/2006061765 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c00f3d70 con 0x561753460990 2023-12-19T16:17:32.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90ccff9640 1 -- 172.21.15.73:0/2006061765 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00f7f20 con 0x561753460990 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- 172.21.15.73:0/2006061765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 msgr2=0x561753415c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f90c00f79f0 tx=0x7f90c0009810 comp rx=0 tx=0).stop 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- 172.21.15.73:0/2006061765 shutdown_connections 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5617534161c0 0x5617534165a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753415c80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2006061765 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460070 0x561753460450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- 172.21.15.73:0/2006061765 >> 172.21.15.73:0/2006061765 conn(0x56175341c950 msgr2=0x561753414560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- 172.21.15.73:0/2006061765 shutdown_connections 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- 172.21.15.73:0/2006061765 wait complete. 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 -- start start 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.398+0000 7f90e0b34000 1 Processor -- start 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175341b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460990 0x56175344d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617532640e0 con 0x561753460070 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561753203310 con 0x561753460990 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561753221770 con 0x5617534161c0 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 10 client.0 _ll_register_callbacks cb 0x561753401b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36754/0 (socket says 172.21.15.73:36754) 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2140450165 learned_addr learned my addr 172.21.15.73:0/2140450165 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175341b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90d77fe640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460990 0x56175344d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 msgr2=0x56175341b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175341b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460990 msgr2=0x56175344d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460990 0x56175344d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 -- 172.21.15.73:0/2140450165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d8157dc0 con 0x561753460070 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f90c001c950 tx=0x7f90c00a58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d454c9eac73ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00f03a0 con 0x561753460070 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c00eff40 con 0x561753460070 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561753233c10 con 0x561753460070 2023-12-19T16:17:32.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c00ef430 con 0x561753460070 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 10 client.5613 fetch_fsmap learned FSMap version 30 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x561753229260 con 0x561753460070 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561753233c10 con 0x561753460070 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90c0005d20 con 0x561753460070 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 10 client.5613 fetch_fsmap finished waiting for FSMap version 30 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 10 client.5613 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 20 client.5613 populate_metadata read hostname 'smithi073' 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x56175346f310 0x561753471700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 4 client.5613 mds_command: new command op to 5439 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 --> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561753262a30 con 0x56175346f310 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x56175346f310 0x561753471700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x56175346f310 0x561753471700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8260fbb6d0d97788 server_cookie=d0cfda98b8f4a042 in_seq=0 out_seq=0 2023-12-19T16:17:32.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 10 client.5613 ms_handle_connect on v2:172.21.15.73:6835/2630347924 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 1 -- 172.21.15.73:0/2140450165 <== mds.0 v2:172.21.15.73:6835/2630347924 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561753262a30 con 0x56175346f310 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 10 client.5613 handle_command_reply: tid=0 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 client.5613 shutdown 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 msgr2=0x56175341bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f90c001c950 tx=0x7f90c00a58c0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 shutdown_connections 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x56175346f310 0x561753471700 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460990 0x56175344d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460070 0x56175341bcb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90b5ffb640 0 client.5613 ms_handle_reset on v2:172.21.15.73:6835/2630347924 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 --2- 172.21.15.73:0/2140450165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175341b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.411 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.402+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 >> 172.21.15.73:0/2140450165 conn(0x56175341c950 msgr2=0x561753414c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.406+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 shutdown_connections 2023-12-19T16:17:32.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.406+0000 7f90e0b34000 1 -- 172.21.15.73:0/2140450165 wait complete. 2023-12-19T16:17:32.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.406+0000 7f90e0b34000 20 client.5613 trim_cache size 0 max 16384 2023-12-19T16:17:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 Processor -- start 2023-12-19T16:17:32.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 -- start start 2023-12-19T16:17:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175344c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x56175344c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561752f21940 con 0x561753460990 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561753418fa0 con 0x561753460070 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561753475f10 con 0x5617534161c0 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36770/0 (socket says 172.21.15.73:36770) 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90d77fe640 1 -- 172.21.15.73:0/548850637 learned_addr learned my addr 172.21.15.73:0/548850637 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175344c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.418+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x56175344c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 -- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 msgr2=0x56175344c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175344c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 -- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 msgr2=0x56175344c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x56175344c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 -- 172.21.15.73:0/548850637 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56175320f3b0 con 0x561753460990 2023-12-19T16:17:32.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f90d00015e0 tx=0x7f90d0001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2dc45a22b516f9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90cd7fa640 1 -- 172.21.15.73:0/548850637 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00052d0 con 0x561753460990 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90cd7fa640 1 -- 172.21.15.73:0/548850637 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d000d040 con 0x561753460990 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90cd7fa640 1 -- 172.21.15.73:0/548850637 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d0011890 con 0x561753460990 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- 172.21.15.73:0/548850637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 msgr2=0x561753471700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f90d00015e0 tx=0x7f90d0001aa0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- 172.21.15.73:0/548850637 shutdown_connections 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x561753460990 0x561753471700 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x56175344c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- 172.21.15.73:0/548850637 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5617534161c0 0x56175344c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- 172.21.15.73:0/548850637 >> 172.21.15.73:0/548850637 conn(0x56175341c950 msgr2=0x56175341a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- 172.21.15.73:0/548850637 shutdown_connections 2023-12-19T16:17:32.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- 172.21.15.73:0/548850637 wait complete. 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- start start 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 Processor -- start 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x5617534c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460990 0x5617534481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x561753203310 con 0x5617534161c0 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56175340d9d0 con 0x561753460070 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x561753262f70 con 0x561753460990 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90e0b34000 10 client.0 _ll_register_callbacks cb 0x561753212640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36772/0 (socket says 172.21.15.73:36772) 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 -- 172.21.15.73:0/205461974 learned_addr learned my addr 172.21.15.73:0/205461974 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x5617534c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d77fe640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460990 0x5617534481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 -- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460990 msgr2=0x5617534481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460990 0x5617534481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 -- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 msgr2=0x5617534c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x5617534c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.422+0000 7f90d6ffd640 1 -- 172.21.15.73:0/205461974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d815ad00 con 0x5617534161c0 2023-12-19T16:17:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b3a0 tx=0x7f90c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b7e5100d601ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:17:32.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8014660 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c800fe60 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561753229e00 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90c80293c0 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 10 client.5619 fetch_fsmap learned FSMap version 30 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x561752f60cc0 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561753229e00 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 30) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f90c80147c0 con 0x5617534161c0 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 10 client.5619 fetch_fsmap finished waiting for FSMap version 30 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 10 client.5619 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 20 client.5619 populate_metadata read hostname 'smithi073' 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x5617534486f0 0x561753448ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 4 client.5619 mds_command: new command op to 5439 tid=0[{"prefix": "status"}] 2023-12-19T16:17:32.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 --> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56175325d160 con 0x5617534486f0 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x5617534486f0 0x561753448ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90ce7fc640 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x5617534486f0 0x561753448ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5f8303ffaa5ba4 server_cookie=9b702897d333eeec in_seq=0 out_seq=0 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 10 client.5619 ms_handle_connect on v2:172.21.15.73:6835/2630347924 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 1 -- 172.21.15.73:0/205461974 <== mds.0 v2:172.21.15.73:6835/2630347924 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x56175325d160 con 0x5617534486f0 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 10 client.5619 handle_command_reply: tid=0 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 client.5619 shutdown 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 msgr2=0x5617534c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f90c800b3a0 tx=0x7f90c8004740 comp rx=0 tx=0).stop 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 shutdown_connections 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:6835/2630347924,v1:172.21.15.73:6837/2630347924] conn(0x5617534486f0 0x561753448ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x561753460990 0x5617534481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561753460070 0x5617534c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 --2- 172.21.15.73:0/205461974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5617534161c0 0x5617534c49a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90b5ffb640 0 client.5619 ms_handle_reset on v2:172.21.15.73:6835/2630347924 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 >> 172.21.15.73:0/205461974 conn(0x56175341c950 msgr2=0x56175341a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 shutdown_connections 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 1 -- 172.21.15.73:0/205461974 wait complete. 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90e0b34000 20 client.5619 trim_cache size 0 max 16384 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "90ec874a-c348-4a69-99d9-d4bef3b9261d", 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5439, 2023-12-19T16:17:32.434 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.305255569, 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 30, 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 52, 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 52, 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.573836917 2023-12-19T16:17:32.435 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 msgr2=0x7f90b8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 0x7f90b8067f50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90d8159110 tx=0x7f90c8008040 comp rx=0 tx=0).stop 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 msgr2=0x7f90d814eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f90c0019520 tx=0x7f90c00196b0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 shutdown_connections 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90d8159830 0x7f90d81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f90b8065a90 0x7f90b8067f50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80cda70 0x7f90d814eff0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.436 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 --2- 172.21.15.73:0/3548148198 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90d80b40b0 0x7f90d80c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 >> 172.21.15.73:0/3548148198 conn(0x7f90d80b0270 msgr2=0x7f90d80ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 shutdown_connections 2023-12-19T16:17:32.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.426+0000 7f90dd7c0640 1 -- 172.21.15.73:0/3548148198 wait complete. 2023-12-19T16:17:32.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T16:17:32.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 Processor -- start 2023-12-19T16:17:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 -- start start 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd61815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6180cdc40 0x7fd6180ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61815ad00 con 0x7fd6180b40b0 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61815e110 con 0x7fd6180cdc40 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd62008c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180ce2d0 con 0x7fd618159830 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61d627640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd6180b40b0 0x7fd6180cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41482/0 (socket says 172.21.15.73:41482) 2023-12-19T16:17:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61d627640 1 -- 172.21.15.73:0/3529235836 learned_addr learned my addr 172.21.15.73:0/3529235836 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61de28640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd61815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 --2- 172.21.15.73:0/3529235836 >> v2:172.21.15.162:3300/0 conn(0x7fd6180cdc40 0x7fd6180ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707249795 0 0) 0x7fd61815ad00 con 0x7fd6180b40b0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd604005740 con 0x7fd6180b40b0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087809585 0 0) 0x7fd604005740 con 0x7fd6180b40b0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 msgr2=0x7fd61815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd61815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 >> v2:172.21.15.162:3300/0 conn(0x7fd6180cdc40 msgr2=0x7fd6180ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 --2- 172.21.15.73:0/3529235836 >> v2:172.21.15.162:3300/0 conn(0x7fd6180cdc40 0x7fd6180ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61815d490 con 0x7fd6180b40b0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fd608001680 con 0x7fd6180b40b0 2023-12-19T16:17:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 >> v1:172.21.15.73:6789/0 conn(0x7fd6180b40b0 legacy=0x7fd6180cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd604005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6040060d0 0x7fd6040069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd6040073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815e110 con 0x7fd604006f20 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180ce2d0 con 0x7fd6040060d0 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60400dba0 con 0x7fd618159830 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd6040073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61d627640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6040060d0 0x7fd6040069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61de28640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd604005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 -- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 msgr2=0x7fd604005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618159830 0x7fd604005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 -- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6040060d0 msgr2=0x7fd6040069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6040060d0 0x7fd6040069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61e629640 1 -- 172.21.15.73:0/3529235836 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604005740 con 0x7fd604006f20 2023-12-19T16:17:32.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.586+0000 7fd61d627640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6040060d0 0x7fd6040069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd61e629640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd6040073a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fc0 tx=0x7fd61001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93c4cafe6b00caa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100a5cb0 con 0x7fd604006f20 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000f040 con 0x7fd604006f20 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd61ce26640 1 -- 172.21.15.73:0/3529235836 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100ad680 con 0x7fd604006f20 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 -- 172.21.15.73:0/3529235836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 msgr2=0x7fd6040073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 --2- 172.21.15.73:0/3529235836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd6040073a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fc0 tx=0x7fd61001cca0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd61e629640 1 -- 172.21.15.73:0/3529235836 reap_dead start 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 -- 172.21.15.73:0/3529235836 shutdown_connections 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 -- 172.21.15.73:0/3529235836 >> 172.21.15.73:0/3529235836 conn(0x7fd6180b0270 msgr2=0x7fd6180b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 -- 172.21.15.73:0/3529235836 shutdown_connections 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.590+0000 7fd62008c640 1 -- 172.21.15.73:0/3529235836 wait complete. 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 Processor -- start 2023-12-19T16:17:32.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- start start 2023-12-19T16:17:32.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd61815b950 0x7fd61815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6180ae680 0x7fd6180aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815d090 con 0x7fd604006f20 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180af070 con 0x7fd6180ae680 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815c410 con 0x7fd61815b950 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36784/0 (socket says 172.21.15.73:36784) 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 -- 172.21.15.73:0/2374513014 learned_addr learned my addr 172.21.15.73:0/2374513014 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61d627640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd61815b950 0x7fd61815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61e629640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6180ae680 0x7fd6180aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 -- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd61815b950 msgr2=0x7fd61815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd61815b950 0x7fd61815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 -- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6180ae680 msgr2=0x7fd6180aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6180ae680 0x7fd6180aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 -- 172.21.15.73:0/2374513014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61815c6f0 con 0x7fd604006f20 2023-12-19T16:17:32.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd61de28640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6140115e0 tx=0x7fd6140119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614015870 con 0x7fd604006f20 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6140159d0 con 0x7fd604006f20 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61815c9d0 con 0x7fd604006f20 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614015d40 con 0x7fd604006f20 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.594+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61814f0a0 con 0x7fd604006f20 2023-12-19T16:17:32.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd618074050 con 0x7fd604006f20 2023-12-19T16:17:32.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd614013400 con 0x7fd604006f20 2023-12-19T16:17:32.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd60e7fc640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 0x7fd5fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:32.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6140831e0 con 0x7fd604006f20 2023-12-19T16:17:32.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd61d627640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 0x7fd5fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:32.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.598+0000 7fd61d627640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 0x7fd5fc067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd608008b90 tx=0x7fd608008a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:32.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.602+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd614050c40 con 0x7fd604006f20 2023-12-19T16:17:32.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6180cbfc0 con 0x7fd604006f20 2023-12-19T16:17:32.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd60e7fc640 1 -- 172.21.15.73:0/2374513014 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd614054260 con 0x7fd604006f20 2023-12-19T16:17:32.789 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T16:17:32.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 msgr2=0x7fd5fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 0x7fd5fc067f20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd608008b90 tx=0x7fd608008a00 comp rx=0 tx=0).stop 2023-12-19T16:17:32.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 msgr2=0x7fd61814eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:32.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd6140115e0 tx=0x7fd6140119e0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 shutdown_connections 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6180ae680 0x7fd6180aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd61815b950 0x7fd61815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd5fc065a60 0x7fd5fc067f20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 --2- 172.21.15.73:0/2374513014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd604006f20 0x7fd61814eb60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 >> 172.21.15.73:0/2374513014 conn(0x7fd6180b0270 msgr2=0x7fd61806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 shutdown_connections 2023-12-19T16:17:32.792 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:32.786+0000 7fd62008c640 1 -- 172.21.15.73:0/2374513014 wait complete. 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T16:17:32.810 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:32.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:32.811 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.821 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42312sec preferred_lft 42312sec 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:c8:3e:2d:c3 brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T16:17:32.822 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-19T16:17:32.823 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T16:17:32.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:32.824 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T16:17:32.885 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T16:17:32.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:32.888 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T16:17:32.942 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T16:17:32.942 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T16:17:32.942 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T16:17:32.942 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T16:17:32.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:32.943 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T16:17:32.944 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T16:17:32.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T16:17:32.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T16:17:32.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T16:17:32.944 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T16:17:33.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:33.035 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:17:33.044 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:17:33.044 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:17:33.045 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:33.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:33.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-19T16:17:33.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:33.107 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:33.163 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T16:17:33.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T16:17:33.163 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:33.215 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T16:17:33.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:33.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:17:33.308 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:17:33.309 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:17:33.309 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:17:33.325 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:17:33.325 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:17:33.325 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:17:33.325 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:17:33.325 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:17:33.334 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T16:17:33.334 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T16:17:33.334 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2023-12-19T16:17:33.334 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.162:3300,172.21.15.162:3301" 2023-12-19T16:17:33.335 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T16:17:33.335 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790" 2023-12-19T16:17:33.335 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2023-12-19T16:17:33.335 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=90ec874a-c348-4a69-99d9-d4bef3b9261d" will pass to kernel 2023-12-19T16:17:33.339 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T16:17:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:33.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T16:17:33.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:17:33.362 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T16:17:33.421 INFO:teuthology.orchestra.run.smithi073.stdout:client5628 2023-12-19T16:17:33.422 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:33.422 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:33.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:17:33.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:17:33.558 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.559 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:17:33.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.562 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T16:17:33.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T16:17:33.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:33.565 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:17:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T16:17:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:17:33.568 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T16:17:33.569 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi073.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-12-19T16:17:33.570 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.571 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-12-19T16:17:33.572 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.573 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-12-19T16:17:33.574 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2023-12-19T16:17:33.575 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-12-19T16:17:33.576 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-12-19T16:17:33.577 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:17:33.578 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:17:33.579 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-12-19T16:17:33.580 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-12-19T16:17:33.581 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:17:33.581 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:17:33.581 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:17:33.581 INFO:teuthology.orchestra.run.smithi162.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2023-12-19T16:17:33.584 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T16:17:33.584 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T16:17:33.584 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:17:33.584 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:33.584 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T16:17:33.584 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T16:17:33.585 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:17:33.585 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:33.585 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T16:17:33.585 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T16:17:33.585 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:17:33.585 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:33.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T16:17:33.586 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T16:17:33.586 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:17:33.586 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:17:33.637 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:17:33.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T16:17:33.639 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:17:33.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T16:17:33.640 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:17:33.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T16:17:33.642 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:17:33.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T16:17:33.681 INFO:tasks.ceph.mds.a:Started 2023-12-19T16:17:33.682 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:33.684 INFO:tasks.ceph.mds.c:Started 2023-12-19T16:17:33.684 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:33.690 INFO:tasks.ceph.mds.b:Started 2023-12-19T16:17:33.690 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:33.692 INFO:tasks.ceph.mds.d:Started 2023-12-19T16:17:33.692 DEBUG:teuthology.parallel:result is None 2023-12-19T16:17:33.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:33.770 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2023-12-19T16:17:33.770 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:17:33.777 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2023-12-19T16:17:33.780 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2023-12-19T16:17:33.786 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-19T16:17:33.782+0000 7f8e1fc50640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:17:33.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-19T16:17:33.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T16:17:33.843 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-19T16:17:33.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.846+0000 7f3eeeb25640 1 Processor -- start 2023-12-19T16:17:33.850 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.846+0000 7f3eeeb25640 1 -- start start 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.846+0000 7f3eeeb25640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 0x7f3ee815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eeeb25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee80b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eeeb25640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ee80b30b0 0x7f3ee815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eeeb25640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee81436d0 con 0x7f3ee80b30b0 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eeeb25640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee815aef0 con 0x7f3ee80cc930 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eeeb25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee80b1ad0 con 0x7f3ee80ccd10 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ee80b30b0 0x7f3ee815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ee80b30b0 0x7f3ee815b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36826/0 (socket says 172.21.15.73:36826) 2023-12-19T16:17:33.852 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 -- 172.21.15.73:0/343843891 learned_addr learned my addr 172.21.15.73:0/343843891 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eec8c1640 1 --2- 172.21.15.73:0/343843891 >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 0x7f3ee815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3ee7fff640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee80b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 -- 172.21.15.73:0/343843891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 msgr2=0x7f3ee80b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee80b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 -- 172.21.15.73:0/343843891 >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 msgr2=0x7f3ee815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 --2- 172.21.15.73:0/343843891 >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 0x7f3ee815a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 -- 172.21.15.73:0/343843891 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80b1db0 con 0x7f3ee80b30b0 2023-12-19T16:17:33.853 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eec8c1640 1 --2- 172.21.15.73:0/343843891 >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 0x7f3ee815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:33.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.850+0000 7f3eed0c2640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80b30b0 0x7f3ee815b0f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ee806a900 tx=0x7f3ee001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56887391d6967d90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:33.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee77fe640 1 -- 172.21.15.73:0/343843891 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00a5820 con 0x7f3ee80b30b0 2023-12-19T16:17:33.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee77fe640 1 -- 172.21.15.73:0/343843891 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee00a5980 con 0x7f3ee80b30b0 2023-12-19T16:17:33.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee77fe640 1 -- 172.21.15.73:0/343843891 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee00a5d10 con 0x7f3ee80b30b0 2023-12-19T16:17:33.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- 172.21.15.73:0/343843891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80b30b0 msgr2=0x7f3ee815b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:33.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80b30b0 0x7f3ee815b0f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3ee806a900 tx=0x7f3ee001c9a0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- 172.21.15.73:0/343843891 shutdown_connections 2023-12-19T16:17:33.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80b30b0 0x7f3ee815b0f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.856 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/343843891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee80b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/343843891 >> v2:172.21.15.162:3300/0 conn(0x7f3ee80cc930 0x7f3ee815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- 172.21.15.73:0/343843891 >> 172.21.15.73:0/343843891 conn(0x7f3ee8069cc0 msgr2=0x7f3ee806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- 172.21.15.73:0/343843891 shutdown_connections 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- 172.21.15.73:0/343843891 wait complete. 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 Processor -- start 2023-12-19T16:17:33.857 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- start start 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ee80b30b0 0x7f3ee8158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee813cd60 con 0x7f3ee80cc930 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee813efc0 con 0x7f3ee80b30b0 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eeeb25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee813d730 con 0x7f3ee80ccd10 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36840/0 (socket says 172.21.15.73:36840) 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3ee7fff640 1 -- 172.21.15.73:0/570848993 learned_addr learned my addr 172.21.15.73:0/570848993 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:33.860 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eed0c2640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.854+0000 7f3eec8c1640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ee80b30b0 0x7f3ee8158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 -- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 msgr2=0x7f3ee813d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee813d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 -- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ee80b30b0 msgr2=0x7f3ee8158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ee80b30b0 0x7f3ee8158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 -- 172.21.15.73:0/570848993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0009b30 con 0x7f3ee80cc930 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee7fff640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400d650 tx=0x7f3ed400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400b6c0 con 0x7f3ee80cc930 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed400b820 con 0x7f3ee80cc930 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed400bbb0 con 0x7f3ee80cc930 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee813b9b0 con 0x7f3ee80cc930 2023-12-19T16:17:33.861 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee813c710 con 0x7f3ee80cc930 2023-12-19T16:17:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee813cf10 con 0x7f3ee80cc930 2023-12-19T16:17:33.862 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ed400bd10 con 0x7f3ee80cc930 2023-12-19T16:17:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 0x7f3ecc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3ed4083580 con 0x7f3ee80cc930 2023-12-19T16:17:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.858+0000 7f3eec8c1640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 0x7f3ecc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:33.863 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.862+0000 7f3eec8c1640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 0x7f3ecc067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098d0 tx=0x7f3edc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:33.866 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:33.862+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ee813cf10 con 0x7f3ee80cc930 2023-12-19T16:17:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.042+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ee813cf10 con 0x7f3ee80cc930 2023-12-19T16:17:34.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3ee57fa640 1 -- 172.21.15.73:0/570848993 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f3ee813cf10 con 0x7f3ee80cc930 2023-12-19T16:17:34.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:34.067 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5105,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2309978342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2309978342},{"type":"v1","addr":"172.21.15.162:6835","nonce":2309978342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:33.797434+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:34.067 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 32 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 msgr2=0x7f3ecc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 0x7f3ecc067f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0098d0 tx=0x7f3edc008040 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 msgr2=0x7f3ee813ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400d650 tx=0x7f3ed400db10 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 shutdown_connections 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ee80ccd10 0x7f3ee813d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3ecc065a90 0x7f3ecc067f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ee80cc930 0x7f3ee813ea80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 --2- 172.21.15.73:0/570848993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ee80b30b0 0x7f3ee8158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 >> 172.21.15.73:0/570848993 conn(0x7f3ee8069cc0 msgr2=0x7f3ee815cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 shutdown_connections 2023-12-19T16:17:34.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:34.046+0000 7f3eeeb25640 1 -- 172.21.15.73:0/570848993 wait complete. 2023-12-19T16:17:34.472 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:22.120066+0000', 'modified': '2023-12-19T16:17:33.797434+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6837/2814692317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2814692317}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2814692317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:34.472 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5646:up:replay 2023-12-19T16:17:35.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 Processor -- start 2023-12-19T16:17:35.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 -- start start 2023-12-19T16:17:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 0x7ff6d40b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 0x7ff6d415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d41436d0 con 0x7ff6d40cc930 2023-12-19T16:17:35.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40b1ad0 con 0x7ff6d40ccd10 2023-12-19T16:17:35.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d958f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b1db0 con 0x7ff6d40b30b0 2023-12-19T16:17:35.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d2ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff6d40cc930 0x7ff6d415a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59468/0 (socket says 172.21.15.73:59468) 2023-12-19T16:17:35.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d2ffd640 1 -- 172.21.15.73:0/4249686776 learned_addr learned my addr 172.21.15.73:0/4249686776 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:35.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d37fe640 1 --2- 172.21.15.73:0/4249686776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 0x7ff6d415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d27fc640 1 --2- 172.21.15.73:0/4249686776 >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 0x7ff6d40b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d1ffb640 1 -- 172.21.15.73:0/4249686776 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127516555 0 0) 0x7ff6d41436d0 con 0x7ff6d40cc930 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.618+0000 7ff6d1ffb640 1 -- 172.21.15.73:0/4249686776 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc003530 con 0x7ff6d40cc930 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d37fe640 1 -- 172.21.15.73:0/4249686776 >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 msgr2=0x7ff6d40b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d37fe640 1 --2- 172.21.15.73:0/4249686776 >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 0x7ff6d40b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d37fe640 1 -- 172.21.15.73:0/4249686776 >> v1:172.21.15.73:6789/0 conn(0x7ff6d40cc930 legacy=0x7ff6d415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d37fe640 1 -- 172.21.15.73:0/4249686776 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40b2090 con 0x7ff6d40b30b0 2023-12-19T16:17:35.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d27fc640 1 --2- 172.21.15.73:0/4249686776 >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 0x7ff6d40b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d37fe640 1 --2- 172.21.15.73:0/4249686776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 0x7ff6d415b0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009d90 tx=0x7ff6cc01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b95a2f6eba5a4e67 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d1ffb640 1 -- 172.21.15.73:0/4249686776 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0a59e0 con 0x7ff6d40b30b0 2023-12-19T16:17:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d1ffb640 1 -- 172.21.15.73:0/4249686776 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc0a5b40 con 0x7ff6d40b30b0 2023-12-19T16:17:35.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d1ffb640 1 -- 172.21.15.73:0/4249686776 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ad440 con 0x7ff6d40b30b0 2023-12-19T16:17:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 -- 172.21.15.73:0/4249686776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 msgr2=0x7ff6d415b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 --2- 172.21.15.73:0/4249686776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 0x7ff6d415b0f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009d90 tx=0x7ff6cc01c920 comp rx=0 tx=0).stop 2023-12-19T16:17:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 -- 172.21.15.73:0/4249686776 shutdown_connections 2023-12-19T16:17:35.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 --2- 172.21.15.73:0/4249686776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40b30b0 0x7ff6d415b0f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 --2- 172.21.15.73:0/4249686776 >> v2:172.21.15.162:3300/0 conn(0x7ff6d40ccd10 0x7ff6d40b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.622+0000 7ff6d958f640 1 -- 172.21.15.73:0/4249686776 >> 172.21.15.73:0/4249686776 conn(0x7ff6d4069cc0 msgr2=0x7ff6d406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- 172.21.15.73:0/4249686776 shutdown_connections 2023-12-19T16:17:35.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- 172.21.15.73:0/4249686776 wait complete. 2023-12-19T16:17:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 Processor -- start 2023-12-19T16:17:35.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- start start 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 0x7ff6d4159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40ccd10 0x7ff6d406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4169080 con 0x7ff6d40cc930 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4168470 con 0x7ff6d40b30b0 2023-12-19T16:17:35.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d958f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4168750 con 0x7ff6d40ccd10 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60234/0 (socket says 172.21.15.73:60234) 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 -- 172.21.15.73:0/2130888332 learned_addr learned my addr 172.21.15.73:0/2130888332 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d37fe640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40ccd10 0x7ff6d406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d2ffd640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 0x7ff6d4159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 -- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40ccd10 msgr2=0x7ff6d406f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40ccd10 0x7ff6d406f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 -- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 msgr2=0x7ff6d4159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 0x7ff6d4159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 -- 172.21.15.73:0/2130888332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009420 con 0x7ff6d40cc930 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d2ffd640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 0x7ff6d4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:35.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.626+0000 7ff6d27fc640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800ebe0 tx=0x7ff6c800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800eee0 con 0x7ff6d40cc930 2023-12-19T16:17:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c800cc30 con 0x7ff6d40cc930 2023-12-19T16:17:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8013470 con 0x7ff6d40cc930 2023-12-19T16:17:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc009a70 con 0x7ff6d40cc930 2023-12-19T16:17:35.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4168d10 con 0x7ff6d40cc930 2023-12-19T16:17:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d41575f0 con 0x7ff6d40cc930 2023-12-19T16:17:35.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6c80135d0 con 0x7ff6d40cc930 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 0x7ff6c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff6c8083480 con 0x7ff6d40cc930 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6d2ffd640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 0x7ff6c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:35.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.630+0000 7ff6d2ffd640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 0x7ff6c0067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40011f0 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:35.638 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.634+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff6c8050e80 con 0x7ff6d40cc930 2023-12-19T16:17:35.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.818+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6d4072750 con 0x7ff6d40cc930 2023-12-19T16:17:35.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.818+0000 7ff6bb7fe640 1 -- 172.21.15.73:0/2130888332 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4716 (secure 0 0 0) 0x7ff6c80544a0 con 0x7ff6d40cc930 2023-12-19T16:17:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:35.822 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:35.808108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:35.822 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 34 2023-12-19T16:17:35.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 msgr2=0x7ff6c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 0x7ff6c0067f20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40011f0 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2023-12-19T16:17:35.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 msgr2=0x7ff6d406f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800ebe0 tx=0x7ff6c800c520 comp rx=0 tx=0).stop 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 shutdown_connections 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff6d40ccd10 0x7ff6d406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff6c0065a60 0x7ff6c0067f20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6d40cc930 0x7ff6d406f330 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 --2- 172.21.15.73:0/2130888332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6d40b30b0 0x7ff6d4159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:35.825 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 >> 172.21.15.73:0/2130888332 conn(0x7ff6d4069cc0 msgr2=0x7ff6d4159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:35.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 shutdown_connections 2023-12-19T16:17:35.826 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:35.822+0000 7ff6d958f640 1 -- 172.21.15.73:0/2130888332 wait complete. 2023-12-19T16:17:36.246 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:22.120066+0000', 'modified': '2023-12-19T16:17:35.808108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.73:6837/2814692317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2814692317}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2814692317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:36.247 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5646:up:rejoin 2023-12-19T16:17:37.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:37.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 Processor -- start 2023-12-19T16:17:37.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 -- start start 2023-12-19T16:17:37.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 0x7f64100b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64100b30b0 0x7f641015b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64101436d0 con 0x7f64100b30b0 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641015aef0 con 0x7f64100ccd10 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f641722d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100b1ad0 con 0x7f64100cc930 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f64157ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64100b30b0 0x7f641015b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f64157ca640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64100b30b0 0x7f641015b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60246/0 (socket says 172.21.15.73:60246) 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.394+0000 7f64157ca640 1 -- 172.21.15.73:0/1187377317 learned_addr learned my addr 172.21.15.73:0/1187377317 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f6407fff640 1 --2- 172.21.15.73:0/1187377317 >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 0x7f64100b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 -- 172.21.15.73:0/1187377317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 msgr2=0x7f641015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f6414fc9640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 -- 172.21.15.73:0/1187377317 >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 msgr2=0x7f64100b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:37.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 --2- 172.21.15.73:0/1187377317 >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 0x7f64100b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 -- 172.21.15.73:0/1187377317 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100b1db0 con 0x7f64100b30b0 2023-12-19T16:17:37.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f6407fff640 1 --2- 172.21.15.73:0/1187377317 >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 0x7f64100b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:37.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f6414fc9640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:37.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64157ca640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100b30b0 0x7f641015b0f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f641006d4e0 tx=0x7f640801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427f701eef374f1f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64077fe640 1 -- 172.21.15.73:0/1187377317 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080a5820 con 0x7f64100b30b0 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64077fe640 1 -- 172.21.15.73:0/1187377317 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080a5980 con 0x7f64100b30b0 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f64077fe640 1 -- 172.21.15.73:0/1187377317 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080a5d10 con 0x7f64100b30b0 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f641722d640 1 -- 172.21.15.73:0/1187377317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100b30b0 msgr2=0x7f641015b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.398+0000 7f641722d640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100b30b0 0x7f641015b0f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f641006d4e0 tx=0x7f640801c9a0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- 172.21.15.73:0/1187377317 shutdown_connections 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100b30b0 0x7f641015b0f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- 172.21.15.73:0/1187377317 >> v2:172.21.15.162:3300/0 conn(0x7f64100ccd10 0x7f64100b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- 172.21.15.73:0/1187377317 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- 172.21.15.73:0/1187377317 >> 172.21.15.73:0/1187377317 conn(0x7f6410069cc0 msgr2=0x7f641006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- 172.21.15.73:0/1187377317 shutdown_connections 2023-12-19T16:17:37.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- 172.21.15.73:0/1187377317 wait complete. 2023-12-19T16:17:37.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 Processor -- start 2023-12-19T16:17:37.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- start start 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b30b0 0x7f6410158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641013db10 con 0x7f64100ccd10 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641013f820 con 0x7f64100b30b0 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f641722d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641013ddb0 con 0x7f64100cc930 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60252/0 (socket says 172.21.15.73:60252) 2023-12-19T16:17:37.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 -- 172.21.15.73:0/3470958799 learned_addr learned my addr 172.21.15.73:0/3470958799 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f6414fc9640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b30b0 0x7f6410158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f6407fff640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 -- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 msgr2=0x7f641015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 -- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b30b0 msgr2=0x7f6410158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b30b0 0x7f6410158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f64157ca640 1 -- 172.21.15.73:0/3470958799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009b30 con 0x7f64100ccd10 2023-12-19T16:17:37.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.402+0000 7f6407fff640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64157ca640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f640801b050 tx=0x7f6408019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080b8880 con 0x7f64100ccd10 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080b8a00 con 0x7f64100ccd10 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080b8db0 con 0x7f64100ccd10 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641013e090 con 0x7f64100ccd10 2023-12-19T16:17:37.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6410158dd0 con 0x7f64100ccd10 2023-12-19T16:17:37.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410072750 con 0x7f64100ccd10 2023-12-19T16:17:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f64080c3460 con 0x7f64100ccd10 2023-12-19T16:17:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f640811e8e0 con 0x7f64100ccd10 2023-12-19T16:17:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.406+0000 7f6414fc9640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:37.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.410+0000 7f6414fc9640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 0x7f63fc067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f640c006b20 tx=0x7f640c010040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:37.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.410+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f64080ec360 con 0x7f64100ccd10 2023-12-19T16:17:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.590+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f641013e540 con 0x7f64100ccd10 2023-12-19T16:17:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f64057fa640 1 -- 172.21.15.73:0/3470958799 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f64080ef980 con 0x7f64100ccd10 2023-12-19T16:17:37.596 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:37.596 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:36.811024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:37.596 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 35 2023-12-19T16:17:37.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 msgr2=0x7f63fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 0x7f63fc067f20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f640c006b20 tx=0x7f640c010040 comp rx=0 tx=0).stop 2023-12-19T16:17:37.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 msgr2=0x7f641015e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:37.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f640801b050 tx=0x7f6408019740 comp rx=0 tx=0).stop 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 shutdown_connections 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f63fc065a60 0x7f63fc067f20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64100ccd10 0x7f641015e270 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f64100cc930 0x7f641015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 --2- 172.21.15.73:0/3470958799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64100b30b0 0x7f6410158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:37.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 >> 172.21.15.73:0/3470958799 conn(0x7f6410069cc0 msgr2=0x7f641013c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:37.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 shutdown_connections 2023-12-19T16:17:37.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:37.594+0000 7f641722d640 1 -- 172.21.15.73:0/3470958799 wait complete. 2023-12-19T16:17:38.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:22.120066+0000', 'modified': '2023-12-19T16:17:36.811024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.73:6837/2814692317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2814692317}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2814692317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:38.020 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5646:up:clientreplay 2023-12-19T16:17:38.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:38.589 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:38.810 INFO:tasks.ceph.mds.c.smithi073.stderr:2023-12-19T16:17:38.806+0000 7fc65859f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:17:39.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 Processor -- start 2023-12-19T16:17:39.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 -- start start 2023-12-19T16:17:39.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 0x7f3ccc0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc1436d0 con 0x7f3ccc0cc930 2023-12-19T16:17:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0b1ad0 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd3a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0b1db0 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd1027640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 0x7f3ccc0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd2029640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd1027640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 0x7f3ccc0b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:45192/0 (socket says 172.21.15.73:45192) 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd1027640 1 -- 172.21.15.73:0/3029891884 learned_addr learned my addr 172.21.15.73:0/3029891884 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd2029640 1 -- 172.21.15.73:0/3029891884 >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 msgr2=0x7f3ccc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd2029640 1 --2- 172.21.15.73:0/3029891884 >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 0x7f3ccc0b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd2029640 1 -- 172.21.15.73:0/3029891884 >> v1:172.21.15.162:6789/0 conn(0x7f3ccc0cc930 legacy=0x7f3ccc15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.166+0000 7f3cd2029640 1 -- 172.21.15.73:0/3029891884 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0b2090 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd2029640 1 --2- 172.21.15.73:0/3029891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc15b0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009d90 tx=0x7f3cc401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee515e848710f4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd0826640 1 -- 172.21.15.73:0/3029891884 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40a59e0 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd0826640 1 -- 172.21.15.73:0/3029891884 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40a5b40 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd0826640 1 -- 172.21.15.73:0/3029891884 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40ad440 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/3029891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 msgr2=0x7f3ccc15b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/3029891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc15b0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009d90 tx=0x7f3cc401c920 comp rx=0 tx=0).stop 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/3029891884 shutdown_connections 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/3029891884 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc15b0f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/3029891884 >> v2:172.21.15.162:3300/0 conn(0x7f3ccc0ccd10 0x7f3ccc0b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/3029891884 >> 172.21.15.73:0/3029891884 conn(0x7f3ccc069cc0 msgr2=0x7f3ccc06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/3029891884 shutdown_connections 2023-12-19T16:17:39.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.170+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/3029891884 wait complete. 2023-12-19T16:17:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 Processor -- start 2023-12-19T16:17:39.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- start start 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc0cc930 0x7f3ccc158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0aed10 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0abed0 con 0x7f3ccc0cc930 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0ae3e0 con 0x7f3ccc0b30b0 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60264/0 (socket says 172.21.15.73:60264) 2023-12-19T16:17:39.178 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 -- 172.21.15.73:0/2357788818 learned_addr learned my addr 172.21.15.73:0/2357788818 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd1027640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc0cc930 0x7f3ccc158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd1828640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 -- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 msgr2=0x7f3ccc0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 -- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc0cc930 msgr2=0x7f3ccc158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc0cc930 0x7f3ccc158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 -- 172.21.15.73:0/2357788818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009a70 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.179 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd2029640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cc401afd0 tx=0x7f3cc40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40add10 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc40ade70 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc40b9650 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc0ae6c0 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.174+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0ae090 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc0aee80 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3cc40b97b0 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cc27fc640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 0x7f3cb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3cc411e920 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cd1828640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 0x7f3cb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.178+0000 7f3cd1828640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 0x7f3cb0067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8007fd0 tx=0x7f3cc8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.182+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3cc40ec200 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ccc072750 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.369 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cc27fc640 1 -- 172.21.15.73:0/2357788818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f3cc40b2020 con 0x7f3ccc0ccd10 2023-12-19T16:17:39.369 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:39.369 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:39.370 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 msgr2=0x7f3cb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.371 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 0x7f3cb0067f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8007fd0 tx=0x7f3cc8009040 comp rx=0 tx=0).stop 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 msgr2=0x7f3ccc06f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3cc401afd0 tx=0x7f3cc40196c0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 shutdown_connections 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3cb0065a60 0x7f3cb0067f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ccc0ccd10 0x7f3ccc06f330 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.372 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ccc0cc930 0x7f3ccc158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 --2- 172.21.15.73:0/2357788818 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ccc0b30b0 0x7f3ccc0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 >> 172.21.15.73:0/2357788818 conn(0x7f3ccc069cc0 msgr2=0x7f3ccc06bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 shutdown_connections 2023-12-19T16:17:39.373 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.366+0000 7f3cd3a8c640 1 -- 172.21.15.73:0/2357788818 wait complete. 2023-12-19T16:17:39.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T16:17:22.120066+0000', 'modified': '2023-12-19T16:17:37.818779+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 54, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5646': {'gid': 5646, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.73:6837/2814692317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6835', 'nonce': 2814692317}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 2814692317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T16:17:39.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T16:17:39.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T16:17:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 Processor -- start 2023-12-19T16:17:39.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 -- start start 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a800cd400 0x7f4a8015d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a800c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a80154450 con 0x7f4a80154070 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8015e370 con 0x7f4a800cd400 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a85e41640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8015a060 con 0x7f4a8015db60 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a800cd400 0x7f4a8015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a800cd400 0x7f4a8015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60276/0 (socket says 172.21.15.73:60276) 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 -- 172.21.15.73:0/1177897125 learned_addr learned my addr 172.21.15.73:0/1177897125 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a800c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 -- 172.21.15.73:0/1177897125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 msgr2=0x7f4a800c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a800c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 -- 172.21.15.73:0/1177897125 >> v1:172.21.15.162:6789/0 conn(0x7f4a80154070 legacy=0x7f4a800cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.930+0000 7f4a7effd640 1 -- 172.21.15.73:0/1177897125 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8015a340 con 0x7f4a800cd400 2023-12-19T16:17:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a7effd640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a8015d620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009870 tx=0x7f4a7401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1394b7e843197872 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a7e7fc640 1 -- 172.21.15.73:0/1177897125 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740aa670 con 0x7f4a800cd400 2023-12-19T16:17:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a7e7fc640 1 -- 172.21.15.73:0/1177897125 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a740aa7d0 con 0x7f4a800cd400 2023-12-19T16:17:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a7e7fc640 1 -- 172.21.15.73:0/1177897125 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740aab60 con 0x7f4a800cd400 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 -- 172.21.15.73:0/1177897125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 msgr2=0x7f4a8015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a8015d620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009870 tx=0x7f4a7401c510 comp rx=0 tx=0).stop 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 -- 172.21.15.73:0/1177897125 shutdown_connections 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a800c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 --2- 172.21.15.73:0/1177897125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a8015d620 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 -- 172.21.15.73:0/1177897125 >> 172.21.15.73:0/1177897125 conn(0x7f4a800ce950 msgr2=0x7f4a800ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 -- 172.21.15.73:0/1177897125 shutdown_connections 2023-12-19T16:17:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.934+0000 7f4a85e41640 1 -- 172.21.15.73:0/1177897125 wait complete. 2023-12-19T16:17:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 Processor -- start 2023-12-19T16:17:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- start start 2023-12-19T16:17:39.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a80154070 0x7f4a8006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a8006c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8006f880 con 0x7f4a800cd400 2023-12-19T16:17:39.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80143770 con 0x7f4a80154070 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80143a50 con 0x7f4a8015db60 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60284/0 (socket says 172.21.15.73:60284) 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/2966560470 learned_addr learned my addr 172.21.15.73:0/2966560470 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a8006c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7effd640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a80154070 0x7f4a8006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 msgr2=0x7f4a8006c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a8006c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a80154070 msgr2=0x7f4a8006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a80154070 0x7f4a8006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/2966560470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740094d0 con 0x7f4a800cd400 2023-12-19T16:17:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c450 tx=0x7f4a7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a67fff640 1 -- 172.21.15.73:0/2966560470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a700052d0 con 0x7f4a800cd400 2023-12-19T16:17:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a67fff640 1 -- 172.21.15.73:0/2966560470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70005450 con 0x7f4a800cd400 2023-12-19T16:17:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a67fff640 1 -- 172.21.15.73:0/2966560470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012870 con 0x7f4a800cd400 2023-12-19T16:17:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a80143d30 con 0x7f4a800cd400 2023-12-19T16:17:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.938+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80144010 con 0x7f4a800cd400 2023-12-19T16:17:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a67fff640 1 -- 172.21.15.73:0/2966560470 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a700129d0 con 0x7f4a800cd400 2023-12-19T16:17:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a67fff640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 0x7f4a6c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a67fff640 1 -- 172.21.15.73:0/2966560470 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a70082b40 con 0x7f4a800cd400 2023-12-19T16:17:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a7effd640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 0x7f4a6c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a891a9000 1 Processor -- start 2023-12-19T16:17:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a891a9000 1 -- start start 2023-12-19T16:17:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.942+0000 7f4a7effd640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 0x7f4a6c067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ae000 tx=0x7f4a740b5040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x55876653ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x55876653b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876635ec90 con 0x558766585070 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558766390220 con 0x558766585990 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55876638d7f0 con 0x55876653b1c0 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60298/0 (socket says 172.21.15.73:60298) 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/3151522149 learned_addr learned my addr 172.21.15.73:0/3151522149 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x55876653b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x55876653ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 msgr2=0x55876653b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x55876653b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 msgr2=0x55876653ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x55876653ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 -- 172.21.15.73:0/3151522149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558766085890 con 0x558766585070 2023-12-19T16:17:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4a700810c0 tx=0x7f4a70053f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05e5e65c5983d96 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a657fa640 1 -- 172.21.15.73:0/3151522149 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7006b070 con 0x558766585070 2023-12-19T16:17:39.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a657fa640 1 -- 172.21.15.73:0/3151522149 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70052640 con 0x558766585070 2023-12-19T16:17:39.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a657fa640 1 -- 172.21.15.73:0/3151522149 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012c80 con 0x558766585070 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- 172.21.15.73:0/3151522149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 msgr2=0x558766585450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4a700810c0 tx=0x7f4a70053f10 comp rx=0 tx=0).stop 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- 172.21.15.73:0/3151522149 shutdown_connections 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x55876653b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x55876653ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3151522149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766585450 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- 172.21.15.73:0/3151522149 >> 172.21.15.73:0/3151522149 conn(0x558766541950 msgr2=0x558766539560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- 172.21.15.73:0/3151522149 shutdown_connections 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- 172.21.15.73:0/3151522149 wait complete. 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 -- start start 2023-12-19T16:17:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.946+0000 7f4a891a9000 1 Processor -- start 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x558766540740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587663890e0 con 0x558766585070 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558766328310 con 0x558766585990 2023-12-19T16:17:39.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x558766346770 con 0x55876653b1c0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 10 client.0 _ll_register_callbacks cb 0x558766526b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60306/0 (socket says 172.21.15.73:60306) 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 -- 172.21.15.73:0/3817167700 learned_addr learned my addr 172.21.15.73:0/3817167700 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x558766540740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 -- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 msgr2=0x558766540740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x558766540740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 -- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 msgr2=0x5587665475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 -- 172.21.15.73:0/3817167700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80144010 con 0x558766585070 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401a140 tx=0x7f4a7401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc07ed9fa8e70270 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:17:39.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740c4070 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a740bd4b0 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558766358c10 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a740bd670 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 10 client.5682 fetch_fsmap learned FSMap version 36 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55876634e260 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558766358c10 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4a740a8050 con 0x558766585070 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 10 client.5682 fetch_fsmap finished waiting for FSMap version 36 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 10 client.5682 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 20 client.5682 populate_metadata read hostname 'smithi073' 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x55876658c8d0 0x55876658ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 4 client.5682 mds_command: new command op to 5646 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 --> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558766387a30 con 0x55876658c8d0 2023-12-19T16:17:39.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x55876658c8d0 0x55876658ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 10 client.5682 ms_handle_connect on v2:172.21.15.73:6835/2814692317 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x55876658c8d0 0x55876658ccb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b3a1d531bd09f68 server_cookie=b059a64c5a05f9b2 in_seq=0 out_seq=0 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/3817167700 <== mds.0 v2:172.21.15.73:6835/2814692317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558766387a30 con 0x55876658c8d0 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 10 client.5682 handle_command_reply: tid=0 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 client.5682 shutdown 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 msgr2=0x558766547080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401a140 tx=0x7f4a7401ad50 comp rx=0 tx=0).stop 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 shutdown_connections 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x55876658c8d0 0x55876658ccb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a5e7fc640 0 client.5682 ms_handle_reset on v2:172.21.15.73:6835/2814692317 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x558766547080 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3817167700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x558766540740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.950+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 >> 172.21.15.73:0/3817167700 conn(0x558766541950 msgr2=0x558766539c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.954+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 shutdown_connections 2023-12-19T16:17:39.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.954+0000 7f4a891a9000 1 -- 172.21.15.73:0/3817167700 wait complete. 2023-12-19T16:17:39.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.954+0000 7f4a891a9000 20 client.5682 trim_cache size 0 max 16384 2023-12-19T16:17:39.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.966+0000 7f4a891a9000 1 Processor -- start 2023-12-19T16:17:39.970 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.966+0000 7f4a891a9000 1 -- start start 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.966+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55876653b1c0 0x5587665dd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558766585990 0x5587665ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558766046940 con 0x558766585070 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876653e880 con 0x55876653b1c0 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x558766383660 con 0x558766585990 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60310/0 (socket says 172.21.15.73:60310) 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 -- 172.21.15.73:0/3585572336 learned_addr learned my addr 172.21.15.73:0/3585572336 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558766585990 0x5587665ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55876653b1c0 0x5587665dd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 -- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558766585990 msgr2=0x5587665ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558766585990 0x5587665ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 -- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55876653b1c0 msgr2=0x5587665dd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55876653b1c0 0x5587665dd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.973 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 -- 172.21.15.73:0/3585572336 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587663343b0 con 0x558766585070 2023-12-19T16:17:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a7effd640 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4a74019120 tx=0x7f4a740c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49baf515fbb2f1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a65ffb640 1 -- 172.21.15.73:0/3585572336 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740aad60 con 0x558766585070 2023-12-19T16:17:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a65ffb640 1 -- 172.21.15.73:0/3585572336 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a740bd4b0 con 0x558766585070 2023-12-19T16:17:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a65ffb640 1 -- 172.21.15.73:0/3585572336 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740bdaa0 con 0x558766585070 2023-12-19T16:17:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- 172.21.15.73:0/3585572336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 msgr2=0x5587665dd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4a74019120 tx=0x7f4a740c4000 comp rx=0 tx=0).stop 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- 172.21.15.73:0/3585572336 shutdown_connections 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x558766585990 0x5587665ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665dd830 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- 172.21.15.73:0/3585572336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55876653b1c0 0x5587665dd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- 172.21.15.73:0/3585572336 >> 172.21.15.73:0/3585572336 conn(0x558766541950 msgr2=0x558766546f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- 172.21.15.73:0/3585572336 shutdown_connections 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- 172.21.15.73:0/3585572336 wait complete. 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- start start 2023-12-19T16:17:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 Processor -- start 2023-12-19T16:17:39.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x5587665c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876638d0e0 con 0x558766585070 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587663864e0 con 0x558766585990 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.970+0000 7f4a891a9000 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x55876638a670 con 0x55876653b1c0 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 10 client.0 _ll_register_callbacks cb 0x558766337640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60314/0 (socket says 172.21.15.73:60314) 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 -- 172.21.15.73:0/1852844820 learned_addr learned my addr 172.21.15.73:0/1852844820 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x5587665c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7ffff640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 -- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 msgr2=0x5587665c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x5587665c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 -- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 msgr2=0x5587665c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 -- 172.21.15.73:0/1852844820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55876634e260 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7effd640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401abc0 tx=0x7f4a74009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28a39b0777d568f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a740c4040 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4a740aad60 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587665413c0 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a740bde70 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 10 client.5688 fetch_fsmap learned FSMap version 36 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x558766085cc0 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587665413c0 con 0x558766585070 2023-12-19T16:17:39.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4a740df060 con 0x558766585070 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 10 client.5688 fetch_fsmap finished waiting for FSMap version 36 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 10 client.5688 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 20 client.5688 populate_metadata read hostname 'smithi073' 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x5587665c7320 0x5587665ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 4 client.5688 mds_command: new command op to 5646 tid=0[{"prefix": "status"}] 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 --> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55876634ee00 con 0x5587665c7320 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x5587665c7320 0x5587665ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a7f7fe640 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x5587665c7320 0x5587665ea590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89f9c1a2b07cbcb server_cookie=38c69fe00d3a9449 in_seq=0 out_seq=0 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 10 client.5688 ms_handle_connect on v2:172.21.15.73:6835/2814692317 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 1 -- 172.21.15.73:0/1852844820 <== mds.0 v2:172.21.15.73:6835/2814692317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55876634ee00 con 0x5587665c7320 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 10 client.5688 handle_command_reply: tid=0 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 client.5688 shutdown 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 msgr2=0x5587665c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4a7401abc0 tx=0x7f4a74009240 comp rx=0 tx=0).stop 2023-12-19T16:17:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 shutdown_connections 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:6835/2814692317,v1:172.21.15.73:6837/2814692317] conn(0x5587665c7320 0x5587665ea590 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558766585990 0x5587665c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a5e7fc640 0 client.5688 ms_handle_reset on v2:172.21.15.73:6835/2814692317 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558766585070 0x5587665c68a0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 --2- 172.21.15.73:0/1852844820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55876653b1c0 0x5587665c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 >> 172.21.15.73:0/1852844820 conn(0x558766541950 msgr2=0x558766582060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 shutdown_connections 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 1 -- 172.21.15.73:0/1852844820 wait complete. 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a891a9000 20 client.5688 trim_cache size 0 max 16384 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:17:39.983 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "90ec874a-c348-4a69-99d9-d4bef3b9261d", 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5646, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 6.1702129689999996, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 36, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 56, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 56, 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 6.2039654200000003 2023-12-19T16:17:39.984 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 msgr2=0x7f4a6c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 0x7f4a6c067f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a740ae000 tx=0x7f4a740b5040 comp rx=0 tx=0).stop 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 msgr2=0x7f4a80142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c450 tx=0x7f4a7000c910 comp rx=0 tx=0).stop 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 shutdown_connections 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a8015db60 0x7f4a8006c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a80154070 0x7f4a8006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a6c065a60 0x7f4a6c067f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 --2- 172.21.15.73:0/2966560470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a800cd400 0x7f4a80142530 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:39.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 >> 172.21.15.73:0/2966560470 conn(0x7f4a800ce950 msgr2=0x7f4a800ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:39.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 shutdown_connections 2023-12-19T16:17:39.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:39.974+0000 7f4a85e41640 1 -- 172.21.15.73:0/2966560470 wait complete. 2023-12-19T16:17:39.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:40.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.130+0000 7fc283bf0640 1 Processor -- start 2023-12-19T16:17:40.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.130+0000 7fc283bf0640 1 -- start start 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc283bf0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c06bc30 0x7fc27c06c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc283bf0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 0x7fc27c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc283bf0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0b2690 con 0x7fc27c0b0e10 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc283bf0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c06c550 con 0x7fc27c06bc30 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc283bf0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0b1b10 con 0x7fc27c06cda0 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c06bc30 0x7fc27c06c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc27c06bc30 0x7fc27c06c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60326/0 (socket says 172.21.15.73:60326) 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 -- 172.21.15.73:0/3088258140 learned_addr learned my addr 172.21.15.73:0/3088258140 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:40.137 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28218d640 1 --1- 172.21.15.73:0/3088258140 >> v1:172.21.15.73:6789/0 conn(0x7fc27c0b0e10 0x7fc27c15cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59484/0 (socket says 172.21.15.73:59484) 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28118b640 1 --2- 172.21.15.73:0/3088258140 >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 0x7fc27c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 -- 172.21.15.73:0/3088258140 >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 msgr2=0x7fc27c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 --2- 172.21.15.73:0/3088258140 >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 0x7fc27c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 -- 172.21.15.73:0/3088258140 >> v1:172.21.15.73:6789/0 conn(0x7fc27c0b0e10 legacy=0x7fc27c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28198c640 1 -- 172.21.15.73:0/3088258140 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0b1df0 con 0x7fc27c06bc30 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28098a640 1 -- 172.21.15.73:0/3088258140 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808688289 0 0) 0x7fc27c0b2690 con 0x7fc27c0b0e10 2023-12-19T16:17:40.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.134+0000 7fc28118b640 1 --2- 172.21.15.73:0/3088258140 >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 0x7fc27c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:40.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc28198c640 1 --2- 172.21.15.73:0/3088258140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c06c010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc27c06d370 tx=0x7fc27801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2976bef6400bc2f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc28098a640 1 -- 172.21.15.73:0/3088258140 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780ab600 con 0x7fc27c06bc30 2023-12-19T16:17:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc28098a640 1 -- 172.21.15.73:0/3088258140 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2780a7050 con 0x7fc27c06bc30 2023-12-19T16:17:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc28098a640 1 -- 172.21.15.73:0/3088258140 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780ab980 con 0x7fc27c06bc30 2023-12-19T16:17:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- 172.21.15.73:0/3088258140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 msgr2=0x7fc27c06c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3088258140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c06c010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc27c06d370 tx=0x7fc27801c440 comp rx=0 tx=0).stop 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- 172.21.15.73:0/3088258140 shutdown_connections 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3088258140 >> v2:172.21.15.162:3300/0 conn(0x7fc27c06cda0 0x7fc27c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3088258140 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c06c010 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- 172.21.15.73:0/3088258140 >> 172.21.15.73:0/3088258140 conn(0x7fc27c069cc0 msgr2=0x7fc27c06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- 172.21.15.73:0/3088258140 shutdown_connections 2023-12-19T16:17:40.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- 172.21.15.73:0/3088258140 wait complete. 2023-12-19T16:17:40.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 Processor -- start 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.138+0000 7fc283bf0640 1 -- start start 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c06cda0 0x7fc27c146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc27c0b0e10 0x7fc27c162110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c145930 con 0x7fc27c06bc30 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c137670 con 0x7fc27c06cda0 2023-12-19T16:17:40.146 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c1f60a0 con 0x7fc27c0b0e10 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60340/0 (socket says 172.21.15.73:60340) 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 -- 172.21.15.73:0/3927468775 learned_addr learned my addr 172.21.15.73:0/3927468775 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28118b640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c06cda0 0x7fc27c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28218d640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc27c0b0e10 0x7fc27c162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 -- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc27c0b0e10 msgr2=0x7fc27c162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.147 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc27c0b0e10 0x7fc27c162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 -- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c06cda0 msgr2=0x7fc27c146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c06cda0 0x7fc27c146380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 -- 172.21.15.73:0/3927468775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780094d0 con 0x7fc27c06bc30 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc28198c640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc2780ae040 tx=0x7fc27801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b6620 con 0x7fc27c06bc30 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2780b67a0 con 0x7fc27c06bc30 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b6b50 con 0x7fc27c06bc30 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c1f6380 con 0x7fc27c06bc30 2023-12-19T16:17:40.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c145e60 con 0x7fc27c06bc30 2023-12-19T16:17:40.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c072750 con 0x7fc27c06bc30 2023-12-19T16:17:40.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.142+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2780b2040 con 0x7fc27c06bc30 2023-12-19T16:17:40.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.146+0000 7fc2727fc640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 0x7fc260067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:40.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.146+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc27811d590 con 0x7fc27c06bc30 2023-12-19T16:17:40.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.146+0000 7fc28118b640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 0x7fc260067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:40.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.146+0000 7fc28118b640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 0x7fc260067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc27c071310 tx=0x7fc26c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:40.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.150+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2780eaee0 con 0x7fc27c06bc30 2023-12-19T16:17:40.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.330+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc27c0cbf70 con 0x7fc27c06bc30 2023-12-19T16:17:40.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.330+0000 7fc2727fc640 1 -- 172.21.15.73:0/3927468775 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fc2780ee500 con 0x7fc27c06bc30 2023-12-19T16:17:40.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:40.334 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:40.334 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:40.335 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 msgr2=0x7fc260067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 0x7fc260067f20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc27c071310 tx=0x7fc26c008040 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 msgr2=0x7fc27c137130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc2780ae040 tx=0x7fc27801ac80 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 shutdown_connections 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc27c0b0e10 0x7fc27c162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc27c06cda0 0x7fc27c146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc260065a60 0x7fc260067f20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 --2- 172.21.15.73:0/3927468775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc27c06bc30 0x7fc27c137130 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 >> 172.21.15.73:0/3927468775 conn(0x7fc27c069cc0 msgr2=0x7fc27c06f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 shutdown_connections 2023-12-19T16:17:40.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:40.334+0000 7fc283bf0640 1 -- 172.21.15.73:0/3927468775 wait complete. 2023-12-19T16:17:40.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:40.511 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":30,"msgr_send_messages":25,"msgr_recv_bytes":106399,"msgr_send_bytes":8842,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.009691277,"msgr_running_send_time":0.001031435,"msgr_running_recv_time":0.006652862,"msgr_running_fast_dispatch_time":0.000360738,"msgr_send_messages_queue_lat":{"avgcount":25,"sum":0.008442858,"avgtime":0.000337714},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":102368,"msgr_send_encrypted_bytes":5440},"AsyncMessenger::Worker-1":{"msgr_recv_messages":33,"msgr_send_messages":33,"msgr_recv_bytes":16057,"msgr_send_bytes":98898,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.009486527,"msgr_running_send_time":0.001701567,"msgr_running_recv_time":0.006943835,"msgr_running_fast_dispatch_time":0.000677212,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.010043325,"avgtime":0.000313853},"msgr_handle_ack_lat":{"avgcount":3,"sum":0.000002142,"avgtime":0.000000714},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":89168},"AsyncMessenger::Worker-2":{"msgr_recv_messages":17,"msgr_send_messages":18,"msgr_recv_bytes":12461,"msgr_send_bytes":23408,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.004898729,"msgr_running_send_time":0.000581995,"msgr_running_recv_time":0.003516246,"msgr_running_fast_dispatch_time":0.000402596,"msgr_send_messages_queue_lat":{"avgcount":17,"sum":0.006943807,"avgtime":0.000408459},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":48,"sum":0.003126343,"avgtime":0.000065132}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":2,"reply":0,"reply_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":7,"inodes_bottom":3,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":1,"traverse_hit":1,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":152,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":0},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":2,"evex":0,"evtrm":0,"ev":4,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196381,"rdpos":4195196,"jlat":{"avgcount":2,"sum":0.004705980,"avgtime":0.002352990},"replayed":2},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":1,"cap-":0,"rss":40476,"heap":223528},"mds_server":{"dispatch_client_request":1,"dispatch_server_request":0,"handle_client_request":2,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":0,"average_load":0,"avg_session_uptime":915,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229125,"buffer_anon_items":63,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51616,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":1469,"op_resend":0,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.103997527,"avgtime":0.002260815},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":92},"op":46,"op_r":36,"op_w":10,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":2,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":1},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":76,"get_sum":125564,"get_or_fail_fail":0,"get_or_fail_success":76,"take":0,"take_sum":0,"put":76,"put_sum":125564,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":2351,"put":46,"put_sum":2351,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":2,"get_sum":931,"get_or_fail_fail":0,"get_or_fail_success":2,"take":0,"take_sum":0,"put":2,"put_sum":931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:40.513 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 106399, "msgr_recv_encrypted_bytes": 102368, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.000360738, "msgr_running_recv_time": 0.006652862, "msgr_running_send_time": 0.001031435, "msgr_running_total_time": 0.009691277, "msgr_send_bytes": 8842, "msgr_send_encrypted_bytes": 5440, "msgr_send_messages": 25, "msgr_send_messages_queue_lat": { "avgcount": 25, "avgtime": 0.000337714, "sum": 0.008442858 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 3, "avgtime": 7.14e-07, "sum": 2.142e-06 }, "msgr_recv_bytes": 16057, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 33, "msgr_running_fast_dispatch_time": 0.000677212, "msgr_running_recv_time": 0.006943835, "msgr_running_send_time": 0.001701567, "msgr_running_total_time": 0.009486527, "msgr_send_bytes": 98898, "msgr_send_encrypted_bytes": 89168, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000313853, "sum": 0.010043325 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 12461, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 17, "msgr_running_fast_dispatch_time": 0.000402596, "msgr_running_recv_time": 0.003516246, "msgr_running_send_time": 0.000581995, "msgr_running_total_time": 0.004898729, "msgr_send_bytes": 23408, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 17, "avgtime": 0.000408459, "sum": 0.006943807 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 48, "avgtime": 6.5132e-05, "sum": 0.003126343 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 3, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 7, "inodes_with_caps": 1, "load_cent": 152, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 0, "q": 0, "reply": 0, "reply_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "request": 2, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 1, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 1, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 4, "evadd": 2, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 2, "avgtime": 0.00235299, "sum": 0.00470598 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196381 }, "mds_mem": { "cap": 1, "cap+": 1, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 223528, "ino": 13, "ino+": 13, "ino-": 0, "rss": 40476 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 1, "dispatch_server_request": 0, "handle_client_request": 2, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 0, "avg_session_uptime": 915, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 0 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229125, "buffer_anon_items": 63, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51616, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.002260815, "sum": 0.103997527 }, "op_pg": 0, "op_r": 36, "op_reply": 46, "op_resend": 0, "op_rmw": 0, "op_send": 46, "op_send_bytes": 1469, "op_w": 10, "oplen_avg": { "avgcount": 46, "sum": 92 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 1 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 76, "get_or_fail_fail": 0, "get_or_fail_success": 76, "get_started": 0, "get_sum": 125564, "max": 104857600, "put": 76, "put_sum": 125564, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 2351, "take": 46, "take_sum": 2351, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 2, "get_or_fail_fail": 0, "get_or_fail_success": 2, "get_started": 0, "get_sum": 931, "max": 3758096384, "put": 2, "put_sum": 931, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:40.513 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_0:0 2023-12-19T16:17:40.513 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:17:40.513 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:17:40.522 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T16:17:40.522 DEBUG:teuthology.orchestra.run.smithi073:> import time 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> with open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", '"'"'w'"'"') as f: 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> f.write("content") 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> f.flush() 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> while True: 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> time.sleep(1) 2023-12-19T16:17:40.523 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T16:17:40.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-19T16:17:40.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T16:17:40.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-19T16:17:40.570 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2023-12-19T16:17:40.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:17:40.580 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/omap_counter_test_file': No such file or directory 2023-12-19T16:17:41.581 DEBUG:teuthology.orchestra.run.smithi073:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2023-12-19T16:17:41.592 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T16:17:41.592 INFO:tasks.cephfs.mount:File omap_counter_test_file became visible with size 7 from 0 after 1s 2023-12-19T16:17:41.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:41.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.778+0000 7f7154803640 1 Processor -- start 2023-12-19T16:17:41.782 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.778+0000 7f7154803640 1 -- start start 2023-12-19T16:17:41.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f7154803640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71500ad9c0 0x7f71500cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f7154803640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500ce390 con 0x7f7150160fc0 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f7154803640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715006c650 con 0x7f71500cdf40 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f7154803640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71500cc250 con 0x7f71500ad9c0 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7150160fc0 0x7f71500ca220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59486/0 (socket says 172.21.15.73:59486) 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 -- 172.21.15.73:0/639258820 learned_addr learned my addr 172.21.15.73:0/639258820 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:41.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714e59c640 1 --2- 172.21.15.73:0/639258820 >> v2:172.21.15.162:3300/0 conn(0x7f71500ad9c0 0x7f71500cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865465903 0 0) 0x7f7140001120 con 0x7f7150160fc0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7138003530 con 0x7f7150160fc0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811810378 0 0) 0x7f715006c650 con 0x7f71500cdf40 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7140001120 con 0x7f71500cdf40 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451597895 0 0) 0x7f7138003530 con 0x7f7150160fc0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 >> v2:172.21.15.162:3300/0 conn(0x7f71500ad9c0 msgr2=0x7f71500cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 --2- 172.21.15.73:0/639258820 >> v2:172.21.15.162:3300/0 conn(0x7f71500ad9c0 0x7f71500cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 >> v1:172.21.15.162:6789/0 conn(0x7f71500cdf40 legacy=0x7f71500cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715006bbc0 con 0x7f7150160fc0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f7140001810 con 0x7f7150160fc0 2023-12-19T16:17:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 >> v1:172.21.15.73:6789/0 conn(0x7f7150160fc0 legacy=0x7f71500ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 0x7f7138003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71380047d0 0x7f7138004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138005190 0x7f713800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500cc250 con 0x7f7138003b10 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713800c010 con 0x7f7138005190 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713800c1d0 con 0x7f71380047d0 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 0x7f7138003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714f59e640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138005190 0x7f713800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714e59c640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71380047d0 0x7f7138004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 -- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71380047d0 msgr2=0x7f7138004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71380047d0 0x7f7138004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 -- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138005190 msgr2=0x7f713800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138005190 0x7f713800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714ed9d640 1 -- 172.21.15.73:0/639258820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138003530 con 0x7f7138003b10 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714f59e640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138005190 0x7f713800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.782+0000 7f714f59e640 1 -- 172.21.15.73:0/639258820 reap_dead start 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f714ed9d640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 0x7f7138003f10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7140007fd0 tx=0x7f714001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ede09270b0ba2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400a5920 con 0x7f7138003b10 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400a5aa0 con 0x7f7138003b10 2023-12-19T16:17:41.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f714dd9b640 1 -- 172.21.15.73:0/639258820 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400a5e90 con 0x7f7138003b10 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 -- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 msgr2=0x7f7138003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 0x7f7138003f10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7140007fd0 tx=0x7f714001cb90 comp rx=0 tx=0).stop 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 -- 172.21.15.73:0/639258820 shutdown_connections 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 --2- 172.21.15.73:0/639258820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7138003b10 0x7f7138003f10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 -- 172.21.15.73:0/639258820 >> 172.21.15.73:0/639258820 conn(0x7f715006a400 msgr2=0x7f71500b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:41.789 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 -- 172.21.15.73:0/639258820 shutdown_connections 2023-12-19T16:17:41.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.786+0000 7f7154803640 1 -- 172.21.15.73:0/639258820 wait complete. 2023-12-19T16:17:41.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 Processor -- start 2023-12-19T16:17:41.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- start start 2023-12-19T16:17:41.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 0x7f71500c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71500af770 0x7f71500afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500c2bd0 con 0x7f715015b070 2023-12-19T16:17:41.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500b0130 con 0x7f7138003b10 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71500c2db0 con 0x7f71500af770 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60348/0 (socket says 172.21.15.73:60348) 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 -- 172.21.15.73:0/3767837455 learned_addr learned my addr 172.21.15.73:0/3767837455 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714ed9d640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 0x7f71500c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714f59e640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71500af770 0x7f71500afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 -- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71500af770 msgr2=0x7f71500afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71500af770 0x7f71500afbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 -- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 msgr2=0x7f71500c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 0x7f71500c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 -- 172.21.15.73:0/3767837455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500c3090 con 0x7f715015b070 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714ed9d640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 0x7f71500c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f714e59c640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7144011500 tx=0x7f71440119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144015870 con 0x7f715015b070 2023-12-19T16:17:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71440159d0 con 0x7f715015b070 2023-12-19T16:17:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144015d40 con 0x7f715015b070 2023-12-19T16:17:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71500c3370 con 0x7f715015b070 2023-12-19T16:17:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715015b4f0 con 0x7f715015b070 2023-12-19T16:17:41.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.790+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500741a0 con 0x7f715015b070 2023-12-19T16:17:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.794+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7144013400 con 0x7f715015b070 2023-12-19T16:17:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.794+0000 7f71377fe640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.794+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f71440836a0 con 0x7f715015b070 2023-12-19T16:17:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.794+0000 7f714ed9d640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:41.798 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.794+0000 7f714ed9d640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 0x7f713c067f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71400aa000 tx=0x7f7140006040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:41.801 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.798+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7144050f70 con 0x7f715015b070 2023-12-19T16:17:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.978+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f715006bf20 con 0x7f715015b070 2023-12-19T16:17:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f71377fe640 1 -- 172.21.15.73:0/3767837455 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f7144054590 con 0x7f715015b070 2023-12-19T16:17:41.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:41.984 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:41.984 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:41.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 msgr2=0x7f713c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 0x7f713c067f50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f71400aa000 tx=0x7f7140006040 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 msgr2=0x7f715015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7144011500 tx=0x7f71440119c0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 shutdown_connections 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71500af770 0x7f71500afbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f713c065a90 0x7f713c067f50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f715015b070 0x7f715015a430 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 --2- 172.21.15.73:0/3767837455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7138003b10 0x7f71500c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 >> 172.21.15.73:0/3767837455 conn(0x7f715006a400 msgr2=0x7f7150070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 shutdown_connections 2023-12-19T16:17:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:41.982+0000 7f7154803640 1 -- 172.21.15.73:0/3767837455 wait complete. 2023-12-19T16:17:42.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:42.159 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":31,"msgr_send_messages":26,"msgr_recv_bytes":106671,"msgr_send_bytes":9434,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.009812623,"msgr_running_send_time":0.001104694,"msgr_running_recv_time":0.006672893,"msgr_running_fast_dispatch_time":0.000380282,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.008494768,"avgtime":0.000326721},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":102640,"msgr_send_encrypted_bytes":6032},"AsyncMessenger::Worker-1":{"msgr_recv_messages":38,"msgr_send_messages":36,"msgr_recv_bytes":17737,"msgr_send_bytes":102317,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010130880,"msgr_running_send_time":0.002028386,"msgr_running_recv_time":0.007176201,"msgr_running_fast_dispatch_time":0.000791807,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.010140732,"avgtime":0.000289735},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000003387,"avgtime":0.000000677},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":89168},"AsyncMessenger::Worker-2":{"msgr_recv_messages":17,"msgr_send_messages":18,"msgr_recv_bytes":12461,"msgr_send_bytes":23408,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.004898729,"msgr_running_send_time":0.000581995,"msgr_running_recv_time":0.003516246,"msgr_running_fast_dispatch_time":0.000402596,"msgr_send_messages_queue_lat":{"avgcount":17,"sum":0.006943807,"avgtime":0.000408459},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":50,"sum":0.003326310,"avgtime":0.000066526}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":152,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":3,"evex":0,"evtrm":0,"ev":5,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198109,"rdpos":4195196,"jlat":{"avgcount":3,"sum":0.007375586,"avgtime":0.002458528},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41628,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":915,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229125,"buffer_anon_items":63,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51616,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":47,"op_send_bytes":3197,"op_resend":0,"op_reply":47,"op_latency":{"avgcount":47,"sum":0.107997444,"avgtime":0.002297817},"op_inflight":0,"oplen_avg":{"avgcount":47,"sum":93},"op":47,"op_r":36,"op_w":11,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":82,"get_sum":126988,"get_or_fail_fail":0,"get_or_fail_success":82,"take":0,"take_sum":0,"put":82,"put_sum":126988,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":47,"take_sum":4079,"put":47,"put_sum":4079,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":47,"take_sum":47,"put":47,"put_sum":47,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2659,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2659,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:42.161 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 106671, "msgr_recv_encrypted_bytes": 102640, "msgr_recv_messages": 31, "msgr_running_fast_dispatch_time": 0.000380282, "msgr_running_recv_time": 0.006672893, "msgr_running_send_time": 0.001104694, "msgr_running_total_time": 0.009812623, "msgr_send_bytes": 9434, "msgr_send_encrypted_bytes": 6032, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.000326721, "sum": 0.008494768 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 6.77e-07, "sum": 3.387e-06 }, "msgr_recv_bytes": 17737, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 38, "msgr_running_fast_dispatch_time": 0.000791807, "msgr_running_recv_time": 0.007176201, "msgr_running_send_time": 0.002028386, "msgr_running_total_time": 0.01013088, "msgr_send_bytes": 102317, "msgr_send_encrypted_bytes": 89168, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000289735, "sum": 0.010140732 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 12461, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 17, "msgr_running_fast_dispatch_time": 0.000402596, "msgr_running_recv_time": 0.003516246, "msgr_running_send_time": 0.000581995, "msgr_running_total_time": 0.004898729, "msgr_send_bytes": 23408, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 18, "msgr_send_messages_queue_lat": { "avgcount": 17, "avgtime": 0.000408459, "sum": 0.006943807 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 50, "avgtime": 6.6526e-05, "sum": 0.00332631 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 152, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 5, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002458528, "sum": 0.007375586 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4198109 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41628 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 915, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229125, "buffer_anon_items": 63, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51616, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 47, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 47, "avgtime": 0.002297817, "sum": 0.107997444 }, "op_pg": 0, "op_r": 36, "op_reply": 47, "op_resend": 0, "op_rmw": 0, "op_send": 47, "op_send_bytes": 3197, "op_w": 11, "oplen_avg": { "avgcount": 47, "sum": 93 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 82, "get_or_fail_fail": 0, "get_or_fail_success": 82, "get_started": 0, "get_sum": 126988, "max": 104857600, "put": 82, "put_sum": 126988, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 47, "put_sum": 4079, "take": 47, "take_sum": 4079, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 47, "put_sum": 47, "take": 47, "take_sum": 47, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2659, "max": 3758096384, "put": 3, "put_sum": 2659, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:42.161 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:17:47.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:47.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.306+0000 7f3c31da2640 1 Processor -- start 2023-12-19T16:17:47.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.306+0000 7f3c31da2640 1 -- start start 2023-12-19T16:17:47.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c31da2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c2c0cc540 0x7f3c2c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c31da2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c2c06b070 0x7f3c2c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c31da2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c2c0cd000 con 0x7f3c2c160880 2023-12-19T16:17:47.313 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c31da2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c0ced80 con 0x7f3c2c0cc540 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c31da2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2c0ce7c0 con 0x7f3c2c06b070 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c2c0cc540 0x7f3c2c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c30da0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3c2c160880 0x7f3c2c160c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55282/0 (socket says 172.21.15.73:55282) 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c30da0640 1 -- 172.21.15.73:0/990671902 learned_addr learned my addr 172.21.15.73:0/990671902 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c315a1640 1 --2- 172.21.15.73:0/990671902 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c06b070 0x7f3c2c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c23fff640 1 -- 172.21.15.73:0/990671902 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c06b070 msgr2=0x7f3c2c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c23fff640 1 --2- 172.21.15.73:0/990671902 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c06b070 0x7f3c2c0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c23fff640 1 -- 172.21.15.73:0/990671902 >> v1:172.21.15.73:6789/0 conn(0x7f3c2c160880 legacy=0x7f3c2c160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c23fff640 1 -- 172.21.15.73:0/990671902 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c0ceaa0 con 0x7f3c2c0cc540 2023-12-19T16:17:47.314 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.310+0000 7f3c237fe640 1 -- 172.21.15.73:0/990671902 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463067427 0 0) 0x7f3c28001120 con 0x7f3c2c160880 2023-12-19T16:17:47.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c23fff640 1 --2- 172.21.15.73:0/990671902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c0ccac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c06cef0 tx=0x7f3c1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5376e53077a76dbb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c237fe640 1 -- 172.21.15.73:0/990671902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c004230 con 0x7f3c2c0cc540 2023-12-19T16:17:47.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c237fe640 1 -- 172.21.15.73:0/990671902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a7050 con 0x7f3c2c0cc540 2023-12-19T16:17:47.316 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c237fe640 1 -- 172.21.15.73:0/990671902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c003620 con 0x7f3c2c0cc540 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- 172.21.15.73:0/990671902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c0cc540 msgr2=0x7f3c2c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- 172.21.15.73:0/990671902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c0ccac0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c06cef0 tx=0x7f3c1c01c460 comp rx=0 tx=0).stop 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- 172.21.15.73:0/990671902 shutdown_connections 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- 172.21.15.73:0/990671902 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c06b070 0x7f3c2c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- 172.21.15.73:0/990671902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c0ccac0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- 172.21.15.73:0/990671902 >> 172.21.15.73:0/990671902 conn(0x7f3c2c0cb970 msgr2=0x7f3c2c0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- 172.21.15.73:0/990671902 shutdown_connections 2023-12-19T16:17:47.317 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- 172.21.15.73:0/990671902 wait complete. 2023-12-19T16:17:47.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 Processor -- start 2023-12-19T16:17:47.318 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- start start 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c06b070 0x7f3c2c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c15f9f0 con 0x7f3c2c160880 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c6f90 con 0x7f3c2c0cc540 2023-12-19T16:17:47.320 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c31da2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c0c7270 con 0x7f3c2c06b070 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.314+0000 7f3c315a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53802/0 (socket says 172.21.15.73:53802) 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 -- 172.21.15.73:0/357866239 learned_addr learned my addr 172.21.15.73:0/357866239 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c23fff640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c30da0640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c06b070 0x7f3c2c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 -- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c06b070 msgr2=0x7f3c2c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c06b070 0x7f3c2c15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 -- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c0cc540 msgr2=0x7f3c2c153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 -- 172.21.15.73:0/357866239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009420 con 0x7f3c2c160880 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c315a1640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007cf0 tx=0x7f3c2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24014420 con 0x7f3c2c160880 2023-12-19T16:17:47.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c240145a0 con 0x7f3c2c160880 2023-12-19T16:17:47.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c0c7550 con 0x7f3c2c160880 2023-12-19T16:17:47.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24014950 con 0x7f3c2c160880 2023-12-19T16:17:47.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c0c7b10 con 0x7f3c2c160880 2023-12-19T16:17:47.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c0741a0 con 0x7f3c2c160880 2023-12-19T16:17:47.322 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c24014ab0 con 0x7f3c2c160880 2023-12-19T16:17:47.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.318+0000 7f3c217fa640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 0x7f3c18067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.322+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3c24083910 con 0x7f3c2c160880 2023-12-19T16:17:47.323 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.322+0000 7f3c30da0640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 0x7f3c18067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.322+0000 7f3c30da0640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 0x7f3c18067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000f70 tx=0x7f3c28007ba0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.327 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.326+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c24051310 con 0x7f3c2c160880 2023-12-19T16:17:47.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c2c0c7d00 con 0x7f3c2c160880 2023-12-19T16:17:47.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c217fa640 1 -- 172.21.15.73:0/357866239 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f3c24054930 con 0x7f3c2c160880 2023-12-19T16:17:47.512 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:47.513 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:47.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 msgr2=0x7f3c18067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 0x7f3c18067f20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000f70 tx=0x7f3c28007ba0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 msgr2=0x7f3c2c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007cf0 tx=0x7f3c2400e4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 shutdown_connections 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3c18065a60 0x7f3c18067f20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c2c160880 0x7f3c2c155070 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c0cc540 0x7f3c2c153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 --2- 172.21.15.73:0/357866239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c06b070 0x7f3c2c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 >> 172.21.15.73:0/357866239 conn(0x7f3c2c0cb970 msgr2=0x7f3c2c160c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:47.516 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 shutdown_connections 2023-12-19T16:17:47.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.510+0000 7f3c31da2640 1 -- 172.21.15.73:0/357866239 wait complete. 2023-12-19T16:17:47.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:47.690 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":34,"msgr_send_messages":29,"msgr_recv_bytes":107569,"msgr_send_bytes":11010,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010268786,"msgr_running_send_time":0.001313941,"msgr_running_recv_time":0.006764531,"msgr_running_fast_dispatch_time":0.000472143,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.008736209,"avgtime":0.000301248},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":102912,"msgr_send_encrypted_bytes":6624},"AsyncMessenger::Worker-1":{"msgr_recv_messages":45,"msgr_send_messages":39,"msgr_recv_bytes":20335,"msgr_send_bytes":106448,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011421774,"msgr_running_send_time":0.002627065,"msgr_running_recv_time":0.007494766,"msgr_running_fast_dispatch_time":0.001142851,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.010260283,"avgtime":0.000270007},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000003877,"avgtime":0.000000646},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":90928},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":152,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42268,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":920,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54863,"mds_co_items":229,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":94,"get_sum":130116,"get_or_fail_fail":0,"get_or_fail_success":94,"take":0,"take_sum":0,"put":94,"put_sum":130116,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:47.692 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 107569, "msgr_recv_encrypted_bytes": 102912, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000472143, "msgr_running_recv_time": 0.006764531, "msgr_running_send_time": 0.001313941, "msgr_running_total_time": 0.010268786, "msgr_send_bytes": 11010, "msgr_send_encrypted_bytes": 6624, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000301248, "sum": 0.008736209 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 6.46e-07, "sum": 3.877e-06 }, "msgr_recv_bytes": 20335, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 45, "msgr_running_fast_dispatch_time": 0.001142851, "msgr_running_recv_time": 0.007494766, "msgr_running_send_time": 0.002627065, "msgr_running_total_time": 0.011421774, "msgr_send_bytes": 106448, "msgr_send_encrypted_bytes": 90928, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000270007, "sum": 0.010260283 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 152, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42268 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 920, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54863, "mds_co_items": 229, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 94, "get_or_fail_fail": 0, "get_or_fail_success": 94, "get_started": 0, "get_sum": 130116, "max": 104857600, "put": 94, "put_sum": 130116, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:47.692 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-19T16:17:47.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:47.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 Processor -- start 2023-12-19T16:17:47.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 -- start start 2023-12-19T16:17:47.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 0x7f8bd006b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00ce020 con 0x7f8bd00cc660 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00cb130 con 0x7f8bd00b0e40 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.826+0000 7f8bd5ee5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00cd410 con 0x7f8bd015a8d0 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bc7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8bd00cc660 0x7f8bd00b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55286/0 (socket says 172.21.15.73:55286) 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bc7fff640 1 -- 172.21.15.73:0/921865112 learned_addr learned my addr 172.21.15.73:0/921865112 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/921865112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcffff640 1 --2- 172.21.15.73:0/921865112 >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 0x7f8bd006b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bceffd640 1 -- 172.21.15.73:0/921865112 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965305412 0 0) 0x7f8bd00ce020 con 0x7f8bd00cc660 2023-12-19T16:17:47.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bceffd640 1 -- 172.21.15.73:0/921865112 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bbc003530 con 0x7f8bd00cc660 2023-12-19T16:17:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 -- 172.21.15.73:0/921865112 >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 msgr2=0x7f8bd006b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/921865112 >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 0x7f8bd006b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 -- 172.21.15.73:0/921865112 >> v1:172.21.15.73:6789/0 conn(0x7f8bd00cc660 legacy=0x7f8bd00b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 -- 172.21.15.73:0/921865112 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00cd6f0 con 0x7f8bd015a8d0 2023-12-19T16:17:47.833 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcffff640 1 --2- 172.21.15.73:0/921865112 >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 0x7f8bd006b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:17:47.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.830+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/921865112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00cc120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a58fe7087ef7779 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bceffd640 1 -- 172.21.15.73:0/921865112 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00ac620 con 0x7f8bd015a8d0 2023-12-19T16:17:47.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bceffd640 1 -- 172.21.15.73:0/921865112 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc00ac780 con 0x7f8bd015a8d0 2023-12-19T16:17:47.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bceffd640 1 -- 172.21.15.73:0/921865112 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00acaf0 con 0x7f8bd015a8d0 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/921865112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 msgr2=0x7f8bd00cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/921865112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00cc120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097c0 tx=0x7f8bc001c3c0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/921865112 shutdown_connections 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/921865112 >> v2:172.21.15.162:3300/0 conn(0x7f8bd00b0e40 0x7f8bd006b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/921865112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00cc120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/921865112 >> 172.21.15.73:0/921865112 conn(0x7f8bd0069cc0 msgr2=0x7f8bd006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/921865112 shutdown_connections 2023-12-19T16:17:47.836 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/921865112 wait complete. 2023-12-19T16:17:47.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 Processor -- start 2023-12-19T16:17:47.837 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- start start 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 0x7f8bd014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c8720 con 0x7f8bd00cc660 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd014b380 con 0x7f8bd00b0e40 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bd5ee5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c7870 con 0x7f8bd015a8d0 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bc7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bc7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53806/0 (socket says 172.21.15.73:53806) 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.834+0000 7f8bc7fff640 1 -- 172.21.15.73:0/991943639 learned_addr learned my addr 172.21.15.73:0/991943639 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 0x7f8bd014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bcffff640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 -- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 msgr2=0x7f8bd00c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.840 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 -- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 msgr2=0x7f8bd014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 0x7f8bd014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 -- 172.21.15.73:0/991943639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009a70 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 0x7f8bd014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bc7fff640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c480 tx=0x7f8bb800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8005cf0 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb8005e50 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8007290 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc0009420 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00c7df0 con 0x7f8bd00cc660 2023-12-19T16:17:47.841 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00c8890 con 0x7f8bd00cc660 2023-12-19T16:17:47.842 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.838+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8bb80073f0 con 0x7f8bd00cc660 2023-12-19T16:17:47.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.842+0000 7f8bccff9640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 0x7f8bb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:47.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.842+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8bb8082840 con 0x7f8bd00cc660 2023-12-19T16:17:47.843 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.842+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 0x7f8bb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:47.844 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.842+0000 7f8bcf7fe640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 0x7f8bb0067f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae000 tx=0x7f8bc00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:47.847 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:47.842+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8bb8050190 con 0x7f8bd00cc660 2023-12-19T16:17:48.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.026+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bd0072750 con 0x7f8bd00cc660 2023-12-19T16:17:48.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.026+0000 7f8bccff9640 1 -- 172.21.15.73:0/991943639 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f8bb8017020 con 0x7f8bd00cc660 2023-12-19T16:17:48.031 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:48.031 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:48.031 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 msgr2=0x7f8bb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 0x7f8bb0067f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00ae000 tx=0x7f8bc00a7000 comp rx=0 tx=0).stop 2023-12-19T16:17:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 msgr2=0x7f8bd015c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.033 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800c480 tx=0x7f8bb800c940 comp rx=0 tx=0).stop 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 shutdown_connections 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bd015a8d0 0x7f8bd00c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8bb0065a60 0x7f8bb0067f20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8bd00cc660 0x7f8bd015c420 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 --2- 172.21.15.73:0/991943639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bd00b0e40 0x7f8bd014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 >> 172.21.15.73:0/991943639 conn(0x7f8bd0069cc0 msgr2=0x7f8bd0152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 shutdown_connections 2023-12-19T16:17:48.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.030+0000 7f8bd5ee5640 1 -- 172.21.15.73:0/991943639 wait complete. 2023-12-19T16:17:48.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:48.207 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":34,"msgr_send_messages":29,"msgr_recv_bytes":107569,"msgr_send_bytes":11010,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010268786,"msgr_running_send_time":0.001313941,"msgr_running_recv_time":0.006764531,"msgr_running_fast_dispatch_time":0.000472143,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.008736209,"avgtime":0.000301248},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":102912,"msgr_send_encrypted_bytes":6624},"AsyncMessenger::Worker-1":{"msgr_recv_messages":46,"msgr_send_messages":39,"msgr_recv_bytes":20737,"msgr_send_bytes":106448,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011548909,"msgr_running_send_time":0.002677702,"msgr_running_recv_time":0.007526709,"msgr_running_fast_dispatch_time":0.001184638,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.010260283,"avgtime":0.000270007},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000003877,"avgtime":0.000000646},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":90928},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":152,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42268,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":920,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54863,"mds_co_items":229,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":95,"get_sum":130444,"get_or_fail_fail":0,"get_or_fail_success":95,"take":0,"take_sum":0,"put":95,"put_sum":130444,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:48.208 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 107569, "msgr_recv_encrypted_bytes": 102912, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000472143, "msgr_running_recv_time": 0.006764531, "msgr_running_send_time": 0.001313941, "msgr_running_total_time": 0.010268786, "msgr_send_bytes": 11010, "msgr_send_encrypted_bytes": 6624, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000301248, "sum": 0.008736209 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 6.46e-07, "sum": 3.877e-06 }, "msgr_recv_bytes": 20737, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 46, "msgr_running_fast_dispatch_time": 0.001184638, "msgr_running_recv_time": 0.007526709, "msgr_running_send_time": 0.002677702, "msgr_running_total_time": 0.011548909, "msgr_send_bytes": 106448, "msgr_send_encrypted_bytes": 90928, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000270007, "sum": 0.010260283 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 152, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42268 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 920, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54863, "mds_co_items": 229, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 95, "get_or_fail_fail": 0, "get_or_fail_success": 95, "get_started": 0, "get_sum": 130444, "max": 104857600, "put": 95, "put_sum": 130444, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:48.209 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_1:2 2023-12-19T16:17:48.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 Processor -- start 2023-12-19T16:17:48.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 -- start start 2023-12-19T16:17:48.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b70160c60 0x7f4b700b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b700b4bf0 0x7f4b700d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b700d0e90 con 0x7f4b7015d030 2023-12-19T16:17:48.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b700b5080 con 0x7f4b70160c60 2023-12-19T16:17:48.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b7566f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700cdde0 con 0x7f4b700b4bf0 2023-12-19T16:17:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b70160c60 0x7f4b700b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.398 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b74e6e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b700b4bf0 0x7f4b700d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b70160c60 0x7f4b700b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:44852/0 (socket says 172.21.15.73:44852) 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 -- 172.21.15.73:0/1220018297 learned_addr learned my addr 172.21.15.73:0/1220018297 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 -- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b700b4bf0 msgr2=0x7f4b700d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 --2- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b700b4bf0 0x7f4b700d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 -- 172.21.15.73:0/1220018297 >> v1:172.21.15.162:6789/0 conn(0x7f4b7015d030 legacy=0x7f4b700cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.394+0000 7f4b67fff640 1 -- 172.21.15.73:0/1220018297 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700ce0c0 con 0x7f4b70160c60 2023-12-19T16:17:48.400 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b67fff640 1 --2- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b70160c60 0x7f4b700b46b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009870 tx=0x7f4b5801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188c3dd5dc2ebcb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b6f7fe640 1 -- 172.21.15.73:0/1220018297 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580aa610 con 0x7f4b70160c60 2023-12-19T16:17:48.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b6f7fe640 1 -- 172.21.15.73:0/1220018297 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b580a6040 con 0x7f4b70160c60 2023-12-19T16:17:48.401 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b6f7fe640 1 -- 172.21.15.73:0/1220018297 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580aa990 con 0x7f4b70160c60 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 -- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b70160c60 msgr2=0x7f4b700b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b70160c60 0x7f4b700b46b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009870 tx=0x7f4b5801c4b0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 -- 172.21.15.73:0/1220018297 shutdown_connections 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b700b4bf0 0x7f4b700d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1220018297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b70160c60 0x7f4b700b46b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 -- 172.21.15.73:0/1220018297 >> 172.21.15.73:0/1220018297 conn(0x7f4b700cf6b0 msgr2=0x7f4b700cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 -- 172.21.15.73:0/1220018297 shutdown_connections 2023-12-19T16:17:48.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.398+0000 7f4b7566f640 1 -- 172.21.15.73:0/1220018297 wait complete. 2023-12-19T16:17:48.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 Processor -- start 2023-12-19T16:17:48.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- start start 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b700b4bf0 0x7f4b7014af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b7015d030 0x7f4b700b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7014dbf0 con 0x7f4b70160c60 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7014d070 con 0x7f4b700b4bf0 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7014d350 con 0x7f4b7015d030 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53810/0 (socket says 172.21.15.73:53810) 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 -- 172.21.15.73:0/1214727461 learned_addr learned my addr 172.21.15.73:0/1214727461 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b67fff640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b7015d030 0x7f4b700b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b6ffff640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b700b4bf0 0x7f4b7014af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 -- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b7015d030 msgr2=0x7f4b700b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b7015d030 0x7f4b700b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 -- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b700b4bf0 msgr2=0x7f4b7014af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b700b4bf0 0x7f4b7014af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 -- 172.21.15.73:0/1214727461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580094d0 con 0x7f4b70160c60 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b74e6e640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800efc0 tx=0x7f4b6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68014480 con 0x7f4b70160c60 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800f040 con 0x7f4b70160c60 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68014820 con 0x7f4b70160c60 2023-12-19T16:17:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7014d630 con 0x7f4b70160c60 2023-12-19T16:17:48.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7014b450 con 0x7f4b70160c60 2023-12-19T16:17:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.402+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700741a0 con 0x7f4b70160c60 2023-12-19T16:17:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.406+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b68014980 con 0x7f4b70160c60 2023-12-19T16:17:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.406+0000 7f4b6d7fa640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 0x7f4b50067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.406+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4b68083d20 con 0x7f4b70160c60 2023-12-19T16:17:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.406+0000 7f4b6ffff640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 0x7f4b50067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:48.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.406+0000 7f4b6ffff640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 0x7f4b50067f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b60007fd0 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.410+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4b68051600 con 0x7f4b70160c60 2023-12-19T16:17:48.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b700b2a10 con 0x7f4b70160c60 2023-12-19T16:17:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b6d7fa640 1 -- 172.21.15.73:0/1214727461 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f4b68018020 con 0x7f4b70160c60 2023-12-19T16:17:48.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:48.600 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:48.600 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:48.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 msgr2=0x7f4b50067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 0x7f4b50067f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b60007fd0 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 msgr2=0x7f4b700b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800efc0 tx=0x7f4b6800c490 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 shutdown_connections 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4b50065a60 0x7f4b50067f20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b70160c60 0x7f4b700b3750 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b7015d030 0x7f4b700b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 --2- 172.21.15.73:0/1214727461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b700b4bf0 0x7f4b7014af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 >> 172.21.15.73:0/1214727461 conn(0x7f4b700cf6b0 msgr2=0x7f4b700cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 shutdown_connections 2023-12-19T16:17:48.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:48.598+0000 7f4b7566f640 1 -- 172.21.15.73:0/1214727461 wait complete. 2023-12-19T16:17:48.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:48.779 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":34,"msgr_send_messages":29,"msgr_recv_bytes":107569,"msgr_send_bytes":11010,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010268786,"msgr_running_send_time":0.001313941,"msgr_running_recv_time":0.006764531,"msgr_running_fast_dispatch_time":0.000472143,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.008736209,"avgtime":0.000301248},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":102912,"msgr_send_encrypted_bytes":6624},"AsyncMessenger::Worker-1":{"msgr_recv_messages":47,"msgr_send_messages":39,"msgr_recv_bytes":21139,"msgr_send_bytes":106448,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011724019,"msgr_running_send_time":0.002753065,"msgr_running_recv_time":0.007566745,"msgr_running_fast_dispatch_time":0.001240861,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.010260283,"avgtime":0.000270007},"msgr_handle_ack_lat":{"avgcount":6,"sum":0.000003877,"avgtime":0.000000646},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":90928},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":152,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42268,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":920,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54863,"mds_co_items":229,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":96,"get_sum":130772,"get_or_fail_fail":0,"get_or_fail_success":96,"take":0,"take_sum":0,"put":96,"put_sum":130772,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:48.780 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 107569, "msgr_recv_encrypted_bytes": 102912, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000472143, "msgr_running_recv_time": 0.006764531, "msgr_running_send_time": 0.001313941, "msgr_running_total_time": 0.010268786, "msgr_send_bytes": 11010, "msgr_send_encrypted_bytes": 6624, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000301248, "sum": 0.008736209 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 6, "avgtime": 6.46e-07, "sum": 3.877e-06 }, "msgr_recv_bytes": 21139, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 47, "msgr_running_fast_dispatch_time": 0.001240861, "msgr_running_recv_time": 0.007566745, "msgr_running_send_time": 0.002753065, "msgr_running_total_time": 0.011724019, "msgr_send_bytes": 106448, "msgr_send_encrypted_bytes": 90928, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000270007, "sum": 0.010260283 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 152, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42268 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 920, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54863, "mds_co_items": 229, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 96, "get_or_fail_fail": 0, "get_or_fail_success": 96, "get_started": 0, "get_sum": 130772, "max": 104857600, "put": 96, "put_sum": 130772, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:48.780 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:17:53.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:53.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 Processor -- start 2023-12-19T16:17:53.929 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 -- start start 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f92b0071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92b015de10 0x7f92b00cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00ce520 con 0x7f92b00c9670 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b006ff90 con 0x7f92b015de10 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92b55f3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0070270 con 0x7f92b00cdc00 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92af7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92b00c9670 0x7f92b00c9ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55290/0 (socket says 172.21.15.73:55290) 2023-12-19T16:17:53.931 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.926+0000 7f92af7fe640 1 -- 172.21.15.73:0/3058405366 learned_addr learned my addr 172.21.15.73:0/3058405366 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f92b0071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92ae7fc640 1 --2- 172.21.15.73:0/3058405366 >> v2:172.21.15.162:3300/0 conn(0x7f92b015de10 0x7f92b00cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125732944 0 0) 0x7f92b00ce520 con 0x7f92b00c9670 2023-12-19T16:17:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9298003530 con 0x7f92b00c9670 2023-12-19T16:17:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963526028 0 0) 0x7f9298003530 con 0x7f92b00c9670 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 msgr2=0x7f92b0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f92b0071030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 >> v2:172.21.15.162:3300/0 conn(0x7f92b015de10 msgr2=0x7f92b00cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 --2- 172.21.15.73:0/3058405366 >> v2:172.21.15.162:3300/0 conn(0x7f92b015de10 0x7f92b00cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0070550 con 0x7f92b00c9670 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f92a8001a00 con 0x7f92b00c9670 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 >> v1:172.21.15.73:6789/0 conn(0x7f92b00c9670 legacy=0x7f92b00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9298003980 0x7f9298003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980047d0 0x7f9298004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f9298005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b006ff90 con 0x7f9298003980 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0070270 con 0x7f92980047d0 2023-12-19T16:17:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929800b990 con 0x7f92b00cdc00 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9298003980 0x7f9298003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92af7fe640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f9298005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92ae7fc640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980047d0 0x7f9298004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 -- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 msgr2=0x7f9298005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f9298005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 -- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980047d0 msgr2=0x7f9298004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92980047d0 0x7f9298004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92aeffd640 1 -- 172.21.15.73:0/3058405366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298003530 con 0x7f9298003980 2023-12-19T16:17:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.930+0000 7f92af7fe640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00cdc00 0x7f9298005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9298003980 0x7f9298003da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009ae0 tx=0x7f92a001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcb7d3f49ec2e9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a5510 con 0x7f9298003980 2023-12-19T16:17:53.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00a5670 con 0x7f9298003980 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92adffb640 1 -- 172.21.15.73:0/3058405366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a5a20 con 0x7f9298003980 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- 172.21.15.73:0/3058405366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9298003980 msgr2=0x7f9298003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3058405366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9298003980 0x7f9298003da0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009ae0 tx=0x7f92a001ca20 comp rx=0 tx=0).stop 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92af7fe640 1 -- 172.21.15.73:0/3058405366 reap_dead start 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- 172.21.15.73:0/3058405366 shutdown_connections 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- 172.21.15.73:0/3058405366 >> 172.21.15.73:0/3058405366 conn(0x7f92b00b0b10 msgr2=0x7f92b00b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- 172.21.15.73:0/3058405366 shutdown_connections 2023-12-19T16:17:53.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- 172.21.15.73:0/3058405366 wait complete. 2023-12-19T16:17:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 Processor -- start 2023-12-19T16:17:53.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- start start 2023-12-19T16:17:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298003980 0x7f92b00c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ae000 0x7f92b00c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00ae480 con 0x7f92b01595c0 2023-12-19T16:17:53.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.934+0000 7f92b55f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0164950 con 0x7f9298003980 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92b55f3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0163dd0 con 0x7f92b00ae000 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53832/0 (socket says 172.21.15.73:53832) 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 -- 172.21.15.73:0/3533402365 learned_addr learned my addr 172.21.15.73:0/3533402365 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92af7fe640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ae000 0x7f92b00c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298003980 0x7f92b00c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 -- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ae000 msgr2=0x7f92b00c2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ae000 0x7f92b00c2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 -- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298003980 msgr2=0x7f92b00c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298003980 0x7f92b00c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 -- 172.21.15.73:0/3533402365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b01640b0 con 0x7f92b01595c0 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92ae7fc640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f92a4011660 tx=0x7f92a4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:53.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4015870 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a40159d0 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4015d40 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0164390 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b0161280 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0072750 con 0x7f92b01595c0 2023-12-19T16:17:53.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92a400f480 con 0x7f92b01595c0 2023-12-19T16:17:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.938+0000 7f92977fe640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 0x7f929c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.942+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f92a40835c0 con 0x7f92b01595c0 2023-12-19T16:17:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.942+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 0x7f929c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:53.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.942+0000 7f92aeffd640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 0x7f929c067f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f92a00af000 tx=0x7f92a00046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:53.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:53.946+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f92a4050e80 con 0x7f92b01595c0 2023-12-19T16:17:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92b00c2900 con 0x7f92b01595c0 2023-12-19T16:17:54.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92977fe640 1 -- 172.21.15.73:0/3533402365 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f92a40544a0 con 0x7f92b01595c0 2023-12-19T16:17:54.129 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:54.129 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:54.129 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 msgr2=0x7f929c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.130 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 0x7f929c067f20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f92a00af000 tx=0x7f92a00046d0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 msgr2=0x7f92b00adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f92a4011660 tx=0x7f92a4011a60 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 shutdown_connections 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ae000 0x7f92b00c2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f929c065a60 0x7f929c067f20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b01595c0 0x7f92b00adac0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 --2- 172.21.15.73:0/3533402365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9298003980 0x7f92b00c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 >> 172.21.15.73:0/3533402365 conn(0x7f92b00b0b10 msgr2=0x7f92b00cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 shutdown_connections 2023-12-19T16:17:54.131 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:54.126+0000 7f92b55f3640 1 -- 172.21.15.73:0/3533402365 wait complete. 2023-12-19T16:17:54.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:54.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":36,"msgr_send_messages":31,"msgr_recv_bytes":108113,"msgr_send_bytes":12194,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010469628,"msgr_running_send_time":0.001407719,"msgr_running_recv_time":0.006808766,"msgr_running_fast_dispatch_time":0.000517877,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.008853527,"avgtime":0.000285597},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":103456,"msgr_send_encrypted_bytes":7808},"AsyncMessenger::Worker-1":{"msgr_recv_messages":53,"msgr_send_messages":42,"msgr_recv_bytes":23398,"msgr_send_bytes":110071,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.013040887,"msgr_running_send_time":0.003409840,"msgr_running_recv_time":0.007859189,"msgr_running_fast_dispatch_time":0.001580511,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.010397792,"avgtime":0.000253604},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000004200,"avgtime":0.000000600},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":94448},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":131,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42780,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":930,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54903,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":104,"get_sum":132847,"get_or_fail_fail":0,"get_or_fail_success":104,"take":0,"take_sum":0,"put":104,"put_sum":132847,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:54.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 108113, "msgr_recv_encrypted_bytes": 103456, "msgr_recv_messages": 36, "msgr_running_fast_dispatch_time": 0.000517877, "msgr_running_recv_time": 0.006808766, "msgr_running_send_time": 0.001407719, "msgr_running_total_time": 0.010469628, "msgr_send_bytes": 12194, "msgr_send_encrypted_bytes": 7808, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000285597, "sum": 0.008853527 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 6e-07, "sum": 4.2e-06 }, "msgr_recv_bytes": 23398, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 53, "msgr_running_fast_dispatch_time": 0.001580511, "msgr_running_recv_time": 0.007859189, "msgr_running_send_time": 0.00340984, "msgr_running_total_time": 0.013040887, "msgr_send_bytes": 110071, "msgr_send_encrypted_bytes": 94448, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.000253604, "sum": 0.010397792 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 131, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42780 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 930, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54903, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 104, "get_or_fail_fail": 0, "get_or_fail_success": 104, "get_started": 0, "get_sum": 132847, "max": 104857600, "put": 104, "put_sum": 132847, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:54.311 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:17:59.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:17:59.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 Processor -- start 2023-12-19T16:17:59.461 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 -- start start 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f425c0d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f425c1610b0 0x7f425c0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0d0830 con 0x7f425c0ce2c0 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425c0d0b10 con 0x7f425c1610b0 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4260d2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0d0df0 con 0x7f425c15ce30 2023-12-19T16:17:59.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4253fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f425c0ce2c0 0x7f425c1609a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60236/0 (socket says 172.21.15.73:60236) 2023-12-19T16:17:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4253fff640 1 -- 172.21.15.73:0/2023239666 learned_addr learned my addr 172.21.15.73:0/2023239666 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:17:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f425a59c640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f425c0d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f425ad9d640 1 --2- 172.21.15.73:0/2023239666 >> v2:172.21.15.162:3300/0 conn(0x7f425c1610b0 0x7f425c0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805604241 0 0) 0x7f425c0d0830 con 0x7f425c0ce2c0 2023-12-19T16:17:59.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003530 con 0x7f425c0ce2c0 2023-12-19T16:17:59.468 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013312706 0 0) 0x7f4248003530 con 0x7f425c0ce2c0 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 msgr2=0x7f425c0d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f425c0d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 >> v2:172.21.15.162:3300/0 conn(0x7f425c1610b0 msgr2=0x7f425c0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 --2- 172.21.15.73:0/2023239666 >> v2:172.21.15.162:3300/0 conn(0x7f425c1610b0 0x7f425c0ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0d10d0 con 0x7f425c0ce2c0 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f4244001680 con 0x7f425c0ce2c0 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 >> v1:172.21.15.73:6789/0 conn(0x7f425c0ce2c0 legacy=0x7f425c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4248003980 0x7f4248003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f4248004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f4248005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.469 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0d0b10 con 0x7f42480047d0 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0d0df0 con 0x7f4248003980 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.458+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424800b990 con 0x7f425c15ce30 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f4248004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f425ad9d640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f4248005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f425a59c640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4248003980 0x7f4248003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 -- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 msgr2=0x7f4248005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c15ce30 0x7f4248005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 -- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4248003980 msgr2=0x7f4248003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4248003980 0x7f4248003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 -- 172.21.15.73:0/2023239666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248003530 con 0x7f42480047d0 2023-12-19T16:17:59.470 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f425a59c640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4248003980 0x7f4248003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4253fff640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f4248004c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f424400c270 tx=0x7f424401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821bbec2cea4fcb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440058e0 con 0x7f42480047d0 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244005a40 con 0x7f42480047d0 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.462+0000 7f4259d9b640 1 -- 172.21.15.73:0/2023239666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244005e10 con 0x7f42480047d0 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- 172.21.15.73:0/2023239666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 msgr2=0x7f4248004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 --2- 172.21.15.73:0/2023239666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f4248004c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f424400c270 tx=0x7f424401cc60 comp rx=0 tx=0).stop 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425ad9d640 1 -- 172.21.15.73:0/2023239666 reap_dead start 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- 172.21.15.73:0/2023239666 shutdown_connections 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- 172.21.15.73:0/2023239666 >> 172.21.15.73:0/2023239666 conn(0x7f425c0d2bc0 msgr2=0x7f425c0d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- 172.21.15.73:0/2023239666 shutdown_connections 2023-12-19T16:17:59.471 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- 172.21.15.73:0/2023239666 wait complete. 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 Processor -- start 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- start start 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0d0000 0x7f425c0c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c0c8ac0 0x7f425c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0c80f0 con 0x7f42480047d0 2023-12-19T16:17:59.474 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c151700 con 0x7f425c0d0000 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4260d2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0c74e0 con 0x7f425c0c8ac0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37854/0 (socket says 172.21.15.73:37854) 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 -- 172.21.15.73:0/369516405 learned_addr learned my addr 172.21.15.73:0/369516405 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425ad9d640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c0c8ac0 0x7f425c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f4253fff640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0d0000 0x7f425c0c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 -- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c0c8ac0 msgr2=0x7f425c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c0c8ac0 0x7f425c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 -- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0d0000 msgr2=0x7f425c0c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0d0000 0x7f425c0c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.466+0000 7f425a59c640 1 -- 172.21.15.73:0/369516405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0c77c0 con 0x7f42480047d0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f425a59c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f424c011580 tx=0x7f424c011a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c005db0 con 0x7f42480047d0 2023-12-19T16:17:59.475 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c004020 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0043d0 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c0c7aa0 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c1e9bf0 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c072750 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f424c003620 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 0x7f423c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f424c083440 con 0x7f42480047d0 2023-12-19T16:17:59.476 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4253fff640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 0x7f423c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:17:59.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.470+0000 7f4253fff640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 0x7f423c067f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42440aa000 tx=0x7f4244001a80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:17:59.479 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.474+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f424c050d10 con 0x7f42480047d0 2023-12-19T16:17:59.658 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.654+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f425c08ccc0 con 0x7f42480047d0 2023-12-19T16:17:59.659 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.654+0000 7f4252ffd640 1 -- 172.21.15.73:0/369516405 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f424c054330 con 0x7f42480047d0 2023-12-19T16:17:59.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:17:59.660 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:17:59.660 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:17:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 msgr2=0x7f423c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 0x7f423c067f20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f42440aa000 tx=0x7f4244001a80 comp rx=0 tx=0).stop 2023-12-19T16:17:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 msgr2=0x7f425c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:17:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f424c011580 tx=0x7f424c011a40 comp rx=0 tx=0).stop 2023-12-19T16:17:59.661 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 shutdown_connections 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425c0c8ac0 0x7f425c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f425c0d0000 0x7f425c0c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f423c065a60 0x7f423c067f20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 --2- 172.21.15.73:0/369516405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42480047d0 0x7f425c1511c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 >> 172.21.15.73:0/369516405 conn(0x7f425c0d2bc0 msgr2=0x7f425c1553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 shutdown_connections 2023-12-19T16:17:59.662 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:17:59.658+0000 7f4260d2c640 1 -- 172.21.15.73:0/369516405 wait complete. 2023-12-19T16:17:59.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:17:59.839 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":37,"msgr_send_messages":32,"msgr_recv_bytes":108385,"msgr_send_bytes":12786,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010670102,"msgr_running_send_time":0.001512049,"msgr_running_recv_time":0.006853062,"msgr_running_fast_dispatch_time":0.000540550,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.008911797,"avgtime":0.000278493},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":103728,"msgr_send_encrypted_bytes":8400},"AsyncMessenger::Worker-1":{"msgr_recv_messages":59,"msgr_send_messages":43,"msgr_recv_bytes":25810,"msgr_send_bytes":111831,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.014092926,"msgr_running_send_time":0.003853912,"msgr_running_recv_time":0.008085532,"msgr_running_fast_dispatch_time":0.001935332,"msgr_send_messages_queue_lat":{"avgcount":42,"sum":0.010435394,"avgtime":0.000248461},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000004200,"avgtime":0.000000600},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":96208},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":131,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42908,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":935,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54903,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":111,"get_sum":134945,"get_or_fail_fail":0,"get_or_fail_success":111,"take":0,"take_sum":0,"put":111,"put_sum":134945,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:17:59.840 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 108385, "msgr_recv_encrypted_bytes": 103728, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.00054055, "msgr_running_recv_time": 0.006853062, "msgr_running_send_time": 0.001512049, "msgr_running_total_time": 0.010670102, "msgr_send_bytes": 12786, "msgr_send_encrypted_bytes": 8400, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000278493, "sum": 0.008911797 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 6e-07, "sum": 4.2e-06 }, "msgr_recv_bytes": 25810, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 59, "msgr_running_fast_dispatch_time": 0.001935332, "msgr_running_recv_time": 0.008085532, "msgr_running_send_time": 0.003853912, "msgr_running_total_time": 0.014092926, "msgr_send_bytes": 111831, "msgr_send_encrypted_bytes": 96208, "msgr_send_messages": 43, "msgr_send_messages_queue_lat": { "avgcount": 42, "avgtime": 0.000248461, "sum": 0.010435394 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 131, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42908 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 935, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54903, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 111, "get_or_fail_fail": 0, "get_or_fail_success": 111, "get_started": 0, "get_sum": 134945, "max": 104857600, "put": 111, "put_sum": 134945, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:17:59.841 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:18:04.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:04.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.985+0000 7fad244d1640 1 Processor -- start 2023-12-19T16:18:04.990 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.985+0000 7fad244d1640 1 -- start start 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad244d1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad1c15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad244d1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0b2690 con 0x7fad1c06bc30 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad244d1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0b1b10 con 0x7fad1c06cda0 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad244d1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0b1df0 con 0x7fad1c0b0e10 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2226d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fad1c06bc30 0x7fad1c06c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43480/0 (socket says 172.21.15.73:43480) 2023-12-19T16:18:04.992 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2226d640 1 -- 172.21.15.73:0/4129811365 learned_addr learned my addr 172.21.15.73:0/4129811365 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:04.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad22a6e640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad1c15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:04.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866952363 0 0) 0x7fad1c0b2690 con 0x7fad1c06bc30 2023-12-19T16:18:04.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad08003530 con 0x7fad1c06bc30 2023-12-19T16:18:04.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1634612705 0 0) 0x7fad08003530 con 0x7fad1c06bc30 2023-12-19T16:18:04.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 msgr2=0x7fad1c15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad1c15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 >> v1:172.21.15.162:6789/0 conn(0x7fad1c06cda0 legacy=0x7fad1c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0b20d0 con 0x7fad1c06bc30 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fad18001680 con 0x7fad1c06bc30 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 >> v1:172.21.15.73:6789/0 conn(0x7fad1c06bc30 legacy=0x7fad1c06c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080039b0 0x7fad08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad080047d0 0x7fad08004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0b1df0 con 0x7fad080047d0 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0800baf0 con 0x7fad080039b0 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0800bcb0 con 0x7fad1c0b0e10 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad080047d0 0x7fad08004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:04.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad2226d640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080039b0 0x7fad08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad22a6e640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 -- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 msgr2=0x7fad080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c0b0e10 0x7fad080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 -- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080039b0 msgr2=0x7fad08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080039b0 0x7fad08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:04.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.989+0000 7fad21a6c640 1 -- 172.21.15.73:0/4129811365 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad08003530 con 0x7fad080047d0 2023-12-19T16:18:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad21a6c640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad080047d0 0x7fad08004c50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fad0c001780 tx=0x7fad0c01ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd317aba821ebf42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0052d0 con 0x7fad080047d0 2023-12-19T16:18:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0a7050 con 0x7fad080047d0 2023-12-19T16:18:04.997 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad2126b640 1 -- 172.21.15.73:0/4129811365 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c003600 con 0x7fad080047d0 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 -- 172.21.15.73:0/4129811365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad080047d0 msgr2=0x7fad08004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 --2- 172.21.15.73:0/4129811365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad080047d0 0x7fad08004c50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fad0c001780 tx=0x7fad0c01ce30 comp rx=0 tx=0).stop 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad22a6e640 1 -- 172.21.15.73:0/4129811365 reap_dead start 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 -- 172.21.15.73:0/4129811365 shutdown_connections 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 -- 172.21.15.73:0/4129811365 >> 172.21.15.73:0/4129811365 conn(0x7fad1c069cc0 msgr2=0x7fad1c06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 -- 172.21.15.73:0/4129811365 shutdown_connections 2023-12-19T16:18:04.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.993+0000 7fad244d1640 1 -- 172.21.15.73:0/4129811365 wait complete. 2023-12-19T16:18:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 Processor -- start 2023-12-19T16:18:04.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- start start 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080047d0 0x7fad1c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c14b4c0 0x7fad1c14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c155140 con 0x7fad1c153d00 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c154530 con 0x7fad080047d0 2023-12-19T16:18:05.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c154810 con 0x7fad1c14b4c0 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53400/0 (socket says 172.21.15.73:53400) 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 -- 172.21.15.73:0/3696796756 learned_addr learned my addr 172.21.15.73:0/3696796756 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad2226d640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080047d0 0x7fad1c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad22a6e640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c14b4c0 0x7fad1c14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 -- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c14b4c0 msgr2=0x7fad1c14b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c14b4c0 0x7fad1c14b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 -- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080047d0 msgr2=0x7fad1c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080047d0 0x7fad1c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 -- 172.21.15.73:0/3696796756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c154af0 con 0x7fad1c153d00 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad21a6c640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fad0c005040 tx=0x7fad08005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:05.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c007180 con 0x7fad1c153d00 2023-12-19T16:18:05.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c0072e0 con 0x7fad1c153d00 2023-12-19T16:18:05.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c154dd0 con 0x7fad1c153d00 2023-12-19T16:18:05.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c007670 con 0x7fad1c153d00 2023-12-19T16:18:05.004 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c0b37e0 con 0x7fad1c153d00 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:04.997+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c1552f0 con 0x7fad1c153d00 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.001+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad0c0067e0 con 0x7fad1c153d00 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.001+0000 7fad12ffd640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 0x7fad00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.001+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fad0c11d330 con 0x7fad1c153d00 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.001+0000 7fad2226d640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 0x7fad00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:05.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.001+0000 7fad2226d640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 0x7fad00067f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad18001ca0 tx=0x7fad18000ee0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:05.011 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.009+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fad1c1552f0 con 0x7fad1c153d00 2023-12-19T16:18:05.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.189+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad1c072750 con 0x7fad1c153d00 2023-12-19T16:18:05.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.189+0000 7fad12ffd640 1 -- 172.21.15.73:0/3696796756 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fad0c0ee7c0 con 0x7fad1c153d00 2023-12-19T16:18:05.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:05.195 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:05.195 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:05.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 msgr2=0x7fad00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 0x7fad00067f20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fad18001ca0 tx=0x7fad18000ee0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 msgr2=0x7fad1c0b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fad0c005040 tx=0x7fad08005800 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 shutdown_connections 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad1c14b4c0 0x7fad1c14b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fad00065a60 0x7fad00067f20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad1c153d00 0x7fad1c0b32a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 --2- 172.21.15.73:0/3696796756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad080047d0 0x7fad1c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 >> 172.21.15.73:0/3696796756 conn(0x7fad1c069cc0 msgr2=0x7fad1c1441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 shutdown_connections 2023-12-19T16:18:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:05.193+0000 7fad244d1640 1 -- 172.21.15.73:0/3696796756 wait complete. 2023-12-19T16:18:05.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:05.371 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":39,"msgr_send_messages":34,"msgr_recv_bytes":108929,"msgr_send_bytes":13970,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.010959011,"msgr_running_send_time":0.001658396,"msgr_running_recv_time":0.006920698,"msgr_running_fast_dispatch_time":0.000586312,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.009041061,"avgtime":0.000265913},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":104272,"msgr_send_encrypted_bytes":9584},"AsyncMessenger::Worker-1":{"msgr_recv_messages":65,"msgr_send_messages":45,"msgr_recv_bytes":28069,"msgr_send_bytes":113694,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.015529776,"msgr_running_send_time":0.004579312,"msgr_running_recv_time":0.008442812,"msgr_running_fast_dispatch_time":0.002275844,"msgr_send_messages_queue_lat":{"avgcount":44,"sum":0.010507191,"avgtime":0.000238799},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000004974,"avgtime":0.000000621},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":97968},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":131,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":43036,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":940,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54903,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":119,"get_sum":137020,"get_or_fail_fail":0,"get_or_fail_success":119,"take":0,"take_sum":0,"put":119,"put_sum":137020,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:05.373 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 108929, "msgr_recv_encrypted_bytes": 104272, "msgr_recv_messages": 39, "msgr_running_fast_dispatch_time": 0.000586312, "msgr_running_recv_time": 0.006920698, "msgr_running_send_time": 0.001658396, "msgr_running_total_time": 0.010959011, "msgr_send_bytes": 13970, "msgr_send_encrypted_bytes": 9584, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000265913, "sum": 0.009041061 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 6.21e-07, "sum": 4.974e-06 }, "msgr_recv_bytes": 28069, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 65, "msgr_running_fast_dispatch_time": 0.002275844, "msgr_running_recv_time": 0.008442812, "msgr_running_send_time": 0.004579312, "msgr_running_total_time": 0.015529776, "msgr_send_bytes": 113694, "msgr_send_encrypted_bytes": 97968, "msgr_send_messages": 45, "msgr_send_messages_queue_lat": { "avgcount": 44, "avgtime": 0.000238799, "sum": 0.010507191 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 131, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43036 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 940, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54903, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 119, "get_or_fail_fail": 0, "get_or_fail_success": 119, "get_started": 0, "get_sum": 137020, "max": 104857600, "put": 119, "put_sum": 137020, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:05.373 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:18:08.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:08.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:10.374 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:10.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.517+0000 7f6b36d7b640 1 Processor -- start 2023-12-19T16:18:10.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.517+0000 7f6b36d7b640 1 -- start start 2023-12-19T16:18:10.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b36d7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b3015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b36d7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b300ccd10 0x7f6b300b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b36d7b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b301436d0 con 0x7f6b300b30b0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b36d7b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3015aef0 con 0x7f6b300ccd10 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b36d7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b1ad0 con 0x7f6b300cc930 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b35318640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6b300b30b0 0x7f6b3015b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:43496/0 (socket says 172.21.15.73:43496) 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b35318640 1 -- 172.21.15.73:0/2297057605 learned_addr learned my addr 172.21.15.73:0/2297057605 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 --2- 172.21.15.73:0/2297057605 >> v2:172.21.15.162:3300/0 conn(0x7f6b300ccd10 0x7f6b300b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b34b17640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b3015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289732985 0 0) 0x7f6b301436d0 con 0x7f6b300b30b0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b18005740 con 0x7f6b300b30b0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906299874 0 0) 0x7f6b18005740 con 0x7f6b300b30b0 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 msgr2=0x7f6b3015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:10.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b3015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 >> v2:172.21.15.162:3300/0 conn(0x7f6b300ccd10 msgr2=0x7f6b300b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 --2- 172.21.15.73:0/2297057605 >> v2:172.21.15.162:3300/0 conn(0x7f6b300ccd10 0x7f6b300b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300b1db0 con 0x7f6b300b30b0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f6b28001a00 con 0x7f6b300b30b0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 >> v1:172.21.15.73:6789/0 conn(0x7f6b300b30b0 legacy=0x7f6b3015b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b18005b90 0x7f6b18005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b180064f0 0x7f6b180069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b18006f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3015aef0 con 0x7f6b180064f0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300b1ad0 con 0x7f6b18005b90 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18007790 con 0x7f6b300cc930 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b180064f0 0x7f6b180069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b34b17640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b18005b90 0x7f6b18005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b35318640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b18006f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 -- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 msgr2=0x7f6b18006f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:10.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b300cc930 0x7f6b18006f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 -- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b18005b90 msgr2=0x7f6b18005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:10.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b18005b90 0x7f6b18005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.521+0000 7f6b27fff640 1 -- 172.21.15.73:0/2297057605 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18005740 con 0x7f6b180064f0 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b27fff640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b180064f0 0x7f6b180069e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ae0 tx=0x7f6b2001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fbcf3455d4387a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200a5570 con 0x7f6b180064f0 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b200a56d0 con 0x7f6b180064f0 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b277fe640 1 -- 172.21.15.73:0/2297057605 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200a5a80 con 0x7f6b180064f0 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 -- 172.21.15.73:0/2297057605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b180064f0 msgr2=0x7f6b180069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/2297057605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b180064f0 0x7f6b180069e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ae0 tx=0x7f6b2001ca90 comp rx=0 tx=0).stop 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b35318640 1 -- 172.21.15.73:0/2297057605 reap_dead start 2023-12-19T16:18:10.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 -- 172.21.15.73:0/2297057605 shutdown_connections 2023-12-19T16:18:10.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 -- 172.21.15.73:0/2297057605 >> 172.21.15.73:0/2297057605 conn(0x7f6b30069cc0 msgr2=0x7f6b3006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:10.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 -- 172.21.15.73:0/2297057605 shutdown_connections 2023-12-19T16:18:10.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.525+0000 7f6b36d7b640 1 -- 172.21.15.73:0/2297057605 wait complete. 2023-12-19T16:18:10.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 Processor -- start 2023-12-19T16:18:10.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- start start 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180064f0 0x7f6b30142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b301ee120 0x7f6b301ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30142970 con 0x7f6b30157050 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301587b0 con 0x7f6b180064f0 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301eeb10 con 0x7f6b301ee120 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53414/0 (socket says 172.21.15.73:53414) 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b34b17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180064f0 0x7f6b30142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 -- 172.21.15.73:0/939178602 learned_addr learned my addr 172.21.15.73:0/939178602 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b35318640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b301ee120 0x7f6b301ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 -- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b301ee120 msgr2=0x7f6b301ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.534 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b301ee120 0x7f6b301ee5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 -- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180064f0 msgr2=0x7f6b30142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180064f0 0x7f6b30142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 -- 172.21.15.73:0/939178602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30157ba0 con 0x7f6b30157050 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b27fff640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ae0 tx=0x7f6b18007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200be070 con 0x7f6b30157050 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b20004020 con 0x7f6b30157050 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20004390 con 0x7f6b30157050 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b30157e80 con 0x7f6b30157050 2023-12-19T16:18:10.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b30158440 con 0x7f6b30157050 2023-12-19T16:18:10.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.529+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30072750 con 0x7f6b30157050 2023-12-19T16:18:10.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.533+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6b200b4040 con 0x7f6b30157050 2023-12-19T16:18:10.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.533+0000 7f6b257fa640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 0x7f6b1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:10.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.533+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6b2011d290 con 0x7f6b30157050 2023-12-19T16:18:10.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.533+0000 7f6b34b17640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 0x7f6b1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:10.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.533+0000 7f6b34b17640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 0x7f6b1c067f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009b00 tx=0x7f6b2c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:10.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.537+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6b200eab50 con 0x7f6b30157050 2023-12-19T16:18:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.717+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b3006b750 con 0x7f6b30157050 2023-12-19T16:18:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b257fa640 1 -- 172.21.15.73:0/939178602 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f6b200ee170 con 0x7f6b30157050 2023-12-19T16:18:10.724 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:10.724 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:10.724 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:10.725 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 msgr2=0x7f6b1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 0x7f6b1c067f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009b00 tx=0x7f6b2c009190 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 msgr2=0x7f6b301574b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ae0 tx=0x7f6b18007a10 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 shutdown_connections 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b301ee120 0x7f6b301ee5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6b1c065a90 0x7f6b1c067f50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b30157050 0x7f6b301574b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 --2- 172.21.15.73:0/939178602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b180064f0 0x7f6b30142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 >> 172.21.15.73:0/939178602 conn(0x7f6b30069cc0 msgr2=0x7f6b30070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 shutdown_connections 2023-12-19T16:18:10.726 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:10.721+0000 7f6b36d7b640 1 -- 172.21.15.73:0/939178602 wait complete. 2023-12-19T16:18:10.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:10.903 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":40,"msgr_send_messages":35,"msgr_recv_bytes":109201,"msgr_send_bytes":14562,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.011214773,"msgr_running_send_time":0.001778884,"msgr_running_recv_time":0.006966511,"msgr_running_fast_dispatch_time":0.000608487,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.009139773,"avgtime":0.000261136},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":104544,"msgr_send_encrypted_bytes":10176},"AsyncMessenger::Worker-1":{"msgr_recv_messages":71,"msgr_send_messages":46,"msgr_recv_bytes":30481,"msgr_send_bytes":115454,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.016638723,"msgr_running_send_time":0.005069691,"msgr_running_recv_time":0.008678501,"msgr_running_fast_dispatch_time":0.002621786,"msgr_send_messages_queue_lat":{"avgcount":45,"sum":0.010578987,"avgtime":0.000235088},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000004974,"avgtime":0.000000621},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":99728},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099361,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":14,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199834,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":43292,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":945,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54903,"mds_co_items":234,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":126,"get_sum":139118,"get_or_fail_fail":0,"get_or_fail_success":126,"take":0,"take_sum":0,"put":126,"put_sum":139118,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4384,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:10.905 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 109201, "msgr_recv_encrypted_bytes": 104544, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.000608487, "msgr_running_recv_time": 0.006966511, "msgr_running_send_time": 0.001778884, "msgr_running_total_time": 0.011214773, "msgr_send_bytes": 14562, "msgr_send_encrypted_bytes": 10176, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000261136, "sum": 0.009139773 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 6.21e-07, "sum": 4.974e-06 }, "msgr_recv_bytes": 30481, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 71, "msgr_running_fast_dispatch_time": 0.002621786, "msgr_running_recv_time": 0.008678501, "msgr_running_send_time": 0.005069691, "msgr_running_total_time": 0.016638723, "msgr_send_bytes": 115454, "msgr_send_encrypted_bytes": 99728, "msgr_send_messages": 46, "msgr_send_messages_queue_lat": { "avgcount": 45, "avgtime": 0.000235088, "sum": 0.010578987 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099361, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 14, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199834 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43292 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 945, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54903, "mds_co_items": 234, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 126, "get_or_fail_fail": 0, "get_or_fail_success": 126, "get_started": 0, "get_sum": 139118, "max": 104857600, "put": 126, "put_sum": 139118, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4384, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:10.906 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:18:15.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.049+0000 7fc044c8c640 1 Processor -- start 2023-12-19T16:18:16.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.049+0000 7fc044c8c640 1 -- start start 2023-12-19T16:18:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc044c8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 0x7fc04015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc044c8c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400b2690 con 0x7fc04006bc30 2023-12-19T16:18:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc044c8c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0400b1b10 con 0x7fc04006cda0 2023-12-19T16:18:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc044c8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400b1df0 con 0x7fc0400b0e10 2023-12-19T16:18:16.055 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03e59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc04006bc30 0x7fc04006c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41228/0 (socket says 172.21.15.73:41228) 2023-12-19T16:18:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03e59c640 1 -- 172.21.15.73:0/1310125113 learned_addr learned my addr 172.21.15.73:0/1310125113 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03ed9d640 1 --2- 172.21.15.73:0/1310125113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 0x7fc04015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126697878 0 0) 0x7fc0400b2690 con 0x7fc04006bc30 2023-12-19T16:18:16.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003530 con 0x7fc04006bc30 2023-12-19T16:18:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696570868 0 0) 0x7fc0400b1b10 con 0x7fc04006cda0 2023-12-19T16:18:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0400b2690 con 0x7fc04006cda0 2023-12-19T16:18:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03ed9d640 1 -- 172.21.15.73:0/1310125113 >> v1:172.21.15.162:6789/0 conn(0x7fc04006cda0 legacy=0x7fc0401595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03ed9d640 1 -- 172.21.15.73:0/1310125113 >> v1:172.21.15.73:6789/0 conn(0x7fc04006bc30 legacy=0x7fc04006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.053+0000 7fc03ed9d640 1 -- 172.21.15.73:0/1310125113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400b20d0 con 0x7fc0400b0e10 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc03ed9d640 1 --2- 172.21.15.73:0/1310125113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 0x7fc04015cfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc03800a990 tx=0x7fc03801e230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef59e1892e681440 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a68c0 con 0x7fc0400b0e10 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380a6a20 con 0x7fc0400b0e10 2023-12-19T16:18:16.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc03dd9b640 1 -- 172.21.15.73:0/1310125113 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a6d90 con 0x7fc0400b0e10 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- 172.21.15.73:0/1310125113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 msgr2=0x7fc04015cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 --2- 172.21.15.73:0/1310125113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 0x7fc04015cfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc03800a990 tx=0x7fc03801e230 comp rx=0 tx=0).stop 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- 172.21.15.73:0/1310125113 shutdown_connections 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 --2- 172.21.15.73:0/1310125113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0400b0e10 0x7fc04015cfa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- 172.21.15.73:0/1310125113 >> 172.21.15.73:0/1310125113 conn(0x7fc040069cc0 msgr2=0x7fc04006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- 172.21.15.73:0/1310125113 shutdown_connections 2023-12-19T16:18:16.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- 172.21.15.73:0/1310125113 wait complete. 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 Processor -- start 2023-12-19T16:18:16.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- start start 2023-12-19T16:18:16.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc04006cda0 0x7fc040163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 0x7fc0400cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040163800 con 0x7fc04006bc30 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040156b30 con 0x7fc0400b0e10 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.057+0000 7fc044c8c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040162950 con 0x7fc04006cda0 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48608/0 (socket says 172.21.15.73:48608) 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 -- 172.21.15.73:0/410903699 learned_addr learned my addr 172.21.15.73:0/410903699 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03ed9d640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 0x7fc0400cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc035d9b640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc04006cda0 0x7fc040163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 -- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc04006cda0 msgr2=0x7fc040163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc04006cda0 0x7fc040163c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 -- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 msgr2=0x7fc0400cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 0x7fc0400cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 -- 172.21.15.73:0/410903699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03800a5c0 con 0x7fc04006bc30 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03ed9d640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 0x7fc0400cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc03e59c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc03000cbf0 tx=0x7fc03000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03000ad50 con 0x7fc04006bc30 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030012400 con 0x7fc04006bc30 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc040164160 con 0x7fc04006bc30 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030012790 con 0x7fc04006bc30 2023-12-19T16:18:16.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040162e60 con 0x7fc04006bc30 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040163940 con 0x7fc04006bc30 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.061+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc030007070 con 0x7fc04006bc30 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.065+0000 7fc0377fe640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.065+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc030082f80 con 0x7fc04006bc30 2023-12-19T16:18:16.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.065+0000 7fc035d9b640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:16.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.065+0000 7fc035d9b640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 0x7fc020067f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc04015a460 tx=0x7fc028009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:16.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.069+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0300b40a0 con 0x7fc04006bc30 2023-12-19T16:18:16.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.249+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc040164160 con 0x7fc04006bc30 2023-12-19T16:18:16.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.249+0000 7fc0377fe640 1 -- 172.21.15.73:0/410903699 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fc040164160 con 0x7fc04006bc30 2023-12-19T16:18:16.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:16.254 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:16.255 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:16.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 msgr2=0x7fc020067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 0x7fc020067f20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc04015a460 tx=0x7fc028009040 comp rx=0 tx=0).stop 2023-12-19T16:18:16.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 msgr2=0x7fc040162410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:16.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc03000cbf0 tx=0x7fc03000a430 comp rx=0 tx=0).stop 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 shutdown_connections 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0400b0e10 0x7fc0400cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc04006cda0 0x7fc040163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 --2- 172.21.15.73:0/410903699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc04006bc30 0x7fc040162410 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 >> 172.21.15.73:0/410903699 conn(0x7fc040069cc0 msgr2=0x7fc04006a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 shutdown_connections 2023-12-19T16:18:16.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:16.253+0000 7fc044c8c640 1 -- 172.21.15.73:0/410903699 wait complete. 2023-12-19T16:18:16.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:16.433 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":41,"msgr_send_messages":36,"msgr_recv_bytes":109473,"msgr_send_bytes":15154,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.011337394,"msgr_running_send_time":0.001839192,"msgr_running_recv_time":0.006993844,"msgr_running_fast_dispatch_time":0.000632305,"msgr_send_messages_queue_lat":{"avgcount":36,"sum":0.009208563,"avgtime":0.000255793},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":104816,"msgr_send_encrypted_bytes":10768},"AsyncMessenger::Worker-1":{"msgr_recv_messages":77,"msgr_send_messages":47,"msgr_recv_bytes":32597,"msgr_send_bytes":117214,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.017712049,"msgr_running_send_time":0.005575542,"msgr_running_recv_time":0.008933926,"msgr_running_fast_dispatch_time":0.002911512,"msgr_send_messages_queue_lat":{"avgcount":46,"sum":0.010650522,"avgtime":0.000231533},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000004974,"avgtime":0.000000621},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":101488},"AsyncMessenger::Worker-2":{"msgr_recv_messages":19,"msgr_send_messages":20,"msgr_recv_bytes":13129,"msgr_send_bytes":24486,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005099761,"msgr_running_send_time":0.000659115,"msgr_running_recv_time":0.003567052,"msgr_running_fast_dispatch_time":0.000456362,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.007004940,"avgtime":0.000368681},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.003710385,"avgtime":0.000068710}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":14,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202039,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.010104618,"avgtime":0.002526154},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":43676,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":950,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":229895,"buffer_anon_items":69,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54855,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5458,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.119997206,"avgtime":0.002307638},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":133,"get_sum":140920,"get_or_fail_fail":0,"get_or_fail_success":133,"take":0,"take_sum":0,"put":133,"put_sum":140920,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6340,"put":52,"put_sum":6340,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":2205,"max":3758096384,"get_started":0,"get":5,"get_sum":6589,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":4,"put_sum":4384,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:16.435 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 109473, "msgr_recv_encrypted_bytes": 104816, "msgr_recv_messages": 41, "msgr_running_fast_dispatch_time": 0.000632305, "msgr_running_recv_time": 0.006993844, "msgr_running_send_time": 0.001839192, "msgr_running_total_time": 0.011337394, "msgr_send_bytes": 15154, "msgr_send_encrypted_bytes": 10768, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 36, "avgtime": 0.000255793, "sum": 0.009208563 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 6.21e-07, "sum": 4.974e-06 }, "msgr_recv_bytes": 32597, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 77, "msgr_running_fast_dispatch_time": 0.002911512, "msgr_running_recv_time": 0.008933926, "msgr_running_send_time": 0.005575542, "msgr_running_total_time": 0.017712049, "msgr_send_bytes": 117214, "msgr_send_encrypted_bytes": 101488, "msgr_send_messages": 47, "msgr_send_messages_queue_lat": { "avgcount": 46, "avgtime": 0.000231533, "sum": 0.010650522 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13129, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 19, "msgr_running_fast_dispatch_time": 0.000456362, "msgr_running_recv_time": 0.003567052, "msgr_running_send_time": 0.000659115, "msgr_running_total_time": 0.005099761, "msgr_send_bytes": 24486, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000368681, "sum": 0.00700494 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 6.871e-05, "sum": 0.003710385 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 14, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002526154, "sum": 0.010104618 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202039 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43676 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 950, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 229895, "buffer_anon_items": 69, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 54855, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002307638, "sum": 0.119997206 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5458, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 133, "get_or_fail_fail": 0, "get_or_fail_success": 133, "get_started": 0, "get_sum": 140920, "max": 104857600, "put": 133, "put_sum": 140920, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6340, "take": 52, "take_sum": 6340, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6589, "max": 3758096384, "put": 4, "put_sum": 4384, "take": 0, "take_sum": 0, "val": 2205, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:16.435 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2023-12-19T16:18:21.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:21.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 Processor -- start 2023-12-19T16:18:21.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 -- start start 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c1c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c1c15b0f0 0x7f4c1c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c1436d0 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c15aef0 con 0x7f4c1c15b0f0 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c21855640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b3280 con 0x7f4c1c0cc930 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c127fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4c1c0ccd10 0x7f4c1c0b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41244/0 (socket says 172.21.15.73:41244) 2023-12-19T16:18:21.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c127fc640 1 -- 172.21.15.73:0/1172371651 learned_addr learned my addr 172.21.15.73:0/1172371651 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:21.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c1affd640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c1c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c1b7fe640 1 --2- 172.21.15.73:0/1172371651 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c15b0f0 0x7f4c1c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4280941469 0 0) 0x7f4c1c1436d0 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.581+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c08005740 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580817660 0 0) 0x7f4c08005740 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 msgr2=0x7f4c1c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c1c15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c15b0f0 msgr2=0x7f4c1c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 --2- 172.21.15.73:0/1172371651 >> v2:172.21.15.162:3300/0 conn(0x7f4c1c15b0f0 0x7f4c1c15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0b1ad0 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f4c04001a00 con 0x7f4c1c0ccd10 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 >> v1:172.21.15.73:6789/0 conn(0x7f4c1c0ccd10 legacy=0x7f4c1c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c08005b90 0x7f4c08005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080069e0 0x7f4c08006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c080073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15aef0 con 0x7f4c080069e0 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b3280 con 0x7f4c08005b90 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0800dba0 con 0x7f4c1c0cc930 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080069e0 0x7f4c08006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1affd640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c08005b90 0x7f4c08005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1b7fe640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c080073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 -- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 msgr2=0x7f4c080073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c1c0cc930 0x7f4c080073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 -- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c08005b90 msgr2=0x7f4c08005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c08005b90 0x7f4c08005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 -- 172.21.15.73:0/1172371651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005740 con 0x7f4c080069e0 2023-12-19T16:18:21.591 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c127fc640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080069e0 0x7f4c08006e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400a860 tx=0x7f4c0401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc405cb5fa39e24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040ac670 con 0x7f4c080069e0 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c040ac7d0 con 0x7f4c080069e0 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.585+0000 7f4c1a7fc640 1 -- 172.21.15.73:0/1172371651 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c040acba0 con 0x7f4c080069e0 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- 172.21.15.73:0/1172371651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080069e0 msgr2=0x7f4c08006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 --2- 172.21.15.73:0/1172371651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c080069e0 0x7f4c08006e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4c0400a860 tx=0x7f4c0401fac0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c1b7fe640 1 -- 172.21.15.73:0/1172371651 reap_dead start 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- 172.21.15.73:0/1172371651 shutdown_connections 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- 172.21.15.73:0/1172371651 >> 172.21.15.73:0/1172371651 conn(0x7f4c1c069cc0 msgr2=0x7f4c1c06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- 172.21.15.73:0/1172371651 shutdown_connections 2023-12-19T16:18:21.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- 172.21.15.73:0/1172371651 wait complete. 2023-12-19T16:18:21.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 Processor -- start 2023-12-19T16:18:21.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- start start 2023-12-19T16:18:21.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 0x7f4c1c13a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c13b1b0 0x7f4c1c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 0x7f4c1c138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c13ac20 con 0x7f4c1c138b50 2023-12-19T16:18:21.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0af460 con 0x7f4c1c13b1b0 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c21855640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0af740 con 0x7f4c080069e0 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.589+0000 7f4c1affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 0x7f4c1c13a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 0x7f4c1c138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 0x7f4c1c13a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:50908/0 (socket says 172.21.15.73:50908) 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1affd640 1 -- 172.21.15.73:0/1759566682 learned_addr learned my addr 172.21.15.73:0/1759566682 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:21.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c127fc640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c13b1b0 0x7f4c1c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 -- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 msgr2=0x7f4c1c13a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 0x7f4c1c13a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 -- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c13b1b0 msgr2=0x7f4c1c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c13b1b0 0x7f4c1c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 -- 172.21.15.73:0/1759566682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0afa20 con 0x7f4c1c138b50 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1b7fe640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 0x7f4c1c138fd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06d740 tx=0x7f4c14011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14011e80 con 0x7f4c1c138b50 2023-12-19T16:18:21.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c14004240 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1400f6f0 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0afd00 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0af150 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c072750 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c1400f850 con 0x7f4c1c138b50 2023-12-19T16:18:21.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 0x7f4bfc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:21.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4c14083390 con 0x7f4c1c138b50 2023-12-19T16:18:21.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.593+0000 7f4c1affd640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 0x7f4bfc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:21.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.597+0000 7f4c1affd640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 0x7f4bfc067f50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c1f5dd0 tx=0x7f4c0c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:21.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.597+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4c14050c50 con 0x7f4c1c138b50 2023-12-19T16:18:21.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c1c138800 con 0x7f4c1c138b50 2023-12-19T16:18:21.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c18ff9640 1 -- 172.21.15.73:0/1759566682 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f4c14054270 con 0x7f4c1c138b50 2023-12-19T16:18:21.788 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:21.789 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:21.789 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 msgr2=0x7f4bfc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 0x7f4bfc067f50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c1f5dd0 tx=0x7f4c0c009190 comp rx=0 tx=0).stop 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 msgr2=0x7f4c1c138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 0x7f4c1c138fd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06d740 tx=0x7f4c14011c30 comp rx=0 tx=0).stop 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 shutdown_connections 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4bfc065a90 0x7f4bfc067f50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c1c138b50 0x7f4c1c138fd0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.790 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c1c13b1b0 0x7f4c1c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 --2- 172.21.15.73:0/1759566682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c080069e0 0x7f4c1c13a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:21.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 >> 172.21.15.73:0/1759566682 conn(0x7f4c1c069cc0 msgr2=0x7f4c1c15cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:21.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 shutdown_connections 2023-12-19T16:18:21.791 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:21.785+0000 7f4c21855640 1 -- 172.21.15.73:0/1759566682 wait complete. 2023-12-19T16:18:21.810 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:21.964 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":45,"msgr_send_messages":40,"msgr_recv_bytes":110643,"msgr_send_bytes":17314,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.011813724,"msgr_running_send_time":0.002040562,"msgr_running_recv_time":0.007100012,"msgr_running_fast_dispatch_time":0.000748533,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.009396712,"avgtime":0.000234917},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":105360,"msgr_send_encrypted_bytes":11952},"AsyncMessenger::Worker-1":{"msgr_recv_messages":86,"msgr_send_messages":51,"msgr_recv_bytes":35750,"msgr_send_bytes":121994,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.019042146,"msgr_running_send_time":0.006152915,"msgr_running_recv_time":0.009277055,"msgr_running_fast_dispatch_time":0.003297545,"msgr_send_messages_queue_lat":{"avgcount":50,"sum":0.010873981,"avgtime":0.000217479},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000005807,"avgtime":0.000000645},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":103248},"AsyncMessenger::Worker-2":{"msgr_recv_messages":21,"msgr_send_messages":22,"msgr_recv_bytes":13713,"msgr_send_bytes":25362,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005351644,"msgr_running_send_time":0.000748112,"msgr_running_recv_time":0.003622308,"msgr_running_fast_dispatch_time":0.000535835,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.007084378,"avgtime":0.000337351},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":59,"sum":0.003995671,"avgtime":0.000067723}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":14,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202039,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.013432994,"avgtime":0.002686598},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":43932,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":955,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":245927,"buffer_anon_items":73,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56231,"mds_co_items":238,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8155,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.135996534,"avgtime":0.002344767},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":56,"map_full":0,"map_inc":1,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":148,"get_sum":144485,"get_or_fail_fail":0,"get_or_fail_success":148,"take":0,"take_sum":0,"put":148,"put_sum":144485,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9037,"put":58,"put_sum":9037,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6589,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6589,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:21.966 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 110643, "msgr_recv_encrypted_bytes": 105360, "msgr_recv_messages": 45, "msgr_running_fast_dispatch_time": 0.000748533, "msgr_running_recv_time": 0.007100012, "msgr_running_send_time": 0.002040562, "msgr_running_total_time": 0.011813724, "msgr_send_bytes": 17314, "msgr_send_encrypted_bytes": 11952, "msgr_send_messages": 40, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.000234917, "sum": 0.009396712 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 6.45e-07, "sum": 5.807e-06 }, "msgr_recv_bytes": 35750, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 86, "msgr_running_fast_dispatch_time": 0.003297545, "msgr_running_recv_time": 0.009277055, "msgr_running_send_time": 0.006152915, "msgr_running_total_time": 0.019042146, "msgr_send_bytes": 121994, "msgr_send_encrypted_bytes": 103248, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 50, "avgtime": 0.000217479, "sum": 0.010873981 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13713, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000535835, "msgr_running_recv_time": 0.003622308, "msgr_running_send_time": 0.000748112, "msgr_running_total_time": 0.005351644, "msgr_send_bytes": 25362, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000337351, "sum": 0.007084378 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 59, "avgtime": 6.7723e-05, "sum": 0.003995671 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 14, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002686598, "sum": 0.013432994 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202039 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43932 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 955, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 245927, "buffer_anon_items": 73, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 56231, "mds_co_items": 238, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 56, "map_full": 0, "map_inc": 1, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002344767, "sum": 0.135996534 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8155, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 148, "get_or_fail_fail": 0, "get_or_fail_success": 148, "get_started": 0, "get_sum": 144485, "max": 104857600, "put": 148, "put_sum": 144485, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9037, "take": 58, "take_sum": 9037, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6589, "max": 3758096384, "put": 5, "put_sum": 6589, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:21.966 DEBUG:tasks.ceph_test_case:wait_until_true: success in 30s and 0 retries 2023-12-19T16:18:21.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:22.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 Processor -- start 2023-12-19T16:18:22.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 -- start start 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69740b22f0 0x7f69740b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740ce950 con 0x7f69740ce020 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6974161bb0 con 0x7f697406bf90 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f697a497640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740723d0 con 0x7f69740b22f0 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69740b22f0 0x7f69740b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f69740b22f0 0x7f69740b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48642/0 (socket says 172.21.15.73:48642) 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6978c94640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f69740ce020 0x7f6974160d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41246/0 (socket says 172.21.15.73:41246) 2023-12-19T16:18:22.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 -- 172.21.15.73:0/141713619 learned_addr learned my addr 172.21.15.73:0/141713619 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:22.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 -- 172.21.15.73:0/141713619 >> v1:172.21.15.162:6789/0 conn(0x7f697406bf90 legacy=0x7f69741614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:22.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 -- 172.21.15.73:0/141713619 >> v1:172.21.15.73:6789/0 conn(0x7f69740ce020 legacy=0x7f6974160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.101+0000 7f6979495640 1 -- 172.21.15.73:0/141713619 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740b2c10 con 0x7f69740b22f0 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f6979495640 1 --2- 172.21.15.73:0/141713619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f69740b26d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6970009870 tx=0x7f697001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5d6e4618731353 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f696bfff640 1 -- 172.21.15.73:0/141713619 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700ab640 con 0x7f69740b22f0 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f696bfff640 1 -- 172.21.15.73:0/141713619 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69700a7070 con 0x7f69740b22f0 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f696bfff640 1 -- 172.21.15.73:0/141713619 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69700ab9c0 con 0x7f69740b22f0 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- 172.21.15.73:0/141713619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 msgr2=0x7f69740b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 --2- 172.21.15.73:0/141713619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f69740b26d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6970009870 tx=0x7f697001c440 comp rx=0 tx=0).stop 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- 172.21.15.73:0/141713619 shutdown_connections 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 --2- 172.21.15.73:0/141713619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f69740b26d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- 172.21.15.73:0/141713619 >> 172.21.15.73:0/141713619 conn(0x7f69740cd2f0 msgr2=0x7f69740cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- 172.21.15.73:0/141713619 shutdown_connections 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- 172.21.15.73:0/141713619 wait complete. 2023-12-19T16:18:22.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 Processor -- start 2023-12-19T16:18:22.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.105+0000 7f697a497640 1 -- start start 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f697406bf90 0x7f697414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 0x7f69740b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c8440 con 0x7f69740b22f0 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c8720 con 0x7f697406bf90 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740c8a00 con 0x7f69740ce020 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48646/0 (socket says 172.21.15.73:48646) 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 -- 172.21.15.73:0/880123303 learned_addr learned my addr 172.21.15.73:0/880123303 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6979495640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f697406bf90 0x7f697414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6979c96640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 0x7f69740b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 -- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 msgr2=0x7f69740b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 0x7f69740b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 -- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f697406bf90 msgr2=0x7f697414e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f697406bf90 0x7f697414e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 -- 172.21.15.73:0/880123303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69700094d0 con 0x7f69740b22f0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6979c96640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 0x7f69740b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6978c94640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f696400c490 tx=0x7f696400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964007480 con 0x7f69740b22f0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640075e0 con 0x7f69740b22f0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964004a10 con 0x7f69740b22f0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69740c8ce0 con 0x7f69740b22f0 2023-12-19T16:18:22.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697414bb30 con 0x7f69740b22f0 2023-12-19T16:18:22.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740741a0 con 0x7f69740b22f0 2023-12-19T16:18:22.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.109+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6964004b70 con 0x7f69740b22f0 2023-12-19T16:18:22.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.113+0000 7f6969ffb640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 0x7f6958067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.113+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6964082420 con 0x7f69740b22f0 2023-12-19T16:18:22.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.113+0000 7f6979495640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 0x7f6958067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.113+0000 7f6979495640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 0x7f6958067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69700af000 tx=0x7f69700a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.120 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.117+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f696404fd70 con 0x7f69740b22f0 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69740b67f0 con 0x7f69740b22f0 2023-12-19T16:18:22.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f6969ffb640 1 -- 172.21.15.73:0/880123303 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f6964053390 con 0x7f69740b22f0 2023-12-19T16:18:22.304 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:22.304 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:22.304 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 msgr2=0x7f6958067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 0x7f6958067f20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69700af000 tx=0x7f69700a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 msgr2=0x7f697414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f696400c490 tx=0x7f696400c950 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 shutdown_connections 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69740ce020 0x7f69740b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6958065a60 0x7f6958067f20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69740b22f0 0x7f697414b5f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 --2- 172.21.15.73:0/880123303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f697406bf90 0x7f697414e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 >> 172.21.15.73:0/880123303 conn(0x7f69740cd2f0 msgr2=0x7f69740cca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 shutdown_connections 2023-12-19T16:18:22.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.301+0000 7f697a497640 1 -- 172.21.15.73:0/880123303 wait complete. 2023-12-19T16:18:22.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:22.489 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":46,"msgr_send_messages":41,"msgr_recv_bytes":111219,"msgr_send_bytes":17490,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.011913229,"msgr_running_send_time":0.002086795,"msgr_running_recv_time":0.007173836,"msgr_running_fast_dispatch_time":0.000748533,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.009436121,"avgtime":0.000230149},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":105936,"msgr_send_encrypted_bytes":12128},"AsyncMessenger::Worker-1":{"msgr_recv_messages":86,"msgr_send_messages":51,"msgr_recv_bytes":35750,"msgr_send_bytes":121994,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.019042146,"msgr_running_send_time":0.006152915,"msgr_running_recv_time":0.009277055,"msgr_running_fast_dispatch_time":0.003297545,"msgr_send_messages_queue_lat":{"avgcount":50,"sum":0.010873981,"avgtime":0.000217479},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000005807,"avgtime":0.000000645},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":103248},"AsyncMessenger::Worker-2":{"msgr_recv_messages":21,"msgr_send_messages":22,"msgr_recv_bytes":13713,"msgr_send_bytes":25362,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005351644,"msgr_running_send_time":0.000748112,"msgr_running_recv_time":0.003622308,"msgr_running_fast_dispatch_time":0.000535835,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.007084378,"avgtime":0.000337351},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":59,"sum":0.003995671,"avgtime":0.000067723}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":14,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202039,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.013432994,"avgtime":0.002686598},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":43932,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":955,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":245927,"buffer_anon_items":73,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56231,"mds_co_items":238,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8155,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.135996534,"avgtime":0.002344767},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":57,"map_full":0,"map_inc":2,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":149,"get_sum":144918,"get_or_fail_fail":0,"get_or_fail_success":149,"take":0,"take_sum":0,"put":149,"put_sum":144918,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9037,"put":58,"put_sum":9037,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6589,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6589,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:22.490 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111219, "msgr_recv_encrypted_bytes": 105936, "msgr_recv_messages": 46, "msgr_running_fast_dispatch_time": 0.000748533, "msgr_running_recv_time": 0.007173836, "msgr_running_send_time": 0.002086795, "msgr_running_total_time": 0.011913229, "msgr_send_bytes": 17490, "msgr_send_encrypted_bytes": 12128, "msgr_send_messages": 41, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.000230149, "sum": 0.009436121 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 6.45e-07, "sum": 5.807e-06 }, "msgr_recv_bytes": 35750, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 86, "msgr_running_fast_dispatch_time": 0.003297545, "msgr_running_recv_time": 0.009277055, "msgr_running_send_time": 0.006152915, "msgr_running_total_time": 0.019042146, "msgr_send_bytes": 121994, "msgr_send_encrypted_bytes": 103248, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 50, "avgtime": 0.000217479, "sum": 0.010873981 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13713, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000535835, "msgr_running_recv_time": 0.003622308, "msgr_running_send_time": 0.000748112, "msgr_running_total_time": 0.005351644, "msgr_send_bytes": 25362, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000337351, "sum": 0.007084378 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 59, "avgtime": 6.7723e-05, "sum": 0.003995671 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 14, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002686598, "sum": 0.013432994 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202039 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43932 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 955, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 245927, "buffer_anon_items": 73, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 56231, "mds_co_items": 238, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 57, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002344767, "sum": 0.135996534 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8155, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 149, "get_or_fail_fail": 0, "get_or_fail_success": 149, "get_started": 0, "get_sum": 144918, "max": 104857600, "put": 149, "put_sum": 144918, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9037, "take": 58, "take_sum": 9037, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6589, "max": 3758096384, "put": 5, "put_sum": 6589, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:22.491 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T16:18:22.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:22.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 Processor -- start 2023-12-19T16:18:22.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 -- start start 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d6806bc30 0x7f6d6806c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d6806cda0 0x7f6d681595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d680b2690 con 0x7f6d680b0e10 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6806c550 con 0x7f6d6806cda0 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d6cd6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680b1b10 con 0x7f6d6806bc30 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d5dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d6806cda0 0x7f6d681595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d5dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d6806cda0 0x7f6d681595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48654/0 (socket says 172.21.15.73:48654) 2023-12-19T16:18:22.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.625+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/1573488741 learned_addr learned my addr 172.21.15.73:0/1573488741 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6659c640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d6806bc30 0x7f6d6806c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/1573488741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d6806bc30 msgr2=0x7f6d6806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d5dd9b640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d6806bc30 0x7f6d6806c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/1573488741 >> v1:172.21.15.162:6789/0 conn(0x7f6d680b0e10 legacy=0x7f6d6815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:22.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/1573488741 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680b1df0 con 0x7f6d6806cda0 2023-12-19T16:18:22.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d5dd9b640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d681595f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000bb10 tx=0x7f6d5001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877a0b389d077e57 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d65d9b640 1 -- 172.21.15.73:0/1573488741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500a7b20 con 0x7f6d6806cda0 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d65d9b640 1 -- 172.21.15.73:0/1573488741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500a7c80 con 0x7f6d6806cda0 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d65d9b640 1 -- 172.21.15.73:0/1573488741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500af440 con 0x7f6d6806cda0 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/1573488741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 msgr2=0x7f6d681595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d681595f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000bb10 tx=0x7f6d5001eb10 comp rx=0 tx=0).stop 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/1573488741 shutdown_connections 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d681595f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/1573488741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d6806bc30 0x7f6d6806c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/1573488741 >> 172.21.15.73:0/1573488741 conn(0x7f6d68069cc0 msgr2=0x7f6d6806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.629+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/1573488741 shutdown_connections 2023-12-19T16:18:22.635 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/1573488741 wait complete. 2023-12-19T16:18:22.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 Processor -- start 2023-12-19T16:18:22.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 -- start start 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d6806bc30 0x7f6d68152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d680b0e10 0x7f6d68158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68153220 con 0x7f6d6806cda0 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68157260 con 0x7f6d6806bc30 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6cd6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68157de0 con 0x7f6d680b0e10 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48668/0 (socket says 172.21.15.73:48668) 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/3821409271 learned_addr learned my addr 172.21.15.73:0/3821409271 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d66d9d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d680b0e10 0x7f6d68158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d6659c640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d6806bc30 0x7f6d68152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.639 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d680b0e10 msgr2=0x7f6d68158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d680b0e10 0x7f6d68158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d6806bc30 msgr2=0x7f6d68152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d6806bc30 0x7f6d68152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 -- 172.21.15.73:0/3821409271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5000b770 con 0x7f6d6806cda0 2023-12-19T16:18:22.640 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.633+0000 7f6d5dd9b640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000b2c0 tx=0x7f6d5001b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500ba460 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500ba5e0 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500ba990 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d681574b0 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d68157a70 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d68157f70 con 0x7f6d6806cda0 2023-12-19T16:18:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6d500c2360 con 0x7f6d6806cda0 2023-12-19T16:18:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 0x7f6d4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f6d5011dd40 con 0x7f6d6806cda0 2023-12-19T16:18:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d6659c640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 0x7f6d4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:22.642 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.637+0000 7f6d6659c640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 0x7f6d4c067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d681595f0 tx=0x7f6d58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:22.646 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.641+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6d500eb600 con 0x7f6d6806cda0 2023-12-19T16:18:22.827 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d68072750 con 0x7f6d6806cda0 2023-12-19T16:18:22.828 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d5f7fe640 1 -- 172.21.15.73:0/3821409271 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f6d500eec20 con 0x7f6d6806cda0 2023-12-19T16:18:22.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:22.828 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:22.829 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 msgr2=0x7f6d4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 0x7f6d4c067f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d681595f0 tx=0x7f6d58008040 comp rx=0 tx=0).stop 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 msgr2=0x7f6d68151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000b2c0 tx=0x7f6d5001b8b0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 shutdown_connections 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d680b0e10 0x7f6d68158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.830 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6d4c065a60 0x7f6d4c067f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d6806cda0 0x7f6d68151080 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 --2- 172.21.15.73:0/3821409271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d6806bc30 0x7f6d68152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:22.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 >> 172.21.15.73:0/3821409271 conn(0x7f6d68069cc0 msgr2=0x7f6d6806a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:22.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 shutdown_connections 2023-12-19T16:18:22.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:22.825+0000 7f6d6cd6d640 1 -- 172.21.15.73:0/3821409271 wait complete. 2023-12-19T16:18:22.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump 2023-12-19T16:18:23.004 INFO:teuthology.orchestra.run.smithi073.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":46,"msgr_send_messages":41,"msgr_recv_bytes":111219,"msgr_send_bytes":17490,"msgr_created_connections":6,"msgr_active_connections":2,"msgr_running_total_time":0.011913229,"msgr_running_send_time":0.002086795,"msgr_running_recv_time":0.007173836,"msgr_running_fast_dispatch_time":0.000748533,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.009436121,"avgtime":0.000230149},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":105936,"msgr_send_encrypted_bytes":12128},"AsyncMessenger::Worker-1":{"msgr_recv_messages":87,"msgr_send_messages":51,"msgr_recv_bytes":36152,"msgr_send_bytes":121994,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.019155664,"msgr_running_send_time":0.006199854,"msgr_running_recv_time":0.009302254,"msgr_running_fast_dispatch_time":0.003336792,"msgr_send_messages_queue_lat":{"avgcount":50,"sum":0.010873981,"avgtime":0.000217479},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000005807,"avgtime":0.000000645},"msgr_recv_encrypted_bytes":1728,"msgr_send_encrypted_bytes":103248},"AsyncMessenger::Worker-2":{"msgr_recv_messages":21,"msgr_send_messages":22,"msgr_recv_bytes":13713,"msgr_send_bytes":25362,"msgr_created_connections":7,"msgr_active_connections":6,"msgr_running_total_time":0.005351644,"msgr_running_send_time":0.000748112,"msgr_running_recv_time":0.003622308,"msgr_running_fast_dispatch_time":0.000535835,"msgr_send_messages_queue_lat":{"avgcount":21,"sum":0.007084378,"avgtime":0.000337351},"msgr_handle_ack_lat":{"avgcount":2,"sum":0.000000249,"avgtime":0.000000124},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":59,"sum":0.003995671,"avgtime":0.000067723}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000113252,"avgtime":0.000028313}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.003524420,"avgtime":0.001762210},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":14,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202039,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.013432994,"avgtime":0.002686598},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":43932,"heap":223528},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.003349462,"avgtime":0.003349462},"req_getattr_latency":{"avgcount":1,"sum":0.000174958,"avgtime":0.000174958},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":955,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":245927,"buffer_anon_items":73,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5544,"osdmap_items":90,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56231,"mds_co_items":238,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8155,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.135996534,"avgtime":0.002344767},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":57,"map_full":0,"map_inc":2,"osd_sessions":7,"osd_session_open":7,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":3},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":150,"get_sum":145246,"get_or_fail_fail":0,"get_or_fail_success":150,"take":0,"take_sum":0,"put":150,"put_sum":145246,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9037,"put":58,"put_sum":9037,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55dd7a7c8fa0":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6589,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6589,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2023-12-19T16:18:23.006 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 2, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111219, "msgr_recv_encrypted_bytes": 105936, "msgr_recv_messages": 46, "msgr_running_fast_dispatch_time": 0.000748533, "msgr_running_recv_time": 0.007173836, "msgr_running_send_time": 0.002086795, "msgr_running_total_time": 0.011913229, "msgr_send_bytes": 17490, "msgr_send_encrypted_bytes": 12128, "msgr_send_messages": 41, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.000230149, "sum": 0.009436121 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 6.45e-07, "sum": 5.807e-06 }, "msgr_recv_bytes": 36152, "msgr_recv_encrypted_bytes": 1728, "msgr_recv_messages": 87, "msgr_running_fast_dispatch_time": 0.003336792, "msgr_running_recv_time": 0.009302254, "msgr_running_send_time": 0.006199854, "msgr_running_total_time": 0.019155664, "msgr_send_bytes": 121994, "msgr_send_encrypted_bytes": 103248, "msgr_send_messages": 51, "msgr_send_messages_queue_lat": { "avgcount": 50, "avgtime": 0.000217479, "sum": 0.010873981 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 6, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 2, "avgtime": 1.24e-07, "sum": 2.49e-07 }, "msgr_recv_bytes": 13713, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 21, "msgr_running_fast_dispatch_time": 0.000535835, "msgr_running_recv_time": 0.003622308, "msgr_running_send_time": 0.000748112, "msgr_running_total_time": 0.005351644, "msgr_send_bytes": 25362, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 22, "msgr_send_messages_queue_lat": { "avgcount": 21, "avgtime": 0.000337351, "sum": 0.007084378 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 59, "avgtime": 6.7723e-05, "sum": 0.003995671 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 2.8313e-05, "sum": 0.000113252 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 14, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.00176221, "sum": 0.00352442 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.002686598, "sum": 0.013432994 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202039 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223528, "ino": 14, "ino+": 14, "ino-": 0, "rss": 43932 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.003349462, "sum": 0.003349462 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000174958, "sum": 0.000174958 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 955, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 245927, "buffer_anon_items": 73, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 56231, "mds_co_items": 238, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5544, "osdmap_items": 90, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 57, "map_full": 0, "map_inc": 2, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002344767, "sum": 0.135996534 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8155, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 7, "osd_sessions": 7, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 3 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 150, "get_or_fail_fail": 0, "get_or_fail_success": 150, "get_started": 0, "get_sum": 145246, "max": 104857600, "put": 150, "put_sum": 145246, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9037, "take": 58, "take_sum": 9037, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55dd7a7c8fa0": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6589, "max": 3758096384, "put": 5, "put_sum": 6589, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2023-12-19T16:18:23.006 INFO:tasks.cephfs.test_openfiletable:omap_total_removes:1 2023-12-19T16:18:23.006 INFO:tasks.cephfs.test_openfiletable:omap_total_kv_pairs:1 2023-12-19T16:18:23.006 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T16:18:23.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:18:23.117 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T16:18:23.166 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T16:18:23.166 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:18:23.166 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:23.175 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:18:23.175 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:23.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 Processor -- start 2023-12-19T16:18:23.416 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 -- start start 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f77b815cfb0 0x7f77b80cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b80cfc90 0x7f77b80b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b80ce3f0 con 0x7f77b80d10b0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b815d390 con 0x7f77b80cfc90 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77be820640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80d1620 con 0x7f77b815cfb0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77bcdbd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b80cfc90 0x7f77b80b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77b77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77b80d10b0 0x7f77b80cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41252/0 (socket says 172.21.15.73:41252) 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77b77fe640 1 -- 172.21.15.73:0/2452069724 learned_addr learned my addr 172.21.15.73:0/2452069724 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77b7fff640 1 --2- 172.21.15.73:0/2452069724 >> v2:172.21.15.162:3300/0 conn(0x7f77b815cfb0 0x7f77b80cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77bcdbd640 1 -- 172.21.15.73:0/2452069724 >> v2:172.21.15.162:3300/0 conn(0x7f77b815cfb0 msgr2=0x7f77b80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77bcdbd640 1 --2- 172.21.15.73:0/2452069724 >> v2:172.21.15.162:3300/0 conn(0x7f77b815cfb0 0x7f77b80cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77bcdbd640 1 -- 172.21.15.73:0/2452069724 >> v1:172.21.15.73:6789/0 conn(0x7f77b80d10b0 legacy=0x7f77b80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77bcdbd640 1 -- 172.21.15.73:0/2452069724 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b80d1900 con 0x7f77b80cfc90 2023-12-19T16:18:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.413+0000 7f77b6ffd640 1 -- 172.21.15.73:0/2452069724 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165430077 0 0) 0x7f77ac001120 con 0x7f77b80d10b0 2023-12-19T16:18:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77bcdbd640 1 --2- 172.21.15.73:0/2452069724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b80cfc90 0x7f77b80b5e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f77b80d0400 tx=0x7f77b001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69051755f6a190b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77b6ffd640 1 -- 172.21.15.73:0/2452069724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a59a0 con 0x7f77b80cfc90 2023-12-19T16:18:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77b6ffd640 1 -- 172.21.15.73:0/2452069724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b00a5b00 con 0x7f77b80cfc90 2023-12-19T16:18:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77b6ffd640 1 -- 172.21.15.73:0/2452069724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a5e90 con 0x7f77b80cfc90 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 -- 172.21.15.73:0/2452069724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b80cfc90 msgr2=0x7f77b80b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 --2- 172.21.15.73:0/2452069724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b80cfc90 0x7f77b80b5e70 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f77b80d0400 tx=0x7f77b001c8e0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 -- 172.21.15.73:0/2452069724 shutdown_connections 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 --2- 172.21.15.73:0/2452069724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b80cfc90 0x7f77b80b5e70 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 --2- 172.21.15.73:0/2452069724 >> v2:172.21.15.162:3300/0 conn(0x7f77b815cfb0 0x7f77b80cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 -- 172.21.15.73:0/2452069724 >> 172.21.15.73:0/2452069724 conn(0x7f77b80719f0 msgr2=0x7f77b806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 -- 172.21.15.73:0/2452069724 shutdown_connections 2023-12-19T16:18:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.417+0000 7f77be820640 1 -- 172.21.15.73:0/2452069724 wait complete. 2023-12-19T16:18:23.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 Processor -- start 2023-12-19T16:18:23.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- start start 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b80cfc90 0x7f77b814b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b80d10b0 0x7f77b815e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8151ee0 con 0x7f77b815cfb0 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b81512d0 con 0x7f77b80d10b0 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b81515b0 con 0x7f77b80cfc90 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48680/0 (socket says 172.21.15.73:48680) 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 -- 172.21.15.73:0/3298637227 learned_addr learned my addr 172.21.15.73:0/3298637227 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77b77fe640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b80d10b0 0x7f77b815e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77b7fff640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b80cfc90 0x7f77b814b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 -- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b80cfc90 msgr2=0x7f77b814b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b80cfc90 0x7f77b814b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 -- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b80d10b0 msgr2=0x7f77b815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b80d10b0 0x7f77b815e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 -- 172.21.15.73:0/3298637227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0009a70 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77bcdbd640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f77b00194f0 tx=0x7f77b0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00ade20 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b0009450 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00b9690 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b8151890 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b8150f60 con 0x7f77b815cfb0 2023-12-19T16:18:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.421+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b8152050 con 0x7f77b815cfb0 2023-12-19T16:18:23.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.425+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77b00b97f0 con 0x7f77b815cfb0 2023-12-19T16:18:23.428 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.425+0000 7f77b4ff9640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 0x7f77a4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.425+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f77b011e9a0 con 0x7f77b815cfb0 2023-12-19T16:18:23.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.425+0000 7f77b7fff640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 0x7f77a4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.425+0000 7f77b7fff640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 0x7f77a4067f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77b814f000 tx=0x7f77a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.429+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77b00ec350 con 0x7f77b815cfb0 2023-12-19T16:18:23.584 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.581+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77b8072750 con 0x7f77b815cfb0 2023-12-19T16:18:23.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.581+0000 7f77b4ff9640 1 -- 172.21.15.73:0/3298637227 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f77b00ef970 con 0x7f77b815cfb0 2023-12-19T16:18:23.586 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:23.586 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:18:23.331384+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.28","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":7}]},{"pgid":"7.3a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2630347924":"2023-12-20T16:17:33.785002+0000","172.21.15.73:6835/2630347924":"2023-12-20T16:17:33.785002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 msgr2=0x7f77a4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 0x7f77a4067f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77b814f000 tx=0x7f77a8008040 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 msgr2=0x7f77b815ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f77b00194f0 tx=0x7f77b0019680 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 shutdown_connections 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f77a4065a90 0x7f77a4067f50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b815cfb0 0x7f77b815ee20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77b80d10b0 0x7f77b815e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 --2- 172.21.15.73:0/3298637227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77b80cfc90 0x7f77b814b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 >> 172.21.15.73:0/3298637227 conn(0x7f77b80719f0 msgr2=0x7f77b8159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 shutdown_connections 2023-12-19T16:18:23.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.585+0000 7f77be820640 1 -- 172.21.15.73:0/3298637227 wait complete. 2023-12-19T16:18:23.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:19.790228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:21.121249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:23.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 Processor -- start 2023-12-19T16:18:23.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 -- start start 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe580160e70 0x7fe58006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58015d2c0 con 0x7fe58015cee0 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800d07d0 con 0x7fe5801609e0 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe587efc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5800d0ab0 con 0x7fe580160e70 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe585c98640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe58015cee0 0x7fe5800ce390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41256/0 (socket says 172.21.15.73:41256) 2023-12-19T16:18:23.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe585c98640 1 -- 172.21.15.73:0/1733551426 learned_addr learned my addr 172.21.15.73:0/1733551426 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749625128 0 0) 0x7fe58015d2c0 con 0x7fe58015cee0 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe586499640 1 --2- 172.21.15.73:0/1733551426 >> v2:172.21.15.162:3300/0 conn(0x7fe580160e70 0x7fe58006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c003530 con 0x7fe58015cee0 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795456337 0 0) 0x7fe56c003530 con 0x7fe58015cee0 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 >> v2:172.21.15.162:3300/0 conn(0x7fe580160e70 msgr2=0x7fe58006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 --2- 172.21.15.73:0/1733551426 >> v2:172.21.15.162:3300/0 conn(0x7fe580160e70 0x7fe58006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 >> v1:172.21.15.162:6789/0 conn(0x7fe5801609e0 legacy=0x7fe58006a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800d0d90 con 0x7fe58015cee0 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fe57c001680 con 0x7fe58015cee0 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 >> v1:172.21.15.73:6789/0 conn(0x7fe58015cee0 legacy=0x7fe5800ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c003980 0x7fe56c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0047d0 0x7fe56c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe56c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.745+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800d0ab0 con 0x7fe56c005190 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c00c030 con 0x7fe56c0047d0 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c00c1f0 con 0x7fe56c003980 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe56c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe585c98640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c003980 0x7fe56c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe585497640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0047d0 0x7fe56c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 -- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c003980 msgr2=0x7fe56c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c003980 0x7fe56c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 -- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0047d0 msgr2=0x7fe56c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0047d0 0x7fe56c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 -- 172.21.15.73:0/1733551426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c003530 con 0x7fe56c005190 2023-12-19T16:18:23.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe585497640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0047d0 0x7fe56c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:23.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 -- 172.21.15.73:0/1733551426 reap_dead start 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe586499640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe56c00b990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe578009fc0 tx=0x7fe57801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983a12b2b85d686f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5780a5cb0 con 0x7fe56c005190 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800f040 con 0x7fe56c005190 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.749+0000 7fe584c96640 1 -- 172.21.15.73:0/1733551426 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578003be0 con 0x7fe56c005190 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 msgr2=0x7fe56c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe56c00b990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe578009fc0 tx=0x7fe57801cca0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- 172.21.15.73:0/1733551426 shutdown_connections 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 --2- 172.21.15.73:0/1733551426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe56c00b990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- 172.21.15.73:0/1733551426 >> 172.21.15.73:0/1733551426 conn(0x7fe5800d2c00 msgr2=0x7fe5800d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- 172.21.15.73:0/1733551426 shutdown_connections 2023-12-19T16:18:23.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- 172.21.15.73:0/1733551426 wait complete. 2023-12-19T16:18:23.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 Processor -- start 2023-12-19T16:18:23.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- start start 2023-12-19T16:18:23.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.759 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5801e6c80 0x7fe5800b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 0x7fe5800b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801f2530 con 0x7fe56c005190 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580156a90 con 0x7fe5801f5ba0 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe587efc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801f60a0 con 0x7fe5801e6c80 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48686/0 (socket says 172.21.15.73:48686) 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 -- 172.21.15.73:0/967032233 learned_addr learned my addr 172.21.15.73:0/967032233 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585497640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5801e6c80 0x7fe5800b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe586499640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 0x7fe5800b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 -- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5801e6c80 msgr2=0x7fe5800b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5801e6c80 0x7fe5800b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.760 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 -- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 msgr2=0x7fe5800b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 0x7fe5800b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.753+0000 7fe585c98640 1 -- 172.21.15.73:0/967032233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5801f6380 con 0x7fe56c005190 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe586499640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 0x7fe5800b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe585c98640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe57c007290 tx=0x7fe57c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00f9c0 con 0x7fe56c005190 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00fb40 con 0x7fe56c005190 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5801f6660 con 0x7fe56c005190 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0133f0 con 0x7fe56c005190 2023-12-19T16:18:23.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801e7080 con 0x7fe56c005190 2023-12-19T16:18:23.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580072750 con 0x7fe56c005190 2023-12-19T16:18:23.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe57c013550 con 0x7fe56c005190 2023-12-19T16:18:23.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 0x7fe564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:23.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fe57c083370 con 0x7fe56c005190 2023-12-19T16:18:23.762 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.757+0000 7fe585497640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 0x7fe564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:23.763 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.761+0000 7fe585497640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 0x7fe564067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5800c8be0 tx=0x7fe570009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:23.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.761+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe57c050cd0 con 0x7fe56c005190 2023-12-19T16:18:23.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5801617c0 con 0x7fe56c005190 2023-12-19T16:18:23.917 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe5767fc640 1 -- 172.21.15.73:0/967032233 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe57c0542f0 con 0x7fe56c005190 2023-12-19T16:18:23.917 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 msgr2=0x7fe564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 0x7fe564067f20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5800c8be0 tx=0x7fe570009040 comp rx=0 tx=0).stop 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 msgr2=0x7fe5801f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe57c007290 tx=0x7fe57c007750 comp rx=0 tx=0).stop 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 shutdown_connections 2023-12-19T16:18:23.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5801f5ba0 0x7fe5800b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5801e6c80 0x7fe5800b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe564065a60 0x7fe564067f20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 --2- 172.21.15.73:0/967032233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe56c005190 0x7fe5801f1ff0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 >> 172.21.15.73:0/967032233 conn(0x7fe5800d2c00 msgr2=0x7fe5800ce180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 shutdown_connections 2023-12-19T16:18:23.920 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:23.913+0000 7fe587efc640 1 -- 172.21.15.73:0/967032233 wait complete. 2023-12-19T16:18:23.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.073+0000 7fcc7dad1640 1 Processor -- start 2023-12-19T16:18:24.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.073+0000 7fcc7dad1640 1 -- start start 2023-12-19T16:18:24.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc7dad1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcc78159be0 0x7fcc780adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc7dad1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc780cb7e0 0x7fcc7806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc7dad1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780ca460 con 0x7fcc780ca000 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc7dad1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7815e6c0 con 0x7fcc780cb7e0 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc7dad1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7815d6b0 con 0x7fcc78159be0 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc780cb7e0 0x7fcc7806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcc780cb7e0 0x7fcc7806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48696/0 (socket says 172.21.15.73:48696) 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 -- 172.21.15.73:0/745792213 learned_addr learned my addr 172.21.15.73:0/745792213 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc76ffd640 1 --1- 172.21.15.73:0/745792213 >> v1:172.21.15.73:6789/0 conn(0x7fcc780ca000 0x7fcc780cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41258/0 (socket says 172.21.15.73:41258) 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc777fe640 1 --2- 172.21.15.73:0/745792213 >> v2:172.21.15.162:3300/0 conn(0x7fcc78159be0 0x7fcc780adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 -- 172.21.15.73:0/745792213 >> v2:172.21.15.162:3300/0 conn(0x7fcc78159be0 msgr2=0x7fcc780adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 --2- 172.21.15.73:0/745792213 >> v2:172.21.15.162:3300/0 conn(0x7fcc78159be0 0x7fcc780adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 -- 172.21.15.73:0/745792213 >> v1:172.21.15.73:6789/0 conn(0x7fcc780ca000 legacy=0x7fcc780cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc77fff640 1 -- 172.21.15.73:0/745792213 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7815afd0 con 0x7fcc780cb7e0 2023-12-19T16:18:24.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.077+0000 7fcc767fc640 1 -- 172.21.15.73:0/745792213 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899171862 0 0) 0x7fcc780ca460 con 0x7fcc780ca000 2023-12-19T16:18:24.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc77fff640 1 --2- 172.21.15.73:0/745792213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780cb7e0 0x7fcc7806f930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806eb70 tx=0x7fcc7001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45165dbeea70e207 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc767fc640 1 -- 172.21.15.73:0/745792213 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700a5600 con 0x7fcc780cb7e0 2023-12-19T16:18:24.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc767fc640 1 -- 172.21.15.73:0/745792213 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc700a5760 con 0x7fcc780cb7e0 2023-12-19T16:18:24.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc767fc640 1 -- 172.21.15.73:0/745792213 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc700a5af0 con 0x7fcc780cb7e0 2023-12-19T16:18:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- 172.21.15.73:0/745792213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780cb7e0 msgr2=0x7fcc7806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/745792213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780cb7e0 0x7fcc7806f930 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806eb70 tx=0x7fcc7001c940 comp rx=0 tx=0).stop 2023-12-19T16:18:24.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- 172.21.15.73:0/745792213 shutdown_connections 2023-12-19T16:18:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/745792213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780cb7e0 0x7fcc7806f930 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/745792213 >> v2:172.21.15.162:3300/0 conn(0x7fcc78159be0 0x7fcc780adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- 172.21.15.73:0/745792213 >> 172.21.15.73:0/745792213 conn(0x7fcc780b05a0 msgr2=0x7fcc780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- 172.21.15.73:0/745792213 shutdown_connections 2023-12-19T16:18:24.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- 172.21.15.73:0/745792213 wait complete. 2023-12-19T16:18:24.088 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 Processor -- start 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- start start 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc780cb7e0 0x7fcc780cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 0x7fcc78144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78166600 con 0x7fcc780ca000 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc781668e0 con 0x7fcc78159be0 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.081+0000 7fcc7dad1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc78166bc0 con 0x7fcc780cb7e0 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48710/0 (socket says 172.21.15.73:48710) 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 -- 172.21.15.73:0/3471160880 learned_addr learned my addr 172.21.15.73:0/3471160880 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc76ffd640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc780cb7e0 0x7fcc780cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc77fff640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 0x7fcc78144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 -- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc780cb7e0 msgr2=0x7fcc780cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc780cb7e0 0x7fcc780cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 -- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 msgr2=0x7fcc78144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 0x7fcc78144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 -- 172.21.15.73:0/3471160880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009b30 con 0x7fcc780ca000 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc77fff640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 0x7fcc78144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc777fe640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d5f0 tx=0x7fcc6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc680125f0 con 0x7fcc780ca000 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68012750 con 0x7fcc780ca000 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc78166ea0 con 0x7fcc780ca000 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68012ae0 con 0x7fcc780ca000 2023-12-19T16:18:24.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc78144940 con 0x7fcc780ca000 2023-12-19T16:18:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc78072750 con 0x7fcc780ca000 2023-12-19T16:18:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc68012c40 con 0x7fcc780ca000 2023-12-19T16:18:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 0x7fcc64067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.085+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fcc68083710 con 0x7fcc780ca000 2023-12-19T16:18:24.091 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.089+0000 7fcc76ffd640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 0x7fcc64067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.092 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.089+0000 7fcc76ffd640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 0x7fcc64067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b0200 tx=0x7fcc6c007d60 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.089+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcc68050f40 con 0x7fcc780ca000 2023-12-19T16:18:24.244 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc780cc080 con 0x7fcc780ca000 2023-12-19T16:18:24.245 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc5ffff640 1 -- 172.21.15.73:0/3471160880 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc68007380 con 0x7fcc780ca000 2023-12-19T16:18:24.245 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 msgr2=0x7fcc64067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 0x7fcc64067f50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc780b0200 tx=0x7fcc6c007d60 comp rx=0 tx=0).stop 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 msgr2=0x7fcc781676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800d5f0 tx=0x7fcc6800dab0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 shutdown_connections 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc78159be0 0x7fcc78144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.247 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc780cb7e0 0x7fcc780cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fcc64065a90 0x7fcc64067f50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.241+0000 7fcc7dad1640 1 --2- 172.21.15.73:0/3471160880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc780ca000 0x7fcc781676a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.245+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 >> 172.21.15.73:0/3471160880 conn(0x7fcc780b05a0 msgr2=0x7fcc780ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.245+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 shutdown_connections 2023-12-19T16:18:24.248 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.245+0000 7fcc7dad1640 1 -- 172.21.15.73:0/3471160880 wait complete. 2023-12-19T16:18:24.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:24.407 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 Processor -- start 2023-12-19T16:18:24.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 -- start start 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73f8159be0 0x7f73f80adac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f73f80cb7e0 0x7f73f806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80ca460 con 0x7f73f80ca000 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f815e6c0 con 0x7f73f8159be0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73fd3f3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f815d6b0 con 0x7f73f80cb7e0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73f8159be0 0x7f73f80adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73f8159be0 0x7f73f80adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48716/0 (socket says 172.21.15.73:48716) 2023-12-19T16:18:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 -- 172.21.15.73:0/2665814450 learned_addr learned my addr 172.21.15.73:0/2665814450 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f77fe640 1 --2- 172.21.15.73:0/2665814450 >> v2:172.21.15.162:3300/0 conn(0x7f73f80cb7e0 0x7f73f806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 -- 172.21.15.73:0/2665814450 >> v2:172.21.15.162:3300/0 conn(0x7f73f80cb7e0 msgr2=0x7f73f806f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 --2- 172.21.15.73:0/2665814450 >> v2:172.21.15.162:3300/0 conn(0x7f73f80cb7e0 0x7f73f806f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 -- 172.21.15.73:0/2665814450 >> v1:172.21.15.162:6789/0 conn(0x7f73f80ca000 legacy=0x7f73f80cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:24.410 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.405+0000 7f73f6ffd640 1 -- 172.21.15.73:0/2665814450 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f815afd0 con 0x7f73f8159be0 2023-12-19T16:18:24.412 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73f6ffd640 1 --2- 172.21.15.73:0/2665814450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f8159be0 0x7f73f80adac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f73f815b1f0 tx=0x7f73e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f971e02ce0a5a603 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73f5ffb640 1 -- 172.21.15.73:0/2665814450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ab600 con 0x7f73f8159be0 2023-12-19T16:18:24.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73f5ffb640 1 -- 172.21.15.73:0/2665814450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80a7050 con 0x7f73f8159be0 2023-12-19T16:18:24.413 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73f5ffb640 1 -- 172.21.15.73:0/2665814450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80ab980 con 0x7f73f8159be0 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 -- 172.21.15.73:0/2665814450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f8159be0 msgr2=0x7f73f80adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/2665814450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f8159be0 0x7f73f80adac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f73f815b1f0 tx=0x7f73e801c430 comp rx=0 tx=0).stop 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 -- 172.21.15.73:0/2665814450 shutdown_connections 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/2665814450 >> v2:172.21.15.162:3300/0 conn(0x7f73f80cb7e0 0x7f73f806f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/2665814450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f8159be0 0x7f73f80adac0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 -- 172.21.15.73:0/2665814450 >> 172.21.15.73:0/2665814450 conn(0x7f73f80b05a0 msgr2=0x7f73f80b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 -- 172.21.15.73:0/2665814450 shutdown_connections 2023-12-19T16:18:24.414 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.409+0000 7f73fd3f3640 1 -- 172.21.15.73:0/2665814450 wait complete. 2023-12-19T16:18:24.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 Processor -- start 2023-12-19T16:18:24.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- start start 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f80cb7e0 0x7f73f8070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73f8159be0 0x7f73f8071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b3450 con 0x7f73f80ca000 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b2840 con 0x7f73f80cb7e0 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b2b20 con 0x7f73f8159be0 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48726/0 (socket says 172.21.15.73:48726) 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 -- 172.21.15.73:0/151065737 learned_addr learned my addr 172.21.15.73:0/151065737 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f67fc640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f80cb7e0 0x7f73f8070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f77fe640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73f8159be0 0x7f73f8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 -- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73f8159be0 msgr2=0x7f73f8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73f8159be0 0x7f73f8071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 -- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f80cb7e0 msgr2=0x7f73f8070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f80cb7e0 0x7f73f8070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 -- 172.21.15.73:0/151065737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80094d0 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73f6ffd640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae040 tx=0x7f73e801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80b6620 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e80b67a0 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e80b6b50 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80b2e00 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f8141700 con 0x7f73f80ca000 2023-12-19T16:18:24.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.413+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8072750 con 0x7f73f80ca000 2023-12-19T16:18:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.417+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f73e80b2040 con 0x7f73f80ca000 2023-12-19T16:18:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.417+0000 7f73df7fe640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 0x7f73e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.417+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f73e811d6f0 con 0x7f73f80ca000 2023-12-19T16:18:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.417+0000 7f73f67fc640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 0x7f73e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.417+0000 7f73f67fc640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 0x7f73e4067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73f80717d0 tx=0x7f73ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.425 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.421+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f73e80eafc0 con 0x7f73f80ca000 2023-12-19T16:18:24.575 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73f80cc080 con 0x7f73f80ca000 2023-12-19T16:18:24.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73df7fe640 1 -- 172.21.15.73:0/151065737 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73e80ee5e0 con 0x7f73f80ca000 2023-12-19T16:18:24.576 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 msgr2=0x7f73e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 0x7f73e4067f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f73f80717d0 tx=0x7f73ec009040 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 msgr2=0x7f73f81411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73e80ae040 tx=0x7f73e801ac70 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 shutdown_connections 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73f8159be0 0x7f73f8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f80cb7e0 0x7f73f8070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f73e4065a60 0x7f73e4067f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 --2- 172.21.15.73:0/151065737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73f80ca000 0x7f73f81411c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 >> 172.21.15.73:0/151065737 conn(0x7f73f80b05a0 msgr2=0x7f73f815c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 shutdown_connections 2023-12-19T16:18:24.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.573+0000 7f73fd3f3640 1 -- 172.21.15.73:0/151065737 wait complete. 2023-12-19T16:18:24.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T16:18:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 Processor -- start 2023-12-19T16:18:24.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 -- start start 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ef4159070 0x7f5ef40adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40c4b80 con 0x7f5ef4159450 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40c4e60 con 0x7f5ef40ccba0 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5efa9ce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40c5420 con 0x7f5ef4159070 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5ef4159450 0x7f5ef40cc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41264/0 (socket says 172.21.15.73:41264) 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef37fe640 1 -- 172.21.15.73:0/3956272492 learned_addr learned my addr 172.21.15.73:0/3956272492 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef3fff640 1 --2- 172.21.15.73:0/3956272492 >> v2:172.21.15.162:3300/0 conn(0x7f5ef4159070 0x7f5ef40adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef2ffd640 1 -- 172.21.15.73:0/3956272492 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879905878 0 0) 0x7f5ef40c4b80 con 0x7f5ef4159450 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef2ffd640 1 -- 172.21.15.73:0/3956272492 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5edc003530 con 0x7f5ef4159450 2023-12-19T16:18:24.738 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef3fff640 1 -- 172.21.15.73:0/3956272492 >> v1:172.21.15.162:6789/0 conn(0x7f5ef40ccba0 legacy=0x7f5ef406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef3fff640 1 -- 172.21.15.73:0/3956272492 >> v1:172.21.15.73:6789/0 conn(0x7f5ef4159450 legacy=0x7f5ef40cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.733+0000 7f5ef3fff640 1 -- 172.21.15.73:0/3956272492 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40c5140 con 0x7f5ef4159070 2023-12-19T16:18:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5ef3fff640 1 --2- 172.21.15.73:0/3956272492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40adae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097c0 tx=0x7f5ee401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee84a35ed21d636 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5ef2ffd640 1 -- 172.21.15.73:0/3956272492 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40ab620 con 0x7f5ef4159070 2023-12-19T16:18:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5ef2ffd640 1 -- 172.21.15.73:0/3956272492 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee40ab780 con 0x7f5ef4159070 2023-12-19T16:18:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5ef2ffd640 1 -- 172.21.15.73:0/3956272492 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40abb10 con 0x7f5ef4159070 2023-12-19T16:18:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3956272492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 msgr2=0x7f5ef40adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3956272492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40adae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097c0 tx=0x7f5ee401c480 comp rx=0 tx=0).stop 2023-12-19T16:18:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3956272492 shutdown_connections 2023-12-19T16:18:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3956272492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40adae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3956272492 >> 172.21.15.73:0/3956272492 conn(0x7f5ef40ce950 msgr2=0x7f5ef40ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3956272492 shutdown_connections 2023-12-19T16:18:24.743 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.737+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3956272492 wait complete. 2023-12-19T16:18:24.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 Processor -- start 2023-12-19T16:18:24.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- start start 2023-12-19T16:18:24.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef40ccba0 0x7f5ef414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef406b810 con 0x7f5ef4159450 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef414bec0 con 0x7f5ef4159070 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40b1440 con 0x7f5ef40ccba0 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48728/0 (socket says 172.21.15.73:48728) 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 -- 172.21.15.73:0/3645028094 learned_addr learned my addr 172.21.15.73:0/3645028094 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef3fff640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef40ccba0 0x7f5ef414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef37fe640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 -- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef40ccba0 msgr2=0x7f5ef414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef40ccba0 0x7f5ef414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 -- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 msgr2=0x7f5ef40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 -- 172.21.15.73:0/3645028094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009420 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef37fe640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef8f6b640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c7a0 tx=0x7f5eec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec003b80 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec003ce0 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef40b0170 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00aa90 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.741+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40b1930 con 0x7f5ef4159450 2023-12-19T16:18:24.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef4072750 con 0x7f5ef4159450 2023-12-19T16:18:24.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5eec00abf0 con 0x7f5ef4159450 2023-12-19T16:18:24.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5ef0ff9640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 0x7f5ee0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:24.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f5eec083040 con 0x7f5ef4159450 2023-12-19T16:18:24.749 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5ef3fff640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 0x7f5ee0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:24.750 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.745+0000 7f5ef3fff640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 0x7f5ee0067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40af000 tx=0x7f5ee40a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:24.753 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.749+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5eec0b40a0 con 0x7f5ef4159450 2023-12-19T16:18:24.915 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ef40b1220 con 0x7f5ef4159450 2023-12-19T16:18:24.916 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5ef0ff9640 1 -- 172.21.15.73:0/3645028094 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v58) v1 ==== 80+0+122 (secure 0 0 0) 0x7f5eec050900 con 0x7f5ef4159450 2023-12-19T16:18:24.916 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6837/2630347924 2023-12-20T16:17:33.785002+0000 2023-12-19T16:18:24.916 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:6835/2630347924 2023-12-20T16:17:33.785002+0000 2023-12-19T16:18:24.916 INFO:teuthology.orchestra.run.smithi073.stderr:listed 2 entries 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 msgr2=0x7f5ee0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 0x7f5ee0067f20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40af000 tx=0x7f5ee40a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 msgr2=0x7f5ef40af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c7a0 tx=0x7f5eec00cc60 comp rx=0 tx=0).stop 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 shutdown_connections 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ee0065a60 0x7f5ee0067f20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ef4159450 0x7f5ef40af6b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ef4159070 0x7f5ef40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 --2- 172.21.15.73:0/3645028094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ef40ccba0 0x7f5ef414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:24.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 >> 172.21.15.73:0/3645028094 conn(0x7f5ef40ce950 msgr2=0x7f5ef40cab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:24.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 shutdown_connections 2023-12-19T16:18:24.919 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:24.913+0000 7f5efa9ce640 1 -- 172.21.15.73:0/3645028094 wait complete. 2023-12-19T16:18:24.936 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T16:18:24.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:24.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T16:18:24.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:18:24.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:24.964 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T16:18:25.020 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:18:25.020 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:25.031 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:25.031 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:18:25.031 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:25.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:25.071 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:18:25.071 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:25.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:25.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:25.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.245+0000 7fd96d1b3640 1 Processor -- start 2023-12-19T16:18:25.251 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.245+0000 7fd96d1b3640 1 -- start start 2023-12-19T16:18:25.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96d1b3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd9680b0e10 0x7fd96815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96d1b3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680b2690 con 0x7fd96806cda0 2023-12-19T16:18:25.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96d1b3640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680b1b10 con 0x7fd96806bc30 2023-12-19T16:18:25.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96d1b3640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9680b1df0 con 0x7fd9680b0e10 2023-12-19T16:18:25.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd95e59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd96806cda0 0x7fd9681595f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53736/0 (socket says 172.21.15.73:53736) 2023-12-19T16:18:25.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd95e59c640 1 -- 172.21.15.73:0/2485511407 learned_addr learned my addr 172.21.15.73:0/2485511407 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:25.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> v2:172.21.15.162:3300/0 conn(0x7fd9680b0e10 0x7fd96815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990074180 0 0) 0x7fd9680b2690 con 0x7fd96806cda0 2023-12-19T16:18:25.253 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd954003450 con 0x7fd96806cda0 2023-12-19T16:18:25.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879190173 0 0) 0x7fd954003450 con 0x7fd96806cda0 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 >> v2:172.21.15.162:3300/0 conn(0x7fd9680b0e10 msgr2=0x7fd96815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 --2- 172.21.15.73:0/2485511407 >> v2:172.21.15.162:3300/0 conn(0x7fd9680b0e10 0x7fd96815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 >> v1:172.21.15.162:6789/0 conn(0x7fd96806bc30 legacy=0x7fd96806c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680b20d0 con 0x7fd96806cda0 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7fd950001a00 con 0x7fd96806cda0 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 >> v1:172.21.15.73:6789/0 conn(0x7fd96806cda0 legacy=0x7fd9681595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd954003a70 0x7fd954003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd954008860 0x7fd95400ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 0x7fd95400d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680b1df0 con 0x7fd95400b4b0 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95400e250 con 0x7fd954008860 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95400e410 con 0x7fd954003a70 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> v2:172.21.15.162:3300/0 conn(0x7fd9680b0e10 0x7fd96815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 0x7fd95400d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd95e59c640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd954008860 0x7fd95400ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd966d9d640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd954003a70 0x7fd954003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 -- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd954003a70 msgr2=0x7fd954003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd954003a70 0x7fd954003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 -- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd954008860 msgr2=0x7fd95400ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd954008860 0x7fd95400ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.256 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.249+0000 7fd96759e640 1 -- 172.21.15.73:0/2485511407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954003450 con 0x7fd95400b4b0 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96759e640 1 -- 172.21.15.73:0/2485511407 reap_dead start 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96759e640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 0x7fd95400d970 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd960009c60 tx=0x7fd96001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376e400770a7f43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960004020 con 0x7fd95400b4b0 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960004180 con 0x7fd95400b4b0 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96659c640 1 -- 172.21.15.73:0/2485511407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600a5810 con 0x7fd95400b4b0 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 msgr2=0x7fd95400d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 0x7fd95400d970 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd960009c60 tx=0x7fd96001cc10 comp rx=0 tx=0).stop 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2485511407 shutdown_connections 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2485511407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95400b4b0 0x7fd95400d970 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2485511407 >> 172.21.15.73:0/2485511407 conn(0x7fd968069cc0 msgr2=0x7fd96806a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2485511407 shutdown_connections 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.253+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2485511407 wait complete. 2023-12-19T16:18:25.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 Processor -- start 2023-12-19T16:18:25.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- start start 2023-12-19T16:18:25.261 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd95400b4b0 0x7fd968148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96815bb80 0x7fd96815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd968154690 con 0x7fd968155420 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96815c540 con 0x7fd96815bb80 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd968155de0 con 0x7fd95400b4b0 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd966d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd95400b4b0 0x7fd968148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49888/0 (socket says 172.21.15.73:49888) 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 -- 172.21.15.73:0/2154751050 learned_addr learned my addr 172.21.15.73:0/2154751050 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd95e59c640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96815bb80 0x7fd96815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 -- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd95400b4b0 msgr2=0x7fd968148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.262 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd95400b4b0 0x7fd968148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 -- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96815bb80 msgr2=0x7fd96815c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96815bb80 0x7fd96815c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 -- 172.21.15.73:0/2154751050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680c9d30 con 0x7fd968155420 2023-12-19T16:18:25.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96759e640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd96001d4b0 tx=0x7fd9600199b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600044f0 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960003620 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600039b0 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd968153d30 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.257+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9681542b0 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9681547d0 con 0x7fd968155420 2023-12-19T16:18:25.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd960003b10 con 0x7fd968155420 2023-12-19T16:18:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd95ffff640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 0x7fd948067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fd96011cb10 con 0x7fd968155420 2023-12-19T16:18:25.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd966d9d640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 0x7fd948067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.261+0000 7fd966d9d640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 0x7fd948067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd958007fd0 tx=0x7fd9580013f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.265+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9681547d0 con 0x7fd968155420 2023-12-19T16:18:25.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9681547d0 con 0x7fd968155420 2023-12-19T16:18:25.453 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd95ffff640 1 -- 172.21.15.73:0/2154751050 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7fd9681547d0 con 0x7fd968155420 2023-12-19T16:18:25.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:25.453 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:25.454 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 msgr2=0x7fd948067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 0x7fd948067f20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd958007fd0 tx=0x7fd9580013f0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 msgr2=0x7fd9681558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd96001d4b0 tx=0x7fd9600199b0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 shutdown_connections 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.449+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd948065a60 0x7fd948067f20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.455 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd968155420 0x7fd9681558a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd96815bb80 0x7fd96815c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 --2- 172.21.15.73:0/2154751050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd95400b4b0 0x7fd968148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 >> 172.21.15.73:0/2154751050 conn(0x7fd968069cc0 msgr2=0x7fd9680caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 shutdown_connections 2023-12-19T16:18:25.456 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.453+0000 7fd96d1b3640 1 -- 172.21.15.73:0/2154751050 wait complete. 2023-12-19T16:18:25.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:25.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 Processor -- start 2023-12-19T16:18:25.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 -- start start 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c15cae0 0x7f435c06f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 0x7f435c0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0d0620 con 0x7f435c15cae0 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0cd2a0 con 0x7f435c0cfcb0 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f4363b39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0cd580 con 0x7f435c15cec0 2023-12-19T16:18:25.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43618d5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c15cae0 0x7f435c06f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43618d5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c15cae0 0x7f435c06f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49902/0 (socket says 172.21.15.73:49902) 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43618d5640 1 -- 172.21.15.73:0/3641808302 learned_addr learned my addr 172.21.15.73:0/3641808302 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43610d4640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43618d5640 1 -- 172.21.15.73:0/3641808302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 msgr2=0x7f435c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.609+0000 7f43620d6640 1 --2- 172.21.15.73:0/3641808302 >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 0x7f435c0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43618d5640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43618d5640 1 -- 172.21.15.73:0/3641808302 >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 msgr2=0x7f435c0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43618d5640 1 --2- 172.21.15.73:0/3641808302 >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 0x7f435c0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43618d5640 1 -- 172.21.15.73:0/3641808302 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0cd860 con 0x7f435c15cae0 2023-12-19T16:18:25.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43610d4640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:25.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43620d6640 1 --2- 172.21.15.73:0/3641808302 >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 0x7f435c0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:25.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43618d5640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c06f000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ce4b0 tx=0x7f435801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdd42c26f1f360f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43608d3640 1 -- 172.21.15.73:0/3641808302 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580ab600 con 0x7f435c15cae0 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43608d3640 1 -- 172.21.15.73:0/3641808302 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43580a7050 con 0x7f435c15cae0 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f43608d3640 1 -- 172.21.15.73:0/3641808302 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580ab980 con 0x7f435c15cae0 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 -- 172.21.15.73:0/3641808302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 msgr2=0x7f435c06f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c06f000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f435c0ce4b0 tx=0x7f435801c500 comp rx=0 tx=0).stop 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 -- 172.21.15.73:0/3641808302 shutdown_connections 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 --2- 172.21.15.73:0/3641808302 >> v2:172.21.15.162:3300/0 conn(0x7f435c0cfcb0 0x7f435c0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 --2- 172.21.15.73:0/3641808302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c06f000 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 -- 172.21.15.73:0/3641808302 >> 172.21.15.73:0/3641808302 conn(0x7f435c0715b0 msgr2=0x7f435c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 -- 172.21.15.73:0/3641808302 shutdown_connections 2023-12-19T16:18:25.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.613+0000 7f4363b39640 1 -- 172.21.15.73:0/3641808302 wait complete. 2023-12-19T16:18:25.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 Processor -- start 2023-12-19T16:18:25.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- start start 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 0x7f435c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c15f950 con 0x7f435c15cae0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c15e660 con 0x7f435c0cfcb0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c15f4c0 con 0x7f435c15cec0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49908/0 (socket says 172.21.15.73:49908) 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 -- 172.21.15.73:0/3922985246 learned_addr learned my addr 172.21.15.73:0/3922985246 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43620d6640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43618d5640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 0x7f435c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 -- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 msgr2=0x7f435c0b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 -- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 msgr2=0x7f435c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 0x7f435c15bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 -- 172.21.15.73:0/3922985246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580094d0 con 0x7f435c15cae0 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43618d5640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 0x7f435c15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43610d4640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c7f0 tx=0x7f434c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00cea0 con 0x7f435c15cae0 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c007a30 con 0x7f435c15cae0 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c15c410 con 0x7f435c15cae0 2023-12-19T16:18:25.624 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c007de0 con 0x7f435c15cae0 2023-12-19T16:18:25.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.617+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c15eb90 con 0x7f435c15cae0 2023-12-19T16:18:25.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c072750 con 0x7f435c15cae0 2023-12-19T16:18:25.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f434c0113f0 con 0x7f435c15cae0 2023-12-19T16:18:25.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f43527fc640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f434c083330 con 0x7f435c15cae0 2023-12-19T16:18:25.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f43618d5640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.621+0000 7f43618d5640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 0x7f4340067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f43580ad000 tx=0x7f4358008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.625+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f434c050bf0 con 0x7f435c15cae0 2023-12-19T16:18:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f435c06f890 con 0x7f435c15cae0 2023-12-19T16:18:25.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f43527fc640 1 -- 172.21.15.73:0/3922985246 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f434c054210 con 0x7f435c15cae0 2023-12-19T16:18:25.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:25.785 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:18:23.331384+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.28","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":7}]},{"pgid":"7.3a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2630347924":"2023-12-20T16:17:33.785002+0000","172.21.15.73:6835/2630347924":"2023-12-20T16:17:33.785002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 msgr2=0x7f4340067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 0x7f4340067f20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f43580ad000 tx=0x7f4358008040 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 msgr2=0x7f435c154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c7f0 tx=0x7f434c00ccb0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 shutdown_connections 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f435c15cec0 0x7f435c0b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4340065a60 0x7f4340067f20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c15cae0 0x7f435c154f70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 --2- 172.21.15.73:0/3922985246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f435c0cfcb0 0x7f435c15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.787 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 >> 172.21.15.73:0/3922985246 conn(0x7f435c0715b0 msgr2=0x7f435c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 shutdown_connections 2023-12-19T16:18:25.788 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.781+0000 7f4363b39640 1 -- 172.21.15.73:0/3922985246 wait complete. 2023-12-19T16:18:25.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T16:15:28.507124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T16:17:19.790228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T16:17:21.121249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T16:18:25.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T16:18:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.941+0000 7f0cdb7ce640 1 Processor -- start 2023-12-19T16:18:25.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 -- start start 2023-12-19T16:18:25.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0cd4070af0 0x7f0cd40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0cd40ad700 0x7f0cd40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd40ae090 con 0x7f0cd415ab60 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd406c810 con 0x7f0cd4070af0 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cdb7ce640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd4070fa0 con 0x7f0cd40ad700 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0cd4070af0 0x7f0cd40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0cd4070af0 0x7f0cd40c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49924/0 (socket says 172.21.15.73:49924) 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 -- 172.21.15.73:0/752617097 learned_addr learned my addr 172.21.15.73:0/752617097 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:25.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd9d6b640 1 --2- 172.21.15.73:0/752617097 >> v2:172.21.15.162:3300/0 conn(0x7f0cd40ad700 0x7f0cd40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 -- 172.21.15.73:0/752617097 >> v2:172.21.15.162:3300/0 conn(0x7f0cd40ad700 msgr2=0x7f0cd40adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:25.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 --2- 172.21.15.73:0/752617097 >> v2:172.21.15.162:3300/0 conn(0x7f0cd40ad700 0x7f0cd40adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 -- 172.21.15.73:0/752617097 >> v1:172.21.15.162:6789/0 conn(0x7f0cd415ab60 legacy=0x7f0cd406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.945+0000 7f0cd8d69640 1 -- 172.21.15.73:0/752617097 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4071280 con 0x7f0cd4070af0 2023-12-19T16:18:25.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cd8d69640 1 --2- 172.21.15.73:0/752617097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd4070af0 0x7f0cd40c8f00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0cd406ff60 tx=0x7f0cc401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4705c399fac3a7f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0ccbfff640 1 -- 172.21.15.73:0/752617097 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40a89f0 con 0x7f0cd4070af0 2023-12-19T16:18:25.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0ccbfff640 1 -- 172.21.15.73:0/752617097 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc40a8b50 con 0x7f0cd4070af0 2023-12-19T16:18:25.952 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0ccbfff640 1 -- 172.21.15.73:0/752617097 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40b0440 con 0x7f0cd4070af0 2023-12-19T16:18:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/752617097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd4070af0 msgr2=0x7f0cd40c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/752617097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd4070af0 0x7f0cd40c8f00 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0cd406ff60 tx=0x7f0cc401ecf0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/752617097 shutdown_connections 2023-12-19T16:18:25.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/752617097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd4070af0 0x7f0cd40c8f00 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/752617097 >> v2:172.21.15.162:3300/0 conn(0x7f0cd40ad700 0x7f0cd40adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/752617097 >> 172.21.15.73:0/752617097 conn(0x7f0cd40b05a0 msgr2=0x7f0cd40b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:25.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/752617097 shutdown_connections 2023-12-19T16:18:25.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/752617097 wait complete. 2023-12-19T16:18:25.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.949+0000 7f0cdb7ce640 1 Processor -- start 2023-12-19T16:18:25.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- start start 2023-12-19T16:18:25.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd4070af0 0x7f0cd415da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 0x7f0cd415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd415e100 con 0x7f0cd40ad700 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd414c230 con 0x7f0cd4070af0 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40cc620 con 0x7f0cd415ab60 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49932/0 (socket says 172.21.15.73:49932) 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 -- 172.21.15.73:0/3871808772 learned_addr learned my addr 172.21.15.73:0/3871808772 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd9d6b640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 0x7f0cd415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd956a640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd4070af0 0x7f0cd415da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 -- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 msgr2=0x7f0cd415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 0x7f0cd415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 -- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd4070af0 msgr2=0x7f0cd415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:25.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd4070af0 0x7f0cd415da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:25.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 -- 172.21.15.73:0/3871808772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40094d0 con 0x7f0cd40ad700 2023-12-19T16:18:25.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd9d6b640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 0x7f0cd415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:25.958 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cd8d69640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0cc401b900 tx=0x7f0cc401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40b1e00 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc40b9410 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd40cc900 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc40b97c0 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd40ccec0 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.953+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd40cd0b0 con 0x7f0cd40ad700 2023-12-19T16:18:25.959 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.957+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0cc40b7040 con 0x7f0cd40ad700 2023-12-19T16:18:25.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.957+0000 7f0cc9ffb640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 0x7f0cb8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:25.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.957+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0cc4120ee0 con 0x7f0cd40ad700 2023-12-19T16:18:25.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.957+0000 7f0cd956a640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 0x7f0cb8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:25.961 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.957+0000 7f0cd956a640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 0x7f0cb8067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40c8610 tx=0x7f0cd0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:25.964 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:25.961+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0cc40ee820 con 0x7f0cd40ad700 2023-12-19T16:18:26.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.109+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cd4072750 con 0x7f0cd40ad700 2023-12-19T16:18:26.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.109+0000 7f0cc9ffb640 1 -- 172.21.15.73:0/3871808772 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cc40c70a0 con 0x7f0cd40ad700 2023-12-19T16:18:26.114 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 msgr2=0x7f0cb8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 0x7f0cb8067f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0cd40c8610 tx=0x7f0cd0009040 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 msgr2=0x7f0cd41f2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0cc401b900 tx=0x7f0cc401ba90 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 shutdown_connections 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0cd415ab60 0x7f0cd415c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0cb8065a60 0x7f0cb8067f20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cd40ad700 0x7f0cd41f2030 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 --2- 172.21.15.73:0/3871808772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd4070af0 0x7f0cd415da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 >> 172.21.15.73:0/3871808772 conn(0x7f0cd40b05a0 msgr2=0x7f0cd40b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 shutdown_connections 2023-12-19T16:18:26.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.113+0000 7f0cdb7ce640 1 -- 172.21.15.73:0/3871808772 wait complete. 2023-12-19T16:18:26.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T16:18:26.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.273+0000 7fe6ef59e640 1 Processor -- start 2023-12-19T16:18:26.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.273+0000 7fe6ef59e640 1 -- start start 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.273+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ef59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6f00adcf0 0x7fe6f00cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ef59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0159470 con 0x7fe6f0159090 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ef59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f006c730 con 0x7fe6f00adcf0 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ef59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f006be90 con 0x7fe6f00c9470 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ee59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe6f0159090 0x7fe6f00c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53750/0 (socket says 172.21.15.73:53750) 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6ee59c640 1 -- 172.21.15.73:0/1126426058 learned_addr learned my addr 172.21.15.73:0/1126426058 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 --2- 172.21.15.73:0/1126426058 >> v2:172.21.15.73:3300/0 conn(0x7fe6f00adcf0 0x7fe6f00cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6e5d9b640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 -- 172.21.15.73:0/1126426058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 msgr2=0x7fe6f00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 -- 172.21.15.73:0/1126426058 >> v1:172.21.15.73:6789/0 conn(0x7fe6f0159090 legacy=0x7fe6f00c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 -- 172.21.15.73:0/1126426058 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f006c170 con 0x7fe6f00adcf0 2023-12-19T16:18:26.280 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6edd9b640 1 -- 172.21.15.73:0/1126426058 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133351063 0 0) 0x7fe6f0159470 con 0x7fe6f0159090 2023-12-19T16:18:26.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6eed9d640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f00cd2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80097c0 tx=0x7fe6e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fe48b0ceb766ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6edd9b640 1 -- 172.21.15.73:0/1126426058 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80ab650 con 0x7fe6f00adcf0 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6edd9b640 1 -- 172.21.15.73:0/1126426058 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e80ab7b0 con 0x7fe6f00adcf0 2023-12-19T16:18:26.283 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.277+0000 7fe6edd9b640 1 -- 172.21.15.73:0/1126426058 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80abb40 con 0x7fe6f00adcf0 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- 172.21.15.73:0/1126426058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 msgr2=0x7fe6f00cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f00cd2f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe6e80097c0 tx=0x7fe6e801c450 comp rx=0 tx=0).stop 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- 172.21.15.73:0/1126426058 shutdown_connections 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/1126426058 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f00cd2f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- 172.21.15.73:0/1126426058 >> 172.21.15.73:0/1126426058 conn(0x7fe6f006a510 msgr2=0x7fe6f00cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- 172.21.15.73:0/1126426058 shutdown_connections 2023-12-19T16:18:26.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- 172.21.15.73:0/1126426058 wait complete. 2023-12-19T16:18:26.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 Processor -- start 2023-12-19T16:18:26.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- start start 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 0x7fe6f00c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0148100 con 0x7fe6f00adcf0 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0153f40 con 0x7fe6f0159090 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ef59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0156a70 con 0x7fe6f00c9470 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.281+0000 7fe6ee59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49950/0 (socket says 172.21.15.73:49950) 2023-12-19T16:18:26.288 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 -- 172.21.15.73:0/9031075 learned_addr learned my addr 172.21.15.73:0/9031075 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e5d9b640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6eed9d640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 0x7fe6f00c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 -- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 msgr2=0x7fe6f00c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 -- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 msgr2=0x7fe6f00c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 0x7fe6f00c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 -- 172.21.15.73:0/9031075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8009420 con 0x7fe6f00adcf0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6eed9d640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 0x7fe6f00c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ee59c640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c7c0 tx=0x7fe6e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000a640 con 0x7fe6f00adcf0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f0156d50 con 0x7fe6f00adcf0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e000a7c0 con 0x7fe6f00adcf0 2023-12-19T16:18:26.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000ab70 con 0x7fe6f00adcf0 2023-12-19T16:18:26.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0157310 con 0x7fe6f00adcf0 2023-12-19T16:18:26.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00741a0 con 0x7fe6f00adcf0 2023-12-19T16:18:26.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe6e000acd0 con 0x7fe6f00adcf0 2023-12-19T16:18:26.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.285+0000 7fe6e77fe640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 0x7fe6d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.289+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fe6e0082a10 con 0x7fe6f00adcf0 2023-12-19T16:18:26.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.289+0000 7fe6e5d9b640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 0x7fe6d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.289+0000 7fe6e5d9b640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 0x7fe6d0067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00b1280 tx=0x7fe6d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.293+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe6e0050390 con 0x7fe6f00adcf0 2023-12-19T16:18:26.444 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6f00b0cb0 con 0x7fe6f00adcf0 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6e77fe640 1 -- 172.21.15.73:0/9031075 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe6e0018020 con 0x7fe6f00adcf0 2023-12-19T16:18:26.445 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 msgr2=0x7fe6d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 0x7fe6d0067f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00b1280 tx=0x7fe6d8008040 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 msgr2=0x7fe6f0147bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000c7c0 tx=0x7fe6e000cc80 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 shutdown_connections 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0159090 0x7fe6f00c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6f00c9470 0x7fe6f00c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fe6d0065a60 0x7fe6d0067f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 --2- 172.21.15.73:0/9031075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6f00adcf0 0x7fe6f0147bc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 >> 172.21.15.73:0/9031075 conn(0x7fe6f006a510 msgr2=0x7fe6f00af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 shutdown_connections 2023-12-19T16:18:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.441+0000 7fe6ef59e640 1 -- 172.21.15.73:0/9031075 wait complete. 2023-12-19T16:18:26.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T16:18:26.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.601+0000 7f579bfbc640 1 Processor -- start 2023-12-19T16:18:26.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.601+0000 7f579bfbc640 1 -- start start 2023-12-19T16:18:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579bfbc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5794070af0 0x7f57940c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579bfbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579406c810 con 0x7f579415ab60 2023-12-19T16:18:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579bfbc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5794070fa0 con 0x7f57940ad700 2023-12-19T16:18:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579bfbc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5794071280 con 0x7f5794070af0 2023-12-19T16:18:26.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799d58640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f579415ab60 0x7f579406c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53766/0 (socket says 172.21.15.73:53766) 2023-12-19T16:18:26.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799d58640 1 -- 172.21.15.73:0/1304116655 learned_addr learned my addr 172.21.15.73:0/1304116655 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:26.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 --2- 172.21.15.73:0/1304116655 >> v2:172.21.15.162:3300/0 conn(0x7f5794070af0 0x7f57940c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762102424 0 0) 0x7f579406c810 con 0x7f579415ab60 2023-12-19T16:18:26.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003530 con 0x7f579415ab60 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342900268 0 0) 0x7f5780003530 con 0x7f579415ab60 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 >> v2:172.21.15.162:3300/0 conn(0x7f5794070af0 msgr2=0x7f57940c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 --2- 172.21.15.73:0/1304116655 >> v2:172.21.15.162:3300/0 conn(0x7f5794070af0 0x7f57940c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 >> v1:172.21.15.162:6789/0 conn(0x7f57940ad700 legacy=0x7f57940cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794071560 con 0x7f579415ab60 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f5790001680 con 0x7f579415ab60 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 >> v1:172.21.15.73:6789/0 conn(0x7f579415ab60 legacy=0x7f579406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5780003980 0x7f5780003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5780005190 0x7f578000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5794071280 con 0x7f57800047d0 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578000c040 con 0x7f5780005190 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578000c200 con 0x7f5780003980 2023-12-19T16:18:26.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579a559640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5780005190 0x7f578000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799d58640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5780003980 0x7f5780003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 -- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5780003980 msgr2=0x7f5780003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5780003980 0x7f5780003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 -- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5780005190 msgr2=0x7f578000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5780005190 0x7f578000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f5799557640 1 -- 172.21.15.73:0/1304116655 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780003530 con 0x7f57800047d0 2023-12-19T16:18:26.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.605+0000 7f579a559640 1 -- 172.21.15.73:0/1304116655 reap_dead start 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f5799557640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 0x7f5780004c50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5784009ab0 tx=0x7f578401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6926bccb37d027c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840a5620 con 0x7f57800047d0 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57840a5780 con 0x7f57800047d0 2023-12-19T16:18:26.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f5798d56640 1 -- 172.21.15.73:0/1304116655 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840a5b30 con 0x7f57800047d0 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 -- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 msgr2=0x7f5780004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 0x7f5780004c50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5784009ab0 tx=0x7f578401ca30 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 -- 172.21.15.73:0/1304116655 shutdown_connections 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 --2- 172.21.15.73:0/1304116655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57800047d0 0x7f5780004c50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 -- 172.21.15.73:0/1304116655 >> 172.21.15.73:0/1304116655 conn(0x7f57940b05a0 msgr2=0x7f57940b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 -- 172.21.15.73:0/1304116655 shutdown_connections 2023-12-19T16:18:26.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.609+0000 7f579bfbc640 1 -- 172.21.15.73:0/1304116655 wait complete. 2023-12-19T16:18:26.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 Processor -- start 2023-12-19T16:18:26.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- start start 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57800047d0 0x7f57941f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 0x7f579415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57941f2800 con 0x7f579415b780 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579415bf10 con 0x7f57941f2380 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940cc3e0 con 0x7f57800047d0 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49968/0 (socket says 172.21.15.73:49968) 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 -- 172.21.15.73:0/2585746612 learned_addr learned my addr 172.21.15.73:0/2585746612 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:26.618 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f5799d58640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57800047d0 0x7f57941f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f5799557640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 0x7f579415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 -- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57800047d0 msgr2=0x7f57941f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57800047d0 0x7f57941f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 -- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 msgr2=0x7f579415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 0x7f579415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 -- 172.21.15.73:0/2585746612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940cc680 con 0x7f579415b780 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f5799557640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 0x7f579415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579a559640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f579415f820 tx=0x7f578c00e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c006e30 con 0x7f579415b780 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c003980 con 0x7f579415b780 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c003d30 con 0x7f579415b780 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57940cc960 con 0x7f579415b780 2023-12-19T16:18:26.619 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.613+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57940ccf20 con 0x7f579415b780 2023-12-19T16:18:26.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5794072750 con 0x7f579415b780 2023-12-19T16:18:26.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f578c005070 con 0x7f579415b780 2023-12-19T16:18:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f578a7fc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 0x7f5778067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f578c082a40 con 0x7f579415b780 2023-12-19T16:18:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f5799d58640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 0x7f5778067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.617+0000 7f5799d58640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 0x7f5778067f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5790001ca0 tx=0x7f5790007040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.621+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f578c050320 con 0x7f579415b780 2023-12-19T16:18:26.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.769+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57940cbf30 con 0x7f579415b780 2023-12-19T16:18:26.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.769+0000 7f578a7fc640 1 -- 172.21.15.73:0/2585746612 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f578c0190a0 con 0x7f579415b780 2023-12-19T16:18:26.775 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 msgr2=0x7f5778067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 0x7f5778067f50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5790001ca0 tx=0x7f5790007040 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 msgr2=0x7f579415ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f579415f820 tx=0x7f578c00e9e0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 shutdown_connections 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5778065a90 0x7f5778067f50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f579415b780 0x7f579415ea60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57941f2380 0x7f579415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 --2- 172.21.15.73:0/2585746612 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57800047d0 0x7f57941f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 >> 172.21.15.73:0/2585746612 conn(0x7f57940b05a0 msgr2=0x7f57940ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 shutdown_connections 2023-12-19T16:18:26.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.773+0000 7f579bfbc640 1 -- 172.21.15.73:0/2585746612 wait complete. 2023-12-19T16:18:26.796 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:26.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.929+0000 7f0de27f0640 1 Processor -- start 2023-12-19T16:18:26.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.929+0000 7f0de27f0640 1 -- start start 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de27f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de27f0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 0x7f0ddc0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de27f0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0ce020 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de27f0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0b1100 con 0x7f0ddc0cc660 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de27f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0cb130 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de0d8d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0ddc0b0c70 0x7f0ddc15e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53780/0 (socket says 172.21.15.73:53780) 2023-12-19T16:18:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0de0d8d640 1 -- 172.21.15.73:0/3745587784 learned_addr learned my addr 172.21.15.73:0/3745587784 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:26.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddb7fe640 1 --2- 172.21.15.73:0/3745587784 >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 0x7f0ddc0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/3745587784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331331952 0 0) 0x7f0ddc0ce020 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc4003530 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1135148629 0 0) 0x7f0dc4003530 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddbfff640 1 -- 172.21.15.73:0/3745587784 >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 msgr2=0x7f0ddc0b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/3745587784 >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 0x7f0ddc0b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddbfff640 1 -- 172.21.15.73:0/3745587784 >> v1:172.21.15.73:6789/0 conn(0x7f0ddc0b0c70 legacy=0x7f0ddc15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddbfff640 1 -- 172.21.15.73:0/3745587784 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0cd410 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.933+0000 7f0ddb7fe640 1 --2- 172.21.15.73:0/3745587784 >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 0x7f0ddc0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:26.939 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/3745587784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc0cc120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0097c0 tx=0x7f0dcc01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=810711a0ea1289c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4001a00 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0a7050 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0ddaffd640 1 -- 172.21.15.73:0/3745587784 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0ab620 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.940 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- 172.21.15.73:0/3745587784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 msgr2=0x7f0ddc0cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 --2- 172.21.15.73:0/3745587784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc0cc120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0097c0 tx=0x7f0dcc01c2e0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- 172.21.15.73:0/3745587784 shutdown_connections 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 --2- 172.21.15.73:0/3745587784 >> v2:172.21.15.162:3300/0 conn(0x7f0ddc0cc660 0x7f0ddc0b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 --2- 172.21.15.73:0/3745587784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc0cc120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- 172.21.15.73:0/3745587784 >> 172.21.15.73:0/3745587784 conn(0x7f0ddc069cc0 msgr2=0x7f0ddc06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- 172.21.15.73:0/3745587784 shutdown_connections 2023-12-19T16:18:26.941 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- 172.21.15.73:0/3745587784 wait complete. 2023-12-19T16:18:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 Processor -- start 2023-12-19T16:18:26.942 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.937+0000 7f0de27f0640 1 -- start start 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc0cc660 0x7f0ddc06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc06f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc152a60 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1fc870 con 0x7f0ddc0cc660 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc1fcb50 con 0x7f0ddc15a8d0 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.944 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49978/0 (socket says 172.21.15.73:49978) 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 -- 172.21.15.73:0/680063486 learned_addr learned my addr 172.21.15.73:0/680063486 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de0d8d640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddb7fe640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc0cc660 0x7f0ddc06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 -- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 msgr2=0x7f0ddc06f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc06f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 -- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc0cc660 msgr2=0x7f0ddc06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc0cc660 0x7f0ddc06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:26.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 -- 172.21.15.73:0/680063486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009420 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0ddbfff640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0ae040 tx=0x7f0dcc01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b7450 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0b75d0 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc009420 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0b7980 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc1fd110 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.941+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc072750 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.947 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.945+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0dcc0b7ae0 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.945+0000 7f0dd8ff9640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 0x7f0dc8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.945+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f0dcc11d8c0 con 0x7f0ddc0b0c70 2023-12-19T16:18:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.945+0000 7f0ddb7fe640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 0x7f0dc8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:26.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.945+0000 7f0ddb7fe640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 0x7f0dc8067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc1fc7d0 tx=0x7f0dd0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:26.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:26.949+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0dcc0eb2d0 con 0x7f0ddc0b0c70 2023-12-19T16:18:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ddc0ce850 con 0x7f0ddc0b0c70 2023-12-19T16:18:27.132 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0dd8ff9640 1 -- 172.21.15.73:0/680063486 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f0dcc0b0090 con 0x7f0ddc0b0c70 2023-12-19T16:18:27.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:27.133 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:27.133 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 msgr2=0x7f0dc8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 0x7f0dc8067f20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc1fc7d0 tx=0x7f0dd0009190 comp rx=0 tx=0).stop 2023-12-19T16:18:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 msgr2=0x7f0ddc1f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0ae040 tx=0x7f0dcc01ab20 comp rx=0 tx=0).stop 2023-12-19T16:18:27.134 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 shutdown_connections 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ddc15a8d0 0x7f0ddc06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc0cc660 0x7f0ddc06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f0dc8065a60 0x7f0dc8067f20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 --2- 172.21.15.73:0/680063486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ddc0b0c70 0x7f0ddc1f8a50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 >> 172.21.15.73:0/680063486 conn(0x7f0ddc069cc0 msgr2=0x7f0ddc0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 shutdown_connections 2023-12-19T16:18:27.135 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.129+0000 7f0de27f0640 1 -- 172.21.15.73:0/680063486 wait complete. 2023-12-19T16:18:27.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.285+0000 7f5eba8f2640 1 Processor -- start 2023-12-19T16:18:27.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.285+0000 7f5eba8f2640 1 -- start start 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eba8f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 0x7f5eb40cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eba8f2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5eb40cc660 0x7f5eb40b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eba8f2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb40ce020 con 0x7f5eb40b0c70 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eba8f2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb40b1100 con 0x7f5eb40cc660 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eba8f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb40cb130 con 0x7f5eb415a8d0 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb8e8f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5eb40b0c70 0x7f5eb415e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53796/0 (socket says 172.21.15.73:53796) 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb8e8f640 1 -- 172.21.15.73:0/2955389146 learned_addr learned my addr 172.21.15.73:0/2955389146 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:27.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/2955389146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 0x7f5eb40cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb37fe640 1 --2- 172.21.15.73:0/2955389146 >> v2:172.21.15.162:3300/0 conn(0x7f5eb40cc660 0x7f5eb40b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb2ffd640 1 -- 172.21.15.73:0/2955389146 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097361150 0 0) 0x7f5eb40ce020 con 0x7f5eb40b0c70 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb2ffd640 1 -- 172.21.15.73:0/2955389146 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e9c003530 con 0x7f5eb40b0c70 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb3fff640 1 -- 172.21.15.73:0/2955389146 >> v2:172.21.15.162:3300/0 conn(0x7f5eb40cc660 msgr2=0x7f5eb40b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/2955389146 >> v2:172.21.15.162:3300/0 conn(0x7f5eb40cc660 0x7f5eb40b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb3fff640 1 -- 172.21.15.73:0/2955389146 >> v1:172.21.15.73:6789/0 conn(0x7f5eb40b0c70 legacy=0x7f5eb415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.293 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.289+0000 7f5eb3fff640 1 -- 172.21.15.73:0/2955389146 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40cd410 con 0x7f5eb415a8d0 2023-12-19T16:18:27.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/2955389146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 0x7f5eb40cc120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097c0 tx=0x7f5ea401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714d93eb732107b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eb2ffd640 1 -- 172.21.15.73:0/2955389146 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40ab600 con 0x7f5eb415a8d0 2023-12-19T16:18:27.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eb2ffd640 1 -- 172.21.15.73:0/2955389146 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea40a7050 con 0x7f5eb415a8d0 2023-12-19T16:18:27.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eb2ffd640 1 -- 172.21.15.73:0/2955389146 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40ab980 con 0x7f5eb415a8d0 2023-12-19T16:18:27.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- 172.21.15.73:0/2955389146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 msgr2=0x7f5eb40cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/2955389146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 0x7f5eb40cc120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40097c0 tx=0x7f5ea401c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- 172.21.15.73:0/2955389146 shutdown_connections 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/2955389146 >> v2:172.21.15.162:3300/0 conn(0x7f5eb40cc660 0x7f5eb40b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/2955389146 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb415a8d0 0x7f5eb40cc120 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- 172.21.15.73:0/2955389146 >> 172.21.15.73:0/2955389146 conn(0x7f5eb4069cc0 msgr2=0x7f5eb406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- 172.21.15.73:0/2955389146 shutdown_connections 2023-12-19T16:18:27.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- 172.21.15.73:0/2955389146 wait complete. 2023-12-19T16:18:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 Processor -- start 2023-12-19T16:18:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.293+0000 7f5eba8f2640 1 -- start start 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb40b0c70 0x7f5eb4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 0x7f5eb40c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4140d10 con 0x7f5eb40cc660 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb40ca780 con 0x7f5eb415a8d0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb415f7c0 con 0x7f5eb40b0c70 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49984/0 (socket says 172.21.15.73:49984) 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 -- 172.21.15.73:0/3453622143 learned_addr learned my addr 172.21.15.73:0/3453622143 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb40b0c70 0x7f5eb4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb8e8f640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 0x7f5eb40c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 -- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb40b0c70 msgr2=0x7f5eb4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb40b0c70 0x7f5eb4140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 -- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 msgr2=0x7f5eb40c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 0x7f5eb40c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 -- 172.21.15.73:0/3453622143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009420 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb8e8f640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 0x7f5eb40c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb37fe640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e8a0 tx=0x7f5ea800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8009510 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea800c940 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800ccb0 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb415fa30 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb415fff0 con 0x7f5eb40cc660 2023-12-19T16:18:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb40ce490 con 0x7f5eb40cc660 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.297+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ea8013470 con 0x7f5eb40cc660 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.301+0000 7f5eb0ff9640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 0x7f5ea0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.301+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f5ea8083330 con 0x7f5eb40cc660 2023-12-19T16:18:27.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.301+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 0x7f5ea0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.301+0000 7f5eb3fff640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 0x7f5ea0067f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40ad000 tx=0x7f5ea40a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.305+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5eb40ce490 con 0x7f5eb40cc660 2023-12-19T16:18:27.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.453+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eb40ce490 con 0x7f5eb40cc660 2023-12-19T16:18:27.460 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eb0ff9640 1 -- 172.21.15.73:0/3453622143 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f5eb40ce490 con 0x7f5eb40cc660 2023-12-19T16:18:27.460 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:27.460 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:18:23.331384+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.28","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":7}]},{"pgid":"7.3a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2630347924":"2023-12-20T16:17:33.785002+0000","172.21.15.73:6835/2630347924":"2023-12-20T16:17:33.785002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 msgr2=0x7f5ea0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 0x7f5ea0067f50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40ad000 tx=0x7f5ea40a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 msgr2=0x7f5eb40c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800e8a0 tx=0x7f5ea800eca0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 shutdown_connections 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5eb415a8d0 0x7f5eb40c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f5ea0065a90 0x7f5ea0067f50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5eb40cc660 0x7f5eb40c4b30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 --2- 172.21.15.73:0/3453622143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5eb40b0c70 0x7f5eb4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 >> 172.21.15.73:0/3453622143 conn(0x7f5eb4069cc0 msgr2=0x7f5eb4070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 shutdown_connections 2023-12-19T16:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.457+0000 7f5eba8f2640 1 -- 172.21.15.73:0/3453622143 wait complete. 2023-12-19T16:18:27.482 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:18:27.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 Processor -- start 2023-12-19T16:18:27.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 -- start start 2023-12-19T16:18:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc144040 0x7f83fc06b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83fc06b8e0 0x7f83fc1615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc0cd740 con 0x7f83fc161af0 2023-12-19T16:18:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc0cd150 con 0x7f83fc06b8e0 2023-12-19T16:18:27.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8403666640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc162070 con 0x7f83fc144040 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83fc06b8e0 0x7f83fc1615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8401402640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc144040 0x7f83fc06b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83fc06b8e0 0x7f83fc1615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49992/0 (socket says 172.21.15.73:49992) 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 -- 172.21.15.73:0/1924303620 learned_addr learned my addr 172.21.15.73:0/1924303620 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 -- 172.21.15.73:0/1924303620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc144040 msgr2=0x7f83fc06b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 --2- 172.21.15.73:0/1924303620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc144040 0x7f83fc06b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 -- 172.21.15.73:0/1924303620 >> v1:172.21.15.162:6789/0 conn(0x7f83fc161af0 legacy=0x7f83fc0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f8400c01640 1 -- 172.21.15.73:0/1924303620 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc162350 con 0x7f83fc06b8e0 2023-12-19T16:18:27.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.617+0000 7f83f3fff640 1 -- 172.21.15.73:0/1924303620 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968477979 0 0) 0x7f83fc0cd740 con 0x7f83fc161af0 2023-12-19T16:18:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8400c01640 1 --2- 172.21.15.73:0/1924303620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc06b8e0 0x7f83fc1615b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009870 tx=0x7f83ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645f305cb944ff70 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f83f3fff640 1 -- 172.21.15.73:0/1924303620 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0aa430 con 0x7f83fc06b8e0 2023-12-19T16:18:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f83f3fff640 1 -- 172.21.15.73:0/1924303620 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec0aa590 con 0x7f83fc06b8e0 2023-12-19T16:18:27.625 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f83f3fff640 1 -- 172.21.15.73:0/1924303620 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0aa920 con 0x7f83fc06b8e0 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 -- 172.21.15.73:0/1924303620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc06b8e0 msgr2=0x7f83fc1615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 --2- 172.21.15.73:0/1924303620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc06b8e0 0x7f83fc1615b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009870 tx=0x7f83ec01c4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 -- 172.21.15.73:0/1924303620 shutdown_connections 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 --2- 172.21.15.73:0/1924303620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc06b8e0 0x7f83fc1615b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 --2- 172.21.15.73:0/1924303620 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc144040 0x7f83fc06b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 -- 172.21.15.73:0/1924303620 >> 172.21.15.73:0/1924303620 conn(0x7f83fc069cc0 msgr2=0x7f83fc06a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.626 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 -- 172.21.15.73:0/1924303620 shutdown_connections 2023-12-19T16:18:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.621+0000 7f8403666640 1 -- 172.21.15.73:0/1924303620 wait complete. 2023-12-19T16:18:27.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 Processor -- start 2023-12-19T16:18:27.628 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- start start 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc06b8e0 0x7f83fc140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83fc161af0 0x7f83fc147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc148f40 con 0x7f83fc144040 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc15a140 con 0x7f83fc161af0 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc148330 con 0x7f83fc06b8e0 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50008/0 (socket says 172.21.15.73:50008) 2023-12-19T16:18:27.629 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 -- 172.21.15.73:0/2748689179 learned_addr learned my addr 172.21.15.73:0/2748689179 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8401c03640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83fc161af0 0x7f83fc147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.630 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8401402640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc06b8e0 0x7f83fc140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 -- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc06b8e0 msgr2=0x7f83fc140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc06b8e0 0x7f83fc140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 -- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83fc161af0 msgr2=0x7f83fc147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83fc161af0 0x7f83fc147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 -- 172.21.15.73:0/2748689179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec0094d0 con 0x7f83fc144040 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8400c01640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ac040 tx=0x7f83ec01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0aa430 con 0x7f83fc144040 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec0b3820 con 0x7f83fc144040 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc148610 con 0x7f83fc144040 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0b3bd0 con 0x7f83fc144040 2023-12-19T16:18:27.631 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.625+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc148bd0 con 0x7f83fc144040 2023-12-19T16:18:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc1490b0 con 0x7f83fc144040 2023-12-19T16:18:27.632 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83ec0b3d30 con 0x7f83fc144040 2023-12-19T16:18:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f83f1ffb640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 0x7f83e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f83ec11dbb0 con 0x7f83fc144040 2023-12-19T16:18:27.633 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f8401402640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 0x7f83e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.634 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.629+0000 7f8401402640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 0x7f83e0067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83fc15a830 tx=0x7f83f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.637 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.633+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83ec0eb590 con 0x7f83fc144040 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.809+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83fc072750 con 0x7f83fc144040 2023-12-19T16:18:27.815 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f83f1ffb640 1 -- 172.21.15.73:0/2748689179 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f83ec0eebb0 con 0x7f83fc144040 2023-12-19T16:18:27.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:27.816 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:27.816 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:27.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 msgr2=0x7f83e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 0x7f83e0067f20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83fc15a830 tx=0x7f83f8008040 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 msgr2=0x7f83fc1477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0ac040 tx=0x7f83ec01acf0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 shutdown_connections 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83fc161af0 0x7f83fc147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f83e0065a60 0x7f83e0067f20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83fc144040 0x7f83fc1477c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 --2- 172.21.15.73:0/2748689179 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83fc06b8e0 0x7f83fc140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 >> 172.21.15.73:0/2748689179 conn(0x7f83fc069cc0 msgr2=0x7f83fc0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 shutdown_connections 2023-12-19T16:18:27.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.813+0000 7f8403666640 1 -- 172.21.15.73:0/2748689179 wait complete. 2023-12-19T16:18:27.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:18:27.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.969+0000 7eff69560640 1 Processor -- start 2023-12-19T16:18:27.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.969+0000 7eff69560640 1 -- start start 2023-12-19T16:18:27.975 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff69560640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff6406bc30 0x7eff6406c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff69560640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff69560640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640b2690 con 0x7eff6406cda0 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff69560640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6406c550 con 0x7eff6406bc30 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff69560640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640b1b10 con 0x7eff640b0e10 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff6406bc30 0x7eff6406c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff637fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff6406bc30 0x7eff6406c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37030/0 (socket says 172.21.15.73:37030) 2023-12-19T16:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 -- 172.21.15.73:0/2973776718 learned_addr learned my addr 172.21.15.73:0/2973776718 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 -- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 msgr2=0x7eff6415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 --2- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 -- 172.21.15.73:0/2973776718 >> v1:172.21.15.162:6789/0 conn(0x7eff6406cda0 legacy=0x7eff641595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff62ffd640 1 -- 172.21.15.73:0/2973776718 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640b1df0 con 0x7eff6406bc30 2023-12-19T16:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.973+0000 7eff627fc640 1 -- 172.21.15.73:0/2973776718 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786891875 0 0) 0x7eff640b2690 con 0x7eff6406cda0 2023-12-19T16:18:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff62ffd640 1 --2- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff6406c010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff54009870 tx=0x7eff5401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a053e19744cc547 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff627fc640 1 -- 172.21.15.73:0/2973776718 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540ab680 con 0x7eff6406bc30 2023-12-19T16:18:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff627fc640 1 -- 172.21.15.73:0/2973776718 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff540ab7e0 con 0x7eff6406bc30 2023-12-19T16:18:27.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff627fc640 1 -- 172.21.15.73:0/2973776718 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540abb70 con 0x7eff6406bc30 2023-12-19T16:18:27.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 msgr2=0x7eff6406c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.980 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff6406c010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7eff54009870 tx=0x7eff5401c480 comp rx=0 tx=0).stop 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- 172.21.15.73:0/2973776718 shutdown_connections 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- 172.21.15.73:0/2973776718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff6406c010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- 172.21.15.73:0/2973776718 >> 172.21.15.73:0/2973776718 conn(0x7eff64069cc0 msgr2=0x7eff6406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- 172.21.15.73:0/2973776718 shutdown_connections 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- 172.21.15.73:0/2973776718 wait complete. 2023-12-19T16:18:27.981 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 Processor -- start 2023-12-19T16:18:27.982 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- start start 2023-12-19T16:18:27.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff64156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.983 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.977+0000 7eff69560640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff641576e0 con 0x7eff6406cda0 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff69560640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64156b40 con 0x7eff6406bc30 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff69560640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6413e770 con 0x7eff640b0e10 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50010/0 (socket says 172.21.15.73:50010) 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 -- 172.21.15.73:0/1003625411 learned_addr learned my addr 172.21.15.73:0/1003625411 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff62ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff64156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.984 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff637fe640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 -- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 msgr2=0x7eff6414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6414cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 -- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 msgr2=0x7eff64156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff64156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 -- 172.21.15.73:0/1003625411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540094d0 con 0x7eff6406cda0 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff62ffd640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff64156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5a7fc640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c480 tx=0x7eff4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.985 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c005480 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c003600 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff64154ab0 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c0039b0 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff64155070 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff64072750 con 0x7eff6406cda0 2023-12-19T16:18:27.986 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.981+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff4c003b10 con 0x7eff6406cda0 2023-12-19T16:18:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.985+0000 7eff5bfff640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 0x7eff48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.985+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7eff4c082cf0 con 0x7eff6406cda0 2023-12-19T16:18:27.987 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.985+0000 7eff62ffd640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 0x7eff48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:27.988 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.985+0000 7eff62ffd640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 0x7eff48067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff540af000 tx=0x7eff54004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:27.991 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:27.985+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff4c087070 con 0x7eff6406cda0 2023-12-19T16:18:28.172 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.169+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff640b29d0 con 0x7eff6406cda0 2023-12-19T16:18:28.173 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.169+0000 7eff5bfff640 1 -- 172.21.15.73:0/1003625411 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4716 (secure 0 0 0) 0x7eff4c054110 con 0x7eff6406cda0 2023-12-19T16:18:28.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:28.173 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T16:17:22.120066+0000","modified":"2023-12-19T16:17:37.818779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":54,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5646":{"gid":5646,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":5,"addr":"172.21.15.73:6837/2814692317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":2814692317},{"type":"v1","addr":"172.21.15.73:6837","nonce":2814692317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T16:18:28.174 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 36 2023-12-19T16:18:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.169+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 msgr2=0x7eff48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.169+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 0x7eff48067f20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff540af000 tx=0x7eff54004740 comp rx=0 tx=0).stop 2023-12-19T16:18:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 msgr2=0x7eff6413e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.175 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c480 tx=0x7eff4c00c940 comp rx=0 tx=0).stop 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 shutdown_connections 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff640b0e10 0x7eff6414cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7eff48065a60 0x7eff48067f20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff6406cda0 0x7eff6413e230 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 --2- 172.21.15.73:0/1003625411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff6406bc30 0x7eff64156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 >> 172.21.15.73:0/1003625411 conn(0x7eff64069cc0 msgr2=0x7eff6406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 shutdown_connections 2023-12-19T16:18:28.176 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.173+0000 7eff69560640 1 -- 172.21.15.73:0/1003625411 wait complete. 2023-12-19T16:18:28.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 Processor -- start 2023-12-19T16:18:28.332 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 -- start start 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b415a8d0 0x7fb3b40cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b40cc660 0x7fb3b40b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b40ce020 con 0x7fb3b40b0c70 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b40b1100 con 0x7fb3b40cc660 2023-12-19T16:18:28.333 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3bbc5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40cb130 con 0x7fb3b415a8d0 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b40cc660 0x7fb3b40b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b99fb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b415a8d0 0x7fb3b40cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3b40cc660 0x7fb3b40b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:37046/0 (socket says 172.21.15.73:37046) 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 -- 172.21.15.73:0/4133842397 learned_addr learned my addr 172.21.15.73:0/4133842397 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 -- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b415a8d0 msgr2=0x7fb3b40cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 --2- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b415a8d0 0x7fb3b40cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 -- 172.21.15.73:0/4133842397 >> v1:172.21.15.162:6789/0 conn(0x7fb3b40b0c70 legacy=0x7fb3b415e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.334 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.329+0000 7fb3b91fa640 1 -- 172.21.15.73:0/4133842397 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40cd410 con 0x7fb3b40cc660 2023-12-19T16:18:28.336 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3b91fa640 1 --2- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b40b0730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009870 tx=0x7fb3a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a05dc30e55ed3dbb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3b89f9640 1 -- 172.21.15.73:0/4133842397 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40ac600 con 0x7fb3b40cc660 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3b89f9640 1 -- 172.21.15.73:0/4133842397 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a40a8050 con 0x7fb3b40cc660 2023-12-19T16:18:28.337 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3b89f9640 1 -- 172.21.15.73:0/4133842397 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40ac980 con 0x7fb3b40cc660 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 msgr2=0x7fb3b40b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b40b0730 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009870 tx=0x7fb3a401c480 comp rx=0 tx=0).stop 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/4133842397 shutdown_connections 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b40b0730 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/4133842397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b415a8d0 0x7fb3b40cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/4133842397 >> 172.21.15.73:0/4133842397 conn(0x7fb3b4069cc0 msgr2=0x7fb3b406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/4133842397 shutdown_connections 2023-12-19T16:18:28.338 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.333+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/4133842397 wait complete. 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 Processor -- start 2023-12-19T16:18:28.339 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- start start 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b40b0c70 0x7fb3b4156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b4160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c6ce0 con 0x7fb3b415a8d0 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c6fc0 con 0x7fb3b40cc660 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b40c72a0 con 0x7fb3b40b0c70 2023-12-19T16:18:28.342 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50018/0 (socket says 172.21.15.73:50018) 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 -- 172.21.15.73:0/2671106490 learned_addr learned my addr 172.21.15.73:0/2671106490 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3b99fb640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b40b0c70 0x7fb3b4156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3b91fa640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b4160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 -- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b40b0c70 msgr2=0x7fb3b4156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b40b0c70 0x7fb3b4156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 -- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 msgr2=0x7fb3b4160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b4160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 -- 172.21.15.73:0/2671106490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a40094d0 con 0x7fb3b415a8d0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3ba1fc640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c730 tx=0x7fb3ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac003b80 con 0x7fb3b415a8d0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac003ce0 con 0x7fb3b415a8d0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b40c7580 con 0x7fb3b415a8d0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac00aa30 con 0x7fb3b415a8d0 2023-12-19T16:18:28.343 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.337+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b4160740 con 0x7fb3b415a8d0 2023-12-19T16:18:28.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b4072750 con 0x7fb3b415a8d0 2023-12-19T16:18:28.344 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3ac00ab90 con 0x7fb3b415a8d0 2023-12-19T16:18:28.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3aa7fc640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 0x7fb398067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fb3ac082ee0 con 0x7fb3b415a8d0 2023-12-19T16:18:28.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3b99fb640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 0x7fb398067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.345 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.341+0000 7fb3b99fb640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 0x7fb398067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb3b406ceb0 tx=0x7fb3b0009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.345+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb3ac050850 con 0x7fb3b415a8d0 2023-12-19T16:18:28.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.505+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3b40b1580 con 0x7fb3b415a8d0 2023-12-19T16:18:28.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3aa7fc640 1 -- 172.21.15.73:0/2671106490 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16403 (secure 0 0 0) 0x7fb3ac053e70 con 0x7fb3b415a8d0 2023-12-19T16:18:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:28.512 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":58,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:18:23.331384+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-19T16:17:19.790228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-19T16:17:21.121249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.28","mappings":[{"from":5,"to":7}]},{"pgid":"7.30","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":7}]},{"pgid":"7.35","mappings":[{"from":5,"to":7}]},{"pgid":"7.3a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2630347924":"2023-12-20T16:17:33.785002+0000","172.21.15.73:6835/2630347924":"2023-12-20T16:17:33.785002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 msgr2=0x7fb398067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 0x7fb398067f20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb3b406ceb0 tx=0x7fb3b0009190 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 msgr2=0x7fb3b4143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00c730 tx=0x7fb3ac00cbf0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 shutdown_connections 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fb398065a60 0x7fb398067f20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3b415a8d0 0x7fb3b4143d00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3b40cc660 0x7fb3b4160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 --2- 172.21.15.73:0/2671106490 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3b40b0c70 0x7fb3b4156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 >> 172.21.15.73:0/2671106490 conn(0x7fb3b4069cc0 msgr2=0x7fb3b40ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 shutdown_connections 2023-12-19T16:18:28.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.509+0000 7fb3bbc5f640 1 -- 172.21.15.73:0/2671106490 wait complete. 2023-12-19T16:18:28.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T16:18:28.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 Processor -- start 2023-12-19T16:18:28.672 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 -- start start 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f440b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440d0980 con 0x7f7f440b4c60 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440d2230 con 0x7f7f440b82c0 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4b2a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440d2510 con 0x7f7f4415cbb0 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4aaa7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7f440b4c60 0x7f7f440d0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53798/0 (socket says 172.21.15.73:53798) 2023-12-19T16:18:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4aaa7640 1 -- 172.21.15.73:0/2950621475 learned_addr learned my addr 172.21.15.73:0/2950621475 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812885405 0 0) 0x7f7f440d0980 con 0x7f7f440b4c60 2023-12-19T16:18:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f4a2a6640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f440b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003530 con 0x7f7f440b4c60 2023-12-19T16:18:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427390314 0 0) 0x7f7f30003530 con 0x7f7f440b4c60 2023-12-19T16:18:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 msgr2=0x7f7f440b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f440b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 >> v1:172.21.15.162:6789/0 conn(0x7f7f440b82c0 legacy=0x7f7f440b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440d27f0 con 0x7f7f440b4c60 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f7f3c001a00 con 0x7f7f440b4c60 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 >> v1:172.21.15.73:6789/0 conn(0x7f7f440b4c60 legacy=0x7f7f440d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f300039b0 0x7f7f30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440d2510 con 0x7f7f300047d0 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3000ba40 con 0x7f7f300039b0 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.669+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3000bc00 con 0x7f7f4415cbb0 2023-12-19T16:18:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f4a2a6640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f300039b0 0x7f7f30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f4aaa7640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 -- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 msgr2=0x7f7f30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 -- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f300039b0 msgr2=0x7f7f30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f300039b0 0x7f7f30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 -- 172.21.15.73:0/2950621475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30003530 con 0x7f7f300047d0 2023-12-19T16:18:28.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f4aaa7640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4415cbb0 0x7f7f30005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:28.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f30004c50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001750 tx=0x7f7f3401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20873c451aef5f9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f340052d0 con 0x7f7f300047d0 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f340a7050 con 0x7f7f300047d0 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.673+0000 7f7f492a4640 1 -- 172.21.15.73:0/2950621475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003600 con 0x7f7f300047d0 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/2950621475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 msgr2=0x7f7f30004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/2950621475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f30004c50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001750 tx=0x7f7f3401c3a0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4aaa7640 1 -- 172.21.15.73:0/2950621475 reap_dead start 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/2950621475 shutdown_connections 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/2950621475 >> 172.21.15.73:0/2950621475 conn(0x7f7f440cf550 msgr2=0x7f7f440cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/2950621475 shutdown_connections 2023-12-19T16:18:28.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/2950621475 wait complete. 2023-12-19T16:18:28.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 Processor -- start 2023-12-19T16:18:28.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- start start 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f44151ec0 0x7f7f440cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f44152340 0x7f7f440cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.687 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f441f3370 con 0x7f7f300047d0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440c6cb0 con 0x7f7f44151ec0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4b2a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440c6f90 con 0x7f7f44152340 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50040/0 (socket says 172.21.15.73:50040) 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 -- 172.21.15.73:0/4254810715 learned_addr learned my addr 172.21.15.73:0/4254810715 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f44151ec0 0x7f7f440cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4aaa7640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f44152340 0x7f7f440cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 -- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f44152340 msgr2=0x7f7f440cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f44152340 0x7f7f440cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 -- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f44151ec0 msgr2=0x7f7f440cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f44151ec0 0x7f7f440cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 -- 172.21.15.73:0/4254810715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440c7270 con 0x7f7f300047d0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.677+0000 7f7f4a2a6640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7f400119d0 tx=0x7f7f40011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000fb50 con 0x7f7f300047d0 2023-12-19T16:18:28.688 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000fcb0 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f440c7550 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40014440 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f440c7830 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f440d05f0 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f400145a0 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 0x7f7f28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f7f40083c70 con 0x7f7f300047d0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 0x7f7f28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.681+0000 7f7f49aa5640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 0x7f7f28067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f300057b0 tx=0x7f7f340011a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:28.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.685+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f440d05f0 con 0x7f7f300047d0 2023-12-19T16:18:28.880 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.877+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f440d05f0 con 0x7f7f300047d0 2023-12-19T16:18:28.881 INFO:tasks.ceph.mon.a.smithi073.stderr:2023-12-19T16:18:28.877+0000 7f8e22455640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T16:18:28.893 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.885+0000 7f7f3affd640 1 -- 172.21.15.73:0/4254810715 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f440d05f0 con 0x7f7f300047d0 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 msgr2=0x7f7f28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 0x7f7f28067f20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f300057b0 tx=0x7f7f340011a0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 msgr2=0x7f7f441f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7f400119d0 tx=0x7f7f40011e90 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 shutdown_connections 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f44152340 0x7f7f440cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f44151ec0 0x7f7f440cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7f28065a60 0x7f7f28067f20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 --2- 172.21.15.73:0/4254810715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f300047d0 0x7f7f441f2e30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 >> 172.21.15.73:0/4254810715 conn(0x7f7f440cf550 msgr2=0x7f7f440b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:28.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 shutdown_connections 2023-12-19T16:18:28.895 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:28.889+0000 7f7f4b2a8640 1 -- 172.21.15.73:0/4254810715 wait complete. 2023-12-19T16:18:28.898 INFO:tasks.ceph.mds.c.smithi073.stderr: -2565> 2023-12-19T16:17:38.806+0000 7fc65859f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T16:18:28.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T16:18:28.946 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2023-12-19T16:18:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.049+0000 7fc48f59e640 1 Processor -- start 2023-12-19T16:18:29.054 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.049+0000 7fc48f59e640 1 -- start start 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48f59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc49015aa30 0x7fc4900705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48f59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc49006c280 0x7fc4900b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48f59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4900c8d60 con 0x7fc490070b20 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48f59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4900c9390 con 0x7fc49006c280 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48f59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490071030 con 0x7fc49015aa30 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc49006c280 0x7fc4900b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.056 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc49006c280 0x7fc4900b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50062/0 (socket says 172.21.15.73:50062) 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 -- 172.21.15.73:0/870975002 learned_addr learned my addr 172.21.15.73:0/870975002 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc48e59c640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc49015aa30 0x7fc4900705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 -- 172.21.15.73:0/870975002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc49015aa30 msgr2=0x7fc4900705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc49015aa30 0x7fc4900705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 -- 172.21.15.73:0/870975002 >> v1:172.21.15.162:6789/0 conn(0x7fc490070b20 legacy=0x7fc49006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.057 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.053+0000 7fc485d9b640 1 -- 172.21.15.73:0/870975002 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490071310 con 0x7fc49006c280 2023-12-19T16:18:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc485d9b640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49006c280 0x7fc4900b0190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc478009870 tx=0x7fc47801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1298c0158ab796 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48dd9b640 1 -- 172.21.15.73:0/870975002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780ac410 con 0x7fc49006c280 2023-12-19T16:18:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48dd9b640 1 -- 172.21.15.73:0/870975002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780ac570 con 0x7fc49006c280 2023-12-19T16:18:29.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48dd9b640 1 -- 172.21.15.73:0/870975002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780ac900 con 0x7fc49006c280 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- 172.21.15.73:0/870975002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49006c280 msgr2=0x7fc4900b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49006c280 0x7fc4900b0190 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc478009870 tx=0x7fc47801c480 comp rx=0 tx=0).stop 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- 172.21.15.73:0/870975002 shutdown_connections 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49006c280 0x7fc4900b0190 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 --2- 172.21.15.73:0/870975002 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc49015aa30 0x7fc4900705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- 172.21.15.73:0/870975002 >> 172.21.15.73:0/870975002 conn(0x7fc49006a510 msgr2=0x7fc4900cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- 172.21.15.73:0/870975002 shutdown_connections 2023-12-19T16:18:29.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- 172.21.15.73:0/870975002 wait complete. 2023-12-19T16:18:29.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 Processor -- start 2023-12-19T16:18:29.062 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.057+0000 7fc48f59e640 1 -- start start 2023-12-19T16:18:29.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49006c280 0x7fc4901455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.063 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc490070b20 0x7fc490142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c7010 con 0x7fc49015aa30 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4900c50c0 con 0x7fc49006c280 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc490145b10 con 0x7fc490070b20 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50068/0 (socket says 172.21.15.73:50068) 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 -- 172.21.15.73:0/765272269 learned_addr learned my addr 172.21.15.73:0/765272269 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc485d9b640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc490070b20 0x7fc490142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.064 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48e59c640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49006c280 0x7fc4901455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 -- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc490070b20 msgr2=0x7fc490142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.065 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc490070b20 0x7fc490142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 -- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49006c280 msgr2=0x7fc4901455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49006c280 0x7fc4901455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 -- 172.21.15.73:0/765272269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780094d0 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48ed9d640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c340 tx=0x7fc48800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488005220 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488005380 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4900c4de0 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488007270 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4900c77e0 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4900c7330 con 0x7fc49015aa30 2023-12-19T16:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.061+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4880073d0 con 0x7fc49015aa30 2023-12-19T16:18:29.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.065+0000 7fc4877fe640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 0x7fc470067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:29.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.065+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6026+0+0 (secure 0 0 0) 0x7fc4880828d0 con 0x7fc49015aa30 2023-12-19T16:18:29.068 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.065+0000 7fc48e59c640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 0x7fc470067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:29.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.065+0000 7fc48e59c640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 0x7fc470067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc480007330 tx=0x7fc48000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:29.071 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.065+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc4880500b0 con 0x7fc49015aa30 2023-12-19T16:18:29.250 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.245+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4900c7150 con 0x7fc49015aa30 2023-12-19T16:18:29.894 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.889+0000 7fc4877fe640 1 -- 172.21.15.73:0/765272269 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4880536d0 con 0x7fc49015aa30 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 msgr2=0x7fc470067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 0x7fc470067f20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc480007330 tx=0x7fc48000b040 comp rx=0 tx=0).stop 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 msgr2=0x7fc4900b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c340 tx=0x7fc48800c800 comp rx=0 tx=0).stop 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 shutdown_connections 2023-12-19T16:18:29.897 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fc470065a60 0x7fc470067f20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49015aa30 0x7fc4900b25b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc490070b20 0x7fc490142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 --2- 172.21.15.73:0/765272269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49006c280 0x7fc4901455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 >> 172.21.15.73:0/765272269 conn(0x7fc49006a510 msgr2=0x7fc4900af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 shutdown_connections 2023-12-19T16:18:29.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:29.893+0000 7fc48f59e640 1 -- 172.21.15.73:0/765272269 wait complete. 2023-12-19T16:18:29.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T16:18:30.100 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 Processor -- start 2023-12-19T16:18:30.101 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 -- start start 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffb0c161340 0x7ffb0c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c161f10 con 0x7ffb0c160f60 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06b790 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb13339640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cac60 con 0x7ffb0c161340 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb110d5640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ffb0c160f60 0x7ffb0c0ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53812/0 (socket says 172.21.15.73:53812) 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb110d5640 1 -- 172.21.15.73:0/1864625178 learned_addr learned my addr 172.21.15.73:0/1864625178 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:30.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1864625178 >> v2:172.21.15.162:3300/0 conn(0x7ffb0c161340 0x7ffb0c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636622530 0 0) 0x7ffb0c161f10 con 0x7ffb0c160f60 2023-12-19T16:18:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf8003530 con 0x7ffb0c160f60 2023-12-19T16:18:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb108d4640 1 -- 172.21.15.73:0/1864625178 >> v1:172.21.15.162:6789/0 conn(0x7ffb0c0b03e0 legacy=0x7ffb0c164d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb108d4640 1 -- 172.21.15.73:0/1864625178 >> v1:172.21.15.73:6789/0 conn(0x7ffb0c160f60 legacy=0x7ffb0c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98490833 0 0) 0x7ffaf8003530 con 0x7ffb0c160f60 2023-12-19T16:18:30.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.097+0000 7ffb108d4640 1 -- 172.21.15.73:0/1864625178 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0caf40 con 0x7ffb0c161340 2023-12-19T16:18:30.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1864625178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c161340 0x7ffb0c1623a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0097c0 tx=0x7ffafc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c1778e32205a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:30.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08001680 con 0x7ffb0c161340 2023-12-19T16:18:30.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0a7050 con 0x7ffb0c161340 2023-12-19T16:18:30.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb03fff640 1 -- 172.21.15.73:0/1864625178 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc0ab600 con 0x7ffb0c161340 2023-12-19T16:18:30.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 -- 172.21.15.73:0/1864625178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c161340 msgr2=0x7ffb0c1623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 --2- 172.21.15.73:0/1864625178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c161340 0x7ffb0c1623a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0097c0 tx=0x7ffafc01c370 comp rx=0 tx=0).stop 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 -- 172.21.15.73:0/1864625178 shutdown_connections 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 --2- 172.21.15.73:0/1864625178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c161340 0x7ffb0c1623a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 -- 172.21.15.73:0/1864625178 >> 172.21.15.73:0/1864625178 conn(0x7ffb0c0cb800 msgr2=0x7ffb0c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 -- 172.21.15.73:0/1864625178 shutdown_connections 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.101+0000 7ffb13339640 1 -- 172.21.15.73:0/1864625178 wait complete. 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 Processor -- start 2023-12-19T16:18:30.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 -- start start 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 0x7ffb0c13a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 0x7ffb0c150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c151c00 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1560a0 con 0x7ffb0c160f60 2023-12-19T16:18:30.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c156be0 con 0x7ffb0c161340 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50084/0 (socket says 172.21.15.73:50084) 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 -- 172.21.15.73:0/1803044366 learned_addr learned my addr 172.21.15.73:0/1803044366 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 0x7ffb0c13a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 -- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 msgr2=0x7ffb0c150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb118d6640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 0x7ffb0c150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 0x7ffb0c150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 -- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 msgr2=0x7ffb0c13a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 0x7ffb0c13a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 -- 172.21.15.73:0/1803044366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009420 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 0x7ffb0c13a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb118d6640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 0x7ffb0c150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb110d5640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ffb080011f0 tx=0x7ffb0800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:30.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08005ae0 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08005c40 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0b0d80 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.105+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08007070 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c156590 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c0727c0 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb080071d0 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb01ffb640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 0x7ffaf0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:30.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6026+0+0 (secure 0 0 0) 0x7ffb08082a30 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 0x7ffaf0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:30.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.109+0000 7ffb108d4640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 0x7ffaf0067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0ad000 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:30.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.113+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb08050290 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.265+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb0c0cdb70 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.898 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.893+0000 7ffb01ffb640 1 -- 172.21.15.73:0/1803044366 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb08017020 con 0x7ffb0c0b03e0 2023-12-19T16:18:30.898 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2023-12-19T16:18:30.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 msgr2=0x7ffaf0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 0x7ffaf0067f20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0ad000 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2023-12-19T16:18:30.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 msgr2=0x7ffb0c151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:30.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ffb080011f0 tx=0x7ffb0800cbe0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.901 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 shutdown_connections 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb0c161340 0x7ffb0c150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb0c160f60 0x7ffb0c13a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ffaf0065a60 0x7ffaf0067f20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 --2- 172.21.15.73:0/1803044366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b03e0 0x7ffb0c151570 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 >> 172.21.15.73:0/1803044366 conn(0x7ffb0c0cb800 msgr2=0x7ffb0c070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 shutdown_connections 2023-12-19T16:18:30.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:30.897+0000 7ffb13339640 1 -- 172.21.15.73:0/1803044366 wait complete. 2023-12-19T16:18:30.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T16:18:31.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 Processor -- start 2023-12-19T16:18:31.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 -- start start 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 0x7f6c6406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c6406d390 0x7f6c640cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c64071470 con 0x7f6c6415aac0 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c640ade10 con 0x7f6c6406d390 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c6a0e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6406d810 con 0x7f6c640cde00 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c6406d390 0x7f6c640cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c6406d390 0x7f6c640cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50088/0 (socket says 172.21.15.73:50088) 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 -- 172.21.15.73:0/2992180852 learned_addr learned my addr 172.21.15.73:0/2992180852 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:31.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c5bfff640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 0x7f6c6406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 -- 172.21.15.73:0/2992180852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 msgr2=0x7f6c6406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:31.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 0x7f6c6406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 -- 172.21.15.73:0/2992180852 >> v1:172.21.15.162:6789/0 conn(0x7f6c6415aac0 legacy=0x7f6c640ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c63fff640 1 -- 172.21.15.73:0/2992180852 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640ae070 con 0x7f6c6406d390 2023-12-19T16:18:31.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.069+0000 7f6c5bfff640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 0x7f6c6406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:31.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c63fff640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c6406d390 0x7f6c640cc680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009e50 tx=0x7f6c5c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab68392de18079c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:31.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c62ffd640 1 -- 172.21.15.73:0/2992180852 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0a58a0 con 0x7f6c6406d390 2023-12-19T16:18:31.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c62ffd640 1 -- 172.21.15.73:0/2992180852 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0a5a00 con 0x7f6c6406d390 2023-12-19T16:18:31.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c62ffd640 1 -- 172.21.15.73:0/2992180852 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0a5d90 con 0x7f6c6406d390 2023-12-19T16:18:31.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/2992180852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c6406d390 msgr2=0x7f6c640cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c6406d390 0x7f6c640cc680 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009e50 tx=0x7f6c5c01c9e0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/2992180852 shutdown_connections 2023-12-19T16:18:31.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c6406d390 0x7f6c640cc680 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/2992180852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c640cde00 0x7f6c6406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/2992180852 >> 172.21.15.73:0/2992180852 conn(0x7f6c640cb800 msgr2=0x7f6c640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/2992180852 shutdown_connections 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.073+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/2992180852 wait complete. 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 Processor -- start 2023-12-19T16:18:31.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- start start 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6406d390 0x7f6c6414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6415aac0 0x7f6c6413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64142090 con 0x7f6c640cde00 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6414e530 con 0x7f6c6406d390 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6414e810 con 0x7f6c6415aac0 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50096/0 (socket says 172.21.15.73:50096) 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 -- 172.21.15.73:0/1399265727 learned_addr learned my addr 172.21.15.73:0/1399265727 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c63fff640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6415aac0 0x7f6c6413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c637fe640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6406d390 0x7f6c6414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 -- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6415aac0 msgr2=0x7f6c6413f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6415aac0 0x7f6c6413f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 -- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6406d390 msgr2=0x7f6c6414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6406d390 0x7f6c6414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 -- 172.21.15.73:0/1399265727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c009b30 con 0x7f6c640cde00 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c5bfff640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00d800 tx=0x7f6c4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00b6c0 con 0x7f6c640cde00 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00b820 con 0x7f6c640cde00 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00bb90 con 0x7f6c640cde00 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6414eaf0 con 0x7f6c640cde00 2023-12-19T16:18:31.083 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c640b0520 con 0x7f6c640cde00 2023-12-19T16:18:31.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.077+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c641421d0 con 0x7f6c640cde00 2023-12-19T16:18:31.084 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.081+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6c4c00bcf0 con 0x7f6c640cde00 2023-12-19T16:18:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.081+0000 7f6c60ff9640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 0x7f6c44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.081+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5588+0+0 (secure 0 0 0) 0x7f6c4c083560 con 0x7f6c640cde00 2023-12-19T16:18:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.081+0000 7f6c637fe640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 0x7f6c44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:31.085 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.081+0000 7f6c637fe640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 0x7f6c44067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c641f6c70 tx=0x7f6c54009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:31.089 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.085+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6c641421d0 con 0x7f6c640cde00 2023-12-19T16:18:31.238 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.233+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c641421d0 con 0x7f6c640cde00 2023-12-19T16:18:31.900 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.893+0000 7f6c60ff9640 1 -- 172.21.15.73:0/1399265727 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6c641421d0 con 0x7f6c640cde00 2023-12-19T16:18:31.900 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2023-12-19T16:18:31.902 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 msgr2=0x7f6c44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 0x7f6c44067f20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c641f6c70 tx=0x7f6c54009040 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 msgr2=0x7f6c64145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c00d800 tx=0x7f6c4c00dcc0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 shutdown_connections 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6415aac0 0x7f6c6413f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6c44065a60 0x7f6c44067f20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c640cde00 0x7f6c64145600 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 --2- 172.21.15.73:0/1399265727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6406d390 0x7f6c6414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 >> 172.21.15.73:0/1399265727 conn(0x7f6c640cb800 msgr2=0x7f6c640b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:31.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 shutdown_connections 2023-12-19T16:18:31.904 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:31.897+0000 7f6c6a0e5640 1 -- 172.21.15.73:0/1399265727 wait complete. 2023-12-19T16:18:31.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:18:31.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T16:18:31.974 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T16:18:31.975 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.976 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:18:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:18:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T16:18:31.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T16:18:31.978 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.979 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.980 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T16:18:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T16:18:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T16:18:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:18:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2023-12-19T16:18:31.981 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T16:18:31.982 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.983 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T16:18:31.984 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T16:18:31.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:18:31.986 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T16:18:31.987 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:18:31.988 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T16:18:31.989 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:18:31.990 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T16:18:31.991 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T16:18:31.992 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2023-12-19T16:18:31.993 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2023-12-19T16:18:31.994 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.995 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.73,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = 90ec874a-c348-4a69-99d9-d4bef3b9261d 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2023-12-19T16:18:31.996 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.997 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2023-12-19T16:18:31.998 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2023-12-19T16:18:31.999 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2023-12-19T16:18:32.000 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2023-12-19T16:18:32.001 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2023-12-19T16:18:32.002 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T16:18:32.003 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2023-12-19T16:18:32.004 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:18:32.005 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2023-12-19T16:18:32.006 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2023-12-19T16:18:32.007 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2023-12-19T16:18:32.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T16:18:32.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 Processor -- start 2023-12-19T16:18:32.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 -- start start 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f507c0cb390 0x7f507c0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c15aed0 con 0x7f507c15aaf0 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c15f580 con 0x7f507c0ccd20 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507b59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c0cbd60 con 0x7f507c0cb390 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f507c15aaf0 0x7f507c15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53814/0 (socket says 172.21.15.73:53814) 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.189+0000 7f507a59c640 1 -- 172.21.15.73:0/2045873761 learned_addr learned my addr 172.21.15.73:0/2045873761 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:32.195 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5073fff640 1 --2- 172.21.15.73:0/2045873761 >> v2:172.21.15.73:3300/0 conn(0x7f507c0cb390 0x7f507c0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5079d9b640 1 -- 172.21.15.73:0/2045873761 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889445887 0 0) 0x7f507c15aed0 con 0x7f507c15aaf0 2023-12-19T16:18:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5079d9b640 1 -- 172.21.15.73:0/2045873761 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5068003530 con 0x7f507c15aaf0 2023-12-19T16:18:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5073fff640 1 -- 172.21.15.73:0/2045873761 >> v1:172.21.15.162:6789/0 conn(0x7f507c0ccd20 legacy=0x7f507c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5073fff640 1 -- 172.21.15.73:0/2045873761 >> v1:172.21.15.73:6789/0 conn(0x7f507c15aaf0 legacy=0x7f507c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5073fff640 1 -- 172.21.15.73:0/2045873761 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c15ed10 con 0x7f507c0cb390 2023-12-19T16:18:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5073fff640 1 --2- 172.21.15.73:0/2045873761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0cb390 0x7f507c0cb820 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f50640097c0 tx=0x7f506401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782e4f8a701a2b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5079d9b640 1 -- 172.21.15.73:0/2045873761 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640ab650 con 0x7f507c0cb390 2023-12-19T16:18:32.198 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5079d9b640 1 -- 172.21.15.73:0/2045873761 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640ab7b0 con 0x7f507c0cb390 2023-12-19T16:18:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.193+0000 7f5079d9b640 1 -- 172.21.15.73:0/2045873761 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640abb20 con 0x7f507c0cb390 2023-12-19T16:18:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- 172.21.15.73:0/2045873761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0cb390 msgr2=0x7f507c0cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 --2- 172.21.15.73:0/2045873761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0cb390 0x7f507c0cb820 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f50640097c0 tx=0x7f506401c450 comp rx=0 tx=0).stop 2023-12-19T16:18:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- 172.21.15.73:0/2045873761 shutdown_connections 2023-12-19T16:18:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 --2- 172.21.15.73:0/2045873761 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0cb390 0x7f507c0cb820 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- 172.21.15.73:0/2045873761 >> 172.21.15.73:0/2045873761 conn(0x7f507c06a120 msgr2=0x7f507c06a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- 172.21.15.73:0/2045873761 shutdown_connections 2023-12-19T16:18:32.200 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- 172.21.15.73:0/2045873761 wait complete. 2023-12-19T16:18:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 Processor -- start 2023-12-19T16:18:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- start start 2023-12-19T16:18:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f507c0cb390 0x7f507c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f507c0ccd20 0x7f507c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c15e0f0 con 0x7f507c15aaf0 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c151100 con 0x7f507c0cb390 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507b59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0714e0 con 0x7f507c0ccd20 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50120/0 (socket says 172.21.15.73:50120) 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 -- 172.21.15.73:0/2231473581 learned_addr learned my addr 172.21.15.73:0/2231473581 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f5073fff640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f507c0ccd20 0x7f507c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.203 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507a59c640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f507c0cb390 0x7f507c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 -- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f507c0ccd20 msgr2=0x7f507c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f507c0ccd20 0x7f507c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 -- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f507c0cb390 msgr2=0x7f507c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f507c0cb390 0x7f507c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.197+0000 7f507ad9d640 1 -- 172.21.15.73:0/2231473581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009420 con 0x7f507c15aaf0 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f507ad9d640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f507400c7a0 tx=0x7f507400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074003b80 con 0x7f507c15aaf0 2023-12-19T16:18:32.204 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074003ce0 con 0x7f507c15aaf0 2023-12-19T16:18:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507400aa90 con 0x7f507c15aaf0 2023-12-19T16:18:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c071d80 con 0x7f507c15aaf0 2023-12-19T16:18:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c15b220 con 0x7f507c15aaf0 2023-12-19T16:18:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c15b060 con 0x7f507c15aaf0 2023-12-19T16:18:32.205 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f507400abf0 con 0x7f507c15aaf0 2023-12-19T16:18:32.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 0x7f505c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5074082c00 con 0x7f507c15aaf0 2023-12-19T16:18:32.206 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.201+0000 7f507a59c640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 0x7f505c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.207 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.205+0000 7f507a59c640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 0x7f505c067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f506c0010f0 tx=0x7f506c007bf0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.210 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.205+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5074050900 con 0x7f507c15aaf0 2023-12-19T16:18:32.360 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.357+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f507c15b410 con 0x7f507c15aaf0 2023-12-19T16:18:32.365 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f5072ffd640 1 -- 172.21.15.73:0/2231473581 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5074053f20 con 0x7f507c15aaf0 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 msgr2=0x7f505c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 0x7f505c067f20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f506c0010f0 tx=0x7f506c007bf0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 msgr2=0x7f507c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f507400c7a0 tx=0x7f507400cc60 comp rx=0 tx=0).stop 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 shutdown_connections 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f505c065a60 0x7f505c067f20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.367 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c15aaf0 0x7f507c1517c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f507c0ccd20 0x7f507c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 --2- 172.21.15.73:0/2231473581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f507c0cb390 0x7f507c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 >> 172.21.15.73:0/2231473581 conn(0x7f507c06a120 msgr2=0x7f507c159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:32.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.361+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 shutdown_connections 2023-12-19T16:18:32.368 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.365+0000 7f507b59e640 1 -- 172.21.15.73:0/2231473581 wait complete. 2023-12-19T16:18:32.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2023-12-19T16:18:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 Processor -- start 2023-12-19T16:18:32.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 -- start start 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33ac0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f33ac0b1690 0x7f33ac0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0c9940 con 0x7f33ac15dfc0 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac06d720 con 0x7f33ac0b1690 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b2fdb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15e3a0 con 0x7f33ac0c8fa0 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b0d77640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f33ac15dfc0 0x7f33ac0cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53818/0 (socket says 172.21.15.73:53818) 2023-12-19T16:18:32.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b0d77640 1 -- 172.21.15.73:0/1816397786 learned_addr learned my addr 172.21.15.73:0/1816397786 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a3fff640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33ac0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33b1578640 1 --2- 172.21.15.73:0/1816397786 >> v2:172.21.15.162:3300/0 conn(0x7f33ac0b1690 0x7f33ac0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440282187 0 0) 0x7f33ac0c9940 con 0x7f33ac15dfc0 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3394003530 con 0x7f33ac15dfc0 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729637247 0 0) 0x7f3394003530 con 0x7f33ac15dfc0 2023-12-19T16:18:32.528 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 msgr2=0x7f33ac0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33ac0c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 >> v2:172.21.15.162:3300/0 conn(0x7f33ac0b1690 msgr2=0x7f33ac0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 --2- 172.21.15.73:0/1816397786 >> v2:172.21.15.162:3300/0 conn(0x7f33ac0b1690 0x7f33ac0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac06c3a0 con 0x7f33ac15dfc0 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f33a8001680 con 0x7f33ac15dfc0 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 >> v1:172.21.15.73:6789/0 conn(0x7f33ac15dfc0 legacy=0x7f33ac0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f3394003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3394004d10 0x7f3394005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac06d720 con 0x7f3394003980 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac15e3a0 con 0x7f3394004d10 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.521+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339400b990 con 0x7f33ac0c8fa0 2023-12-19T16:18:32.529 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f3394003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33a3fff640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b1578640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3394004d10 0x7f3394005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 -- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 msgr2=0x7f33940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac0c8fa0 0x7f33940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 -- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3394004d10 msgr2=0x7f3394005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3394004d10 0x7f3394005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 -- 172.21.15.73:0/1816397786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394003530 con 0x7f3394003980 2023-12-19T16:18:32.530 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b1578640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3394004d10 0x7f3394005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33b0d77640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f3394003da0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c240 tx=0x7f33a801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd52f674ae52081 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80058e0 con 0x7f3394003980 2023-12-19T16:18:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8005a40 con 0x7f3394003980 2023-12-19T16:18:32.531 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.525+0000 7f33a37fe640 1 -- 172.21.15.73:0/1816397786 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8005e10 con 0x7f3394003980 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- 172.21.15.73:0/1816397786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 msgr2=0x7f3394003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/1816397786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f3394003da0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c240 tx=0x7f33a801cc30 comp rx=0 tx=0).stop 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b1578640 1 -- 172.21.15.73:0/1816397786 reap_dead start 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- 172.21.15.73:0/1816397786 shutdown_connections 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- 172.21.15.73:0/1816397786 >> 172.21.15.73:0/1816397786 conn(0x7f33ac0b0270 msgr2=0x7f33ac0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- 172.21.15.73:0/1816397786 shutdown_connections 2023-12-19T16:18:32.532 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- 172.21.15.73:0/1816397786 wait complete. 2023-12-19T16:18:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 Processor -- start 2023-12-19T16:18:32.533 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- start start 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33ac14f240 0x7f33ac157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac145260 0x7f33ac1456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c5d00 con 0x7f3394003980 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c7f20 con 0x7f33ac14f240 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b2fdb640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0ce320 con 0x7f33ac145260 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.536 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50138/0 (socket says 172.21.15.73:50138) 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 -- 172.21.15.73:0/2272164518 learned_addr learned my addr 172.21.15.73:0/2272164518 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33a3fff640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33ac14f240 0x7f33ac157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b1578640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac145260 0x7f33ac1456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 -- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac145260 msgr2=0x7f33ac1456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac145260 0x7f33ac1456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 -- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33ac14f240 msgr2=0x7f33ac157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.529+0000 7f33b0d77640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33ac14f240 0x7f33ac157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33b0d77640 1 -- 172.21.15.73:0/2272164518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0c8180 con 0x7f3394003980 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33b0d77640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c240 tx=0x7f3394005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8005e30 con 0x7f3394003980 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a80a5820 con 0x7f3394003980 2023-12-19T16:18:32.537 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac0c8460 con 0x7f3394003980 2023-12-19T16:18:32.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80a5b90 con 0x7f3394003980 2023-12-19T16:18:32.538 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac157bd0 con 0x7f3394003980 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac157dc0 con 0x7f3394003980 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33a80a5cf0 con 0x7f3394003980 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 0x7f3398067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f33a811b880 con 0x7f3394003980 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.533+0000 7f33a3fff640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 0x7f3398067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:32.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.537+0000 7f33a3fff640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 0x7f3398067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33ac1462d0 tx=0x7f339c009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:32.542 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.537+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f33ac157dc0 con 0x7f3394003980 2023-12-19T16:18:32.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.745+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7f33ac0c57f0 con 0x7f3394003980 2023-12-19T16:18:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.901+0000 7f33a17fa640 1 -- 172.21.15.73:0/2272164518 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v167) v1 ==== 143+0+0 (secure 0 0 0) 0x7f33ac0c57f0 con 0x7f3394003980 2023-12-19T16:18:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 msgr2=0x7f3398067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 0x7f3398067f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f33ac1462d0 tx=0x7f339c009190 comp rx=0 tx=0).stop 2023-12-19T16:18:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 msgr2=0x7f33ac0acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c240 tx=0x7f3394005800 comp rx=0 tx=0).stop 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 shutdown_connections 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33ac145260 0x7f33ac1456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33ac14f240 0x7f33ac157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f3398065a60 0x7f3398067f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 --2- 172.21.15.73:0/2272164518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3394003980 0x7f33ac0acfa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:32.909 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 >> 172.21.15.73:0/2272164518 conn(0x7f33ac0b0270 msgr2=0x7f33ac0b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:32.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 shutdown_connections 2023-12-19T16:18:32.910 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:32.905+0000 7f33b2fdb640 1 -- 172.21.15.73:0/2272164518 wait complete. 2023-12-19T16:18:32.930 INFO:tasks.cephfs_test_runner:Opening a file should increment omap_total_updates by 1. ... ok 2023-12-19T16:18:32.931 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:32.931 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T16:18:32.931 INFO:tasks.cephfs_test_runner:Ran 2 tests in 145.851s 2023-12-19T16:18:32.931 INFO:tasks.cephfs_test_runner: 2023-12-19T16:18:32.931 INFO:tasks.cephfs_test_runner:OK 2023-12-19T16:18:32.931 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T16:18:32.941 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T16:18:32.955 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T16:18:32.955 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:18:32.955 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:32.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:32.965 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T16:18:32.965 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:33.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2903 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T16:18:33.015 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:18:33.015 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:33.025 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:33.025 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2023-12-19T16:18:33.025 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T16:18:33.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354680k,nr_inodes=4088670,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3292 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,nr_inodes=818846,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T16:18:33.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.080 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:18:33.089 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T16:18:33.089 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T16:18:33.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T16:18:33.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T16:18:33.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T16:18:33.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.446 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T16:18:33.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.455 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T16:18:33.526 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-12-19T16:18:33.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:33.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.528 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:18:33.538 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T16:18:33.538 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T16:18:33.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.539 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T16:18:33.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T16:18:33.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-12-19T16:18:33.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.926 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2023-12-19T16:18:33.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T16:18:33.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2023-12-19T16:18:34.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:18:34.006 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2023-12-19T16:18:34.006 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T16:18:34.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T16:18:34.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:34.156 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 Processor -- start 2023-12-19T16:18:34.157 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 -- start start 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40b8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40b7250 con 0x7f34e415cff0 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40b7530 con 0x7f34e40b4bd0 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ec28c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40b7810 con 0x7f34e40b47f0 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea829640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f34e415cff0 0x7f34e40b5c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53820/0 (socket says 172.21.15.73:53820) 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea829640 1 -- 172.21.15.73:0/1124284733 learned_addr learned my addr 172.21.15.73:0/1124284733 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:34.158 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea028640 1 --2- 172.21.15.73:0/1124284733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011774078 0 0) 0x7f34e40b7250 con 0x7f34e415cff0 2023-12-19T16:18:34.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d0003530 con 0x7f34e415cff0 2023-12-19T16:18:34.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367512977 0 0) 0x7f34e40b7530 con 0x7f34e40b4bd0 2023-12-19T16:18:34.159 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e40b7250 con 0x7f34e40b4bd0 2023-12-19T16:18:34.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea028640 1 -- 172.21.15.73:0/1124284733 >> v1:172.21.15.162:6789/0 conn(0x7f34e40b4bd0 legacy=0x7f34e415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea028640 1 -- 172.21.15.73:0/1124284733 >> v1:172.21.15.73:6789/0 conn(0x7f34e415cff0 legacy=0x7f34e40b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.160 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.153+0000 7f34ea028640 1 -- 172.21.15.73:0/1124284733 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40b7af0 con 0x7f34e40b47f0 2023-12-19T16:18:34.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34ea028640 1 --2- 172.21.15.73:0/1124284733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40b8430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34e00097f0 tx=0x7f34e001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f78ec4fd9ecd93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.162 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00ab620 con 0x7f34e40b47f0 2023-12-19T16:18:34.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e00ab780 con 0x7f34e40b47f0 2023-12-19T16:18:34.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34e9026640 1 -- 172.21.15.73:0/1124284733 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00abb10 con 0x7f34e40b47f0 2023-12-19T16:18:34.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34ec28c640 1 -- 172.21.15.73:0/1124284733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 msgr2=0x7f34e40b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.163 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.157+0000 7f34ec28c640 1 --2- 172.21.15.73:0/1124284733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40b8430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34e00097f0 tx=0x7f34e001c400 comp rx=0 tx=0).stop 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- 172.21.15.73:0/1124284733 shutdown_connections 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 --2- 172.21.15.73:0/1124284733 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40b8430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- 172.21.15.73:0/1124284733 >> 172.21.15.73:0/1124284733 conn(0x7f34e4065ce0 msgr2=0x7f34e40660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- 172.21.15.73:0/1124284733 shutdown_connections 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- 172.21.15.73:0/1124284733 wait complete. 2023-12-19T16:18:34.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 Processor -- start 2023-12-19T16:18:34.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- start start 2023-12-19T16:18:34.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e415cff0 0x7f34e40cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415aba0 con 0x7f34e40b4bd0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4153de0 con 0x7f34e415cff0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ec28c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e415adf0 con 0x7f34e40b47f0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50154/0 (socket says 172.21.15.73:50154) 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 -- 172.21.15.73:0/3019815690 learned_addr learned my addr 172.21.15.73:0/3019815690 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ea028640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34ea829640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e415cff0 0x7f34e40cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 -- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 msgr2=0x7f34e40c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 -- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e415cff0 msgr2=0x7f34e40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e415cff0 0x7f34e40cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.168 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 -- 172.21.15.73:0/3019815690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009420 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.161+0000 7f34e9827640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c460 tx=0x7f34d400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d40052d0 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4005450 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4012870 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e415b0d0 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e4154310 con 0x7f34e40b4bd0 2023-12-19T16:18:34.169 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4074050 con 0x7f34e40b4bd0 2023-12-19T16:18:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34d40129d0 con 0x7f34e40b4bd0 2023-12-19T16:18:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 0x7f34c8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f34d4082a00 con 0x7f34e40b4bd0 2023-12-19T16:18:34.170 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.165+0000 7f34ea028640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 0x7f34c8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.171 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.169+0000 7f34ea028640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 0x7f34c8067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.174 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.169+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34d40505c0 con 0x7f34e40b4bd0 2023-12-19T16:18:34.319 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.313+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34e40cfd90 con 0x7f34c8065a60 2023-12-19T16:18:34.321 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.317+0000 7f34daffd640 1 -- 172.21.15.73:0/3019815690 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50855 (secure 0 0 0) 0x7f34e40cfd90 con 0x7f34c8065a60 2023-12-19T16:18:34.322 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 msgr2=0x7f34c8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 0x7f34c8067f20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34e00af000 tx=0x7f34e00a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 msgr2=0x7f34e4154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f34d400c460 tx=0x7f34d400c920 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 shutdown_connections 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e415cff0 0x7f34e40cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f34c8065a60 0x7f34c8067f20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34e40b4bd0 0x7f34e4154830 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 --2- 172.21.15.73:0/3019815690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34e40b47f0 0x7f34e40c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 >> 172.21.15.73:0/3019815690 conn(0x7f34e4065ce0 msgr2=0x7f34e41522a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.324 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 shutdown_connections 2023-12-19T16:18:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.321+0000 7f34ec28c640 1 -- 172.21.15.73:0/3019815690 wait complete. 2023-12-19T16:18:34.342 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-19T16:18:32.484963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":226316,"kb_used_data":6604,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754748404,"statfs":{"total":773094113280,"available":772862365696,"internally_reserved":0,"allocated":6762496,"data_stored":3516819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9369,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-75,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-7,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001113"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":190,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-12-19T16:18:22.369735+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:18:22.369735+0000","last_peered":"2023-12-19T16:18:22.369735+0000","last_clean":"2023-12-19T16:18:22.369735+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:18:22.369735+0000","last_undegraded":"2023-12-19T16:18:22.369735+0000","last_fullsized":"2023-12-19T16:18:22.369735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476776,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":676,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":692224,"data_stored":292409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.42899999999999999,"15min":0.439},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.52100000000000002,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67000000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.316}]},{"osd":1,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46100000000000002,"15min":0.45600000000000002},"min":{"1min":0.34399999999999997,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.51000000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.34799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.62,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.54000000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.626,"5min":0.996,"15min":0.996},"last":0.54300000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.746,"15min":0.748},"min":{"1min":0.56000000000000005,"5min":0.435,"15min":0.435},"max":{"1min":0.95899999999999996,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.76200000000000001,"15min":0.77300000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.98699999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58899999999999997,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97499999999999998,"5min":1.542,"15min":1.542},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.95499999999999996,"5min":1.272,"15min":1.272},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.071,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.90000000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.56000000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.91100000000000003,"5min":1.581,"15min":1.581},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.83299999999999996,"15min":0.84299999999999997},"min":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.97099999999999997,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.82299999999999995}]}]},{"osd":2,"up_from":16,"seq":68719476776,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":679936,"data_stored":283935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.50900000000000001,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67500000000000004,"5min":2.395,"15min":2.395},"last":0.504}]},{"osd":1,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.443},{"interface":"front","average":{"1min":0.437,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.34899999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66200000000000003,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76200000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":3.407,"15min":3.407},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.92200000000000004,"15min":0.95499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.92400000000000004,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0940000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.044,"5min":1.758,"15min":1.758},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.89100000000000001,"15min":0.91200000000000003},"min":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.835,"15min":1.835},"last":0.77500000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476776,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1273856,"data_stored":874283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.625,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.83199999999999996,"15min":0.89100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":4.593,"15min":4.593},"last":0.42099999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73499999999999999,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.72399999999999998,"15min":0.75900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.45700000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.88600000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91300000000000003,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97999999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.71299999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.94799999999999995,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92100000000000004,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.093,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88100000000000001,"15min":0.90200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94099999999999995,"5min":3.052,"15min":3.052},"last":0.64600000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.93799999999999994,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94899999999999995,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96299999999999997,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.66200000000000003}]}]},{"osd":0,"up_from":16,"seq":68719476775,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":688128,"data_stored":284524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.437,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60399999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77100000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.32700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.41399999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.70599999999999996,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.50900000000000001,"15min":0.51400000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68899999999999995,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.36199999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.34899999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.63200000000000001,"5min":1.026,"15min":1.026},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.65900000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69199999999999995,"15min":0.68799999999999994},"min":{"1min":0.48799999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0329999999999999,"5min":1.232,"15min":1.232},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71599999999999997,"15min":0.71099999999999997},"min":{"1min":0.54600000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94199999999999995,"5min":1.252,"15min":1.252},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75,"15min":0.74199999999999999},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0669999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.71799999999999997,"15min":0.71199999999999997},"min":{"1min":0.52600000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0509999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.96699999999999997,"5min":1.006,"15min":1.006},"last":0.61499999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71699999999999997,"15min":0.71399999999999997},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.77100000000000002,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.995,"5min":1.198,"15min":1.198},"last":0.54600000000000004}]}]},{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86699999999999999,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.117,"5min":4.008,"15min":4.008},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.871},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0529999999999999,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.87,"5min":0.997,"15min":0.997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.77800000000000002,"15min":0.79200000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81000000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93700000000000006,"5min":1.151,"15min":1.151},"last":0.71699999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80900000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.748},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":1.056},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90900000000000003,"5min":0.998,"15min":0.998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93700000000000006,"5min":1.091,"15min":1.091},"last":0.93700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70899999999999996,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89600000000000002,"5min":1.075,"15min":1.075},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":886759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.83299999999999996,"15min":0.86299999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.438,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98599999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96999999999999997,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.1459999999999999,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0449999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.748}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.82799999999999996,"15min":0.89000000000000001},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98599999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.871,"15min":0.92900000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.875,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.702,"15min":1.702},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86899999999999999,"15min":0.93700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94099999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.92700000000000005,"15min":0.996},"min":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.95399999999999996,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.92800000000000005},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.96699999999999997,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84199999999999997,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.93400000000000005,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95299999999999996,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:34.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:34.481 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 Processor -- start 2023-12-19T16:18:34.482 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 -- start start 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 0x7f80500cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80500b26a0 0x7f80500c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80500c9940 con 0x7f80500c8fa0 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805006d720 con 0x7f80500b26a0 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f8055441640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f805015e3a0 con 0x7f805015dfc0 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f804f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80500b26a0 0x7f80500c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f804e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f80500c8fa0 0x7f8050070130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53836/0 (socket says 172.21.15.73:53836) 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.477+0000 7f804e7fc640 1 -- 172.21.15.73:0/2723577721 learned_addr learned my addr 172.21.15.73:0/2723577721 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:34.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804effd640 1 --2- 172.21.15.73:0/2723577721 >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 0x7f80500cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804f7fe640 1 -- 172.21.15.73:0/2723577721 >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 msgr2=0x7f80500cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804f7fe640 1 --2- 172.21.15.73:0/2723577721 >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 0x7f80500cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804f7fe640 1 -- 172.21.15.73:0/2723577721 >> v1:172.21.15.73:6789/0 conn(0x7f80500c8fa0 legacy=0x7f8050070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804f7fe640 1 -- 172.21.15.73:0/2723577721 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805006c3a0 con 0x7f80500b26a0 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804dffb640 1 -- 172.21.15.73:0/2723577721 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775187342 0 0) 0x7f80500c9940 con 0x7f80500c8fa0 2023-12-19T16:18:34.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804effd640 1 --2- 172.21.15.73:0/2723577721 >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 0x7f80500cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:34.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804f7fe640 1 --2- 172.21.15.73:0/2723577721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500b26a0 0x7f80500c9400 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f80500ce580 tx=0x7f804801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8223f25c0397d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804dffb640 1 -- 172.21.15.73:0/2723577721 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80480a58c0 con 0x7f80500b26a0 2023-12-19T16:18:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804dffb640 1 -- 172.21.15.73:0/2723577721 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80480a5a20 con 0x7f80500b26a0 2023-12-19T16:18:34.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.481+0000 7f804dffb640 1 -- 172.21.15.73:0/2723577721 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80480a5db0 con 0x7f80500b26a0 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- 172.21.15.73:0/2723577721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500b26a0 msgr2=0x7f80500c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- 172.21.15.73:0/2723577721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500b26a0 0x7f80500c9400 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f80500ce580 tx=0x7f804801c8e0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- 172.21.15.73:0/2723577721 shutdown_connections 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- 172.21.15.73:0/2723577721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500b26a0 0x7f80500c9400 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- 172.21.15.73:0/2723577721 >> v2:172.21.15.162:3300/0 conn(0x7f805015dfc0 0x7f80500cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- 172.21.15.73:0/2723577721 >> 172.21.15.73:0/2723577721 conn(0x7f80500b0270 msgr2=0x7f80500b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- 172.21.15.73:0/2723577721 shutdown_connections 2023-12-19T16:18:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- 172.21.15.73:0/2723577721 wait complete. 2023-12-19T16:18:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 Processor -- start 2023-12-19T16:18:34.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- start start 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80500b26a0 0x7f805014f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f805015dfc0 0x7f80500b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80500ae4d0 con 0x7f80500c8fa0 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80500ae770 con 0x7f80500b26a0 2023-12-19T16:18:34.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f8055441640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8050156210 con 0x7f805015dfc0 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f804e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f804e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50172/0 (socket says 172.21.15.73:50172) 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f804e7fc640 1 -- 172.21.15.73:0/2432247175 learned_addr learned my addr 172.21.15.73:0/2432247175 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f804f7fe640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f805015dfc0 0x7f80500b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.485+0000 7f804effd640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80500b26a0 0x7f805014f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 -- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f805015dfc0 msgr2=0x7f80500b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f805015dfc0 0x7f80500b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 -- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80500b26a0 msgr2=0x7f805014f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80500b26a0 0x7f805014f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 -- 172.21.15.73:0/2432247175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048009a70 con 0x7f80500c8fa0 2023-12-19T16:18:34.492 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804e7fc640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f804400c550 tx=0x7f804400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044005cf0 con 0x7f80500c8fa0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8044005e70 con 0x7f80500c8fa0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044007310 con 0x7f80500c8fa0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80501564f0 con 0x7f80500c8fa0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805014fd60 con 0x7f80500c8fa0 2023-12-19T16:18:34.493 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80500ae920 con 0x7f80500c8fa0 2023-12-19T16:18:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8044007470 con 0x7f80500c8fa0 2023-12-19T16:18:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 0x7f803c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8044082570 con 0x7f80500c8fa0 2023-12-19T16:18:34.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.489+0000 7f804effd640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 0x7f803c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.493+0000 7f804effd640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 0x7f803c067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f804000b930 tx=0x7f8040008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.493+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80500ae920 con 0x7f80500c8fa0 2023-12-19T16:18:34.645 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.641+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8050156a10 con 0x7f803c065a60 2023-12-19T16:18:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.641+0000 7f80377fe640 1 -- 172.21.15.73:0/2432247175 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50902 (secure 0 0 0) 0x7f8050156a10 con 0x7f803c065a60 2023-12-19T16:18:34.647 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:34.648 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:18:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 msgr2=0x7f803c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.649 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 0x7f803c067f20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f804000b930 tx=0x7f8040008040 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 msgr2=0x7f80500b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f804400c550 tx=0x7f804400ca10 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 shutdown_connections 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f805015dfc0 0x7f80500b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f803c065a60 0x7f803c067f20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80500c8fa0 0x7f80500b1360 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 --2- 172.21.15.73:0/2432247175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80500b26a0 0x7f805014f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 >> 172.21.15.73:0/2432247175 conn(0x7f80500b0270 msgr2=0x7f80500cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 shutdown_connections 2023-12-19T16:18:34.650 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.645+0000 7f8055441640 1 -- 172.21.15.73:0/2432247175 wait complete. 2023-12-19T16:18:34.668 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-19T16:18:34.485202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":226444,"kb_used_data":6732,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754748276,"statfs":{"total":773094113280,"available":772862234624,"internally_reserved":0,"allocated":6893568,"data_stored":3574815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9369,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-75,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-7,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000983"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-19T16:18:30.924707+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:18:30.924707+0000","last_peered":"2023-12-19T16:18:30.924707+0000","last_clean":"2023-12-19T16:18:30.924707+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:18:30.924707+0000","last_undegraded":"2023-12-19T16:18:30.924707+0000","last_fullsized":"2023-12-19T16:18:30.924707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58599999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.372},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.997,"15min":0.997},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88300000000000001,"5min":1.542,"15min":1.542},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.272,"15min":1.272},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89300000000000002,"5min":1.581,"15min":1.581},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0780000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.61499999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476777,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.50900000000000001,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67500000000000004,"5min":2.395,"15min":2.395},"last":0.374}]},{"osd":1,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66200000000000003,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76200000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":3.407,"15min":3.407},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.92200000000000004,"15min":0.95499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.92400000000000004,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0940000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.044,"5min":1.758,"15min":1.758},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.89100000000000001,"15min":0.91200000000000003},"min":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.835,"15min":1.835},"last":0.83199999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476777,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.625,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.83199999999999996,"15min":0.89100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":4.593,"15min":4.593},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73499999999999999,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.72399999999999998,"15min":0.75900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.88600000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91300000000000003,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97999999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.82099999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.94799999999999995,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92100000000000004,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.093,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88100000000000001,"15min":0.90200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94099999999999995,"5min":3.052,"15min":3.052},"last":0.84599999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.93799999999999994,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94899999999999995,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96299999999999997,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.747}]}]},{"osd":0,"up_from":16,"seq":68719476776,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":708608,"data_stored":296398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72799999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":1.026,"15min":1.026},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.60899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.232,"15min":1.232},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.252,"15min":1.252},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.52100000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.083,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.61499999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.03,"5min":1.198,"15min":1.198},"last":0.71099999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86699999999999999,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.117,"5min":4.008,"15min":4.008},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.871},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0529999999999999,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.87,"5min":0.997,"15min":0.997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.77800000000000002,"15min":0.79200000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81000000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93700000000000006,"5min":1.151,"15min":1.151},"last":0.71699999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80900000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.748},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":1.056},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90900000000000003,"5min":0.998,"15min":0.998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93700000000000006,"5min":1.091,"15min":1.091},"last":0.93700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70899999999999996,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89600000000000002,"5min":1.075,"15min":1.075},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":886759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.83299999999999996,"15min":0.86299999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.438,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98599999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96999999999999997,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.1459999999999999,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0449999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.748}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.82799999999999996,"15min":0.89000000000000001},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98599999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.871,"15min":0.92900000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.875,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.702,"15min":1.702},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86899999999999999,"15min":0.93700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94099999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.92700000000000005,"15min":0.996},"min":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.95399999999999996,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.92800000000000005},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.96699999999999997,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84199999999999997,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.93400000000000005,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95299999999999996,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:34.669 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T16:18:34.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:34.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.801+0000 7fa48dd6d640 1 Processor -- start 2023-12-19T16:18:34.807 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 -- start start 2023-12-19T16:18:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa48815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4880cdc40 0x7fa4880ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.809 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48815ad00 con 0x7fa4880b40b0 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48815e110 con 0x7fa4880cdc40 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa48dd6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880ce2d0 con 0x7fa488159830 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4880cdc40 0x7fa4880ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4880cdc40 0x7fa4880ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42766/0 (socket says 172.21.15.73:42766) 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 -- 172.21.15.73:0/2817762276 learned_addr learned my addr 172.21.15.73:0/2817762276 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa4877fe640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa48815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 -- 172.21.15.73:0/2817762276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 msgr2=0x7fa48815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa48815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 -- 172.21.15.73:0/2817762276 >> v1:172.21.15.162:6789/0 conn(0x7fa4880b40b0 legacy=0x7fa4880cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa487fff640 1 -- 172.21.15.73:0/2817762276 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48815d490 con 0x7fa4880cdc40 2023-12-19T16:18:34.810 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.805+0000 7fa4867fc640 1 -- 172.21.15.73:0/2817762276 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876561055 0 0) 0x7fa48815ad00 con 0x7fa4880b40b0 2023-12-19T16:18:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa487fff640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880ca080 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d150 tx=0x7fa48001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ac199772d8a9b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa4867fc640 1 -- 172.21.15.73:0/2817762276 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000b2d0 con 0x7fa4880cdc40 2023-12-19T16:18:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa4867fc640 1 -- 172.21.15.73:0/2817762276 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000b430 con 0x7fa4880cdc40 2023-12-19T16:18:34.812 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa4867fc640 1 -- 172.21.15.73:0/2817762276 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a7c40 con 0x7fa4880cdc40 2023-12-19T16:18:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- 172.21.15.73:0/2817762276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 msgr2=0x7fa4880ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880ca080 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d150 tx=0x7fa48001eb50 comp rx=0 tx=0).stop 2023-12-19T16:18:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- 172.21.15.73:0/2817762276 shutdown_connections 2023-12-19T16:18:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880ca080 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/2817762276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa48815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- 172.21.15.73:0/2817762276 >> 172.21.15.73:0/2817762276 conn(0x7fa4880b0270 msgr2=0x7fa4880b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- 172.21.15.73:0/2817762276 shutdown_connections 2023-12-19T16:18:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- 172.21.15.73:0/2817762276 wait complete. 2023-12-19T16:18:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 Processor -- start 2023-12-19T16:18:34.814 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.809+0000 7fa48dd6d640 1 -- start start 2023-12-19T16:18:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4880b40b0 0x7fa4881537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.816 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa4880b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b3020 con 0x7fa4880cdc40 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b2210 con 0x7fa4880b40b0 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488156420 con 0x7fa488159830 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42780/0 (socket says 172.21.15.73:42780) 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 -- 172.21.15.73:0/1820025966 learned_addr learned my addr 172.21.15.73:0/1820025966 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa4877fe640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4880b40b0 0x7fa4881537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.817 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa487fff640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa4880b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 -- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 msgr2=0x7fa4880b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa4880b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 -- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4880b40b0 msgr2=0x7fa4881537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4880b40b0 0x7fa4881537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.818 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 -- 172.21.15.73:0/1820025966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48000bd40 con 0x7fa4880cdc40 2023-12-19T16:18:34.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa486ffd640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c4d0 tx=0x7fa47c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.819 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c005480 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c003600 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4880b3250 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0039b0 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880b3810 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa488074050 con 0x7fa4880cdc40 2023-12-19T16:18:34.820 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.813+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa47c003b10 con 0x7fa4880cdc40 2023-12-19T16:18:34.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.817+0000 7fa46ffff640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 0x7fa474067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:34.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.817+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa47c082570 con 0x7fa4880cdc40 2023-12-19T16:18:34.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.817+0000 7fa4877fe640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 0x7fa474067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:34.821 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.817+0000 7fa4877fe640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 0x7fa474067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa478009a50 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:34.824 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.821+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa47c0501f0 con 0x7fa4880cdc40 2023-12-19T16:18:34.974 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.969+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa488159c10 con 0x7fa474065a60 2023-12-19T16:18:34.976 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa46ffff640 1 -- 172.21.15.73:0/1820025966 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50902 (secure 0 0 0) 0x7fa4780119a0 con 0x7fa474065a60 2023-12-19T16:18:34.977 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:34.977 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:18:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 msgr2=0x7fa474067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 0x7fa474067f20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa478009a50 tx=0x7fa478008040 comp rx=0 tx=0).stop 2023-12-19T16:18:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 msgr2=0x7fa4880b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00c4d0 tx=0x7fa47c00c990 comp rx=0 tx=0).stop 2023-12-19T16:18:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 shutdown_connections 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa488159830 0x7fa4880b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa474065a60 0x7fa474067f20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4880cdc40 0x7fa4880b2ae0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 --2- 172.21.15.73:0/1820025966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4880b40b0 0x7fa4881537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 >> 172.21.15.73:0/1820025966 conn(0x7fa4880b0270 msgr2=0x7fa488163610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 shutdown_connections 2023-12-19T16:18:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:34.973+0000 7fa48dd6d640 1 -- 172.21.15.73:0/1820025966 wait complete. 2023-12-19T16:18:34.997 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2023-12-19T16:18:34.485202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":226444,"kb_used_data":6732,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754748276,"statfs":{"total":773094113280,"available":772862234624,"internally_reserved":0,"allocated":6893568,"data_stored":3574815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9369,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-75,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-7,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000983"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":193,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-12-19T16:18:30.924707+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:18:30.924707+0000","last_peered":"2023-12-19T16:18:30.924707+0000","last_clean":"2023-12-19T16:18:30.924707+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:18:30.924707+0000","last_undegraded":"2023-12-19T16:18:30.924707+0000","last_fullsized":"2023-12-19T16:18:30.924707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:34.038771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58599999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.372},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.997,"15min":0.997},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88300000000000001,"5min":1.542,"15min":1.542},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.272,"15min":1.272},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89300000000000002,"5min":1.581,"15min":1.581},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0780000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.61499999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476777,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.439,"15min":0.441},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.50900000000000001,"15min":0.51900000000000002},"min":{"1min":0.29299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.67500000000000004,"5min":2.395,"15min":2.395},"last":0.374}]},{"osd":1,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.33700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72399999999999998,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68500000000000005,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.33900000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.66200000000000003,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54100000000000004,"15min":0.54200000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76200000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.42799999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.86099999999999999,"15min":0.88300000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":3.407,"15min":3.407},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.92200000000000004,"15min":0.95499999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.92400000000000004,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.83299999999999996,"15min":0.84799999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0940000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.92100000000000004,"15min":0.94899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0649999999999999,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.58399999999999996}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.82099999999999995,"15min":0.83099999999999996},"min":{"1min":0.56499999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.044,"5min":1.758,"15min":1.758},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.89600000000000002,"15min":0.91800000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.002,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.89100000000000001,"15min":0.91200000000000003},"min":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.022,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.623},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97299999999999998,"5min":1.835,"15min":1.835},"last":0.83199999999999996}]}]},{"osd":1,"up_from":16,"seq":68719476777,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.625,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.83199999999999996,"15min":0.89100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":4.593,"15min":4.593},"last":0.44600000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73499999999999999,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.72399999999999998,"15min":0.75900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.88600000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91300000000000003,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97999999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.82099999999999995}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.94799999999999995,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92100000000000004,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.093,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88100000000000001,"15min":0.90200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94099999999999995,"5min":3.052,"15min":3.052},"last":0.84599999999999997}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.93799999999999994,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94899999999999995,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96299999999999997,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.747}]}]},{"osd":0,"up_from":16,"seq":68719476776,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27644,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":708608,"data_stored":296398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72799999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":1.026,"15min":1.026},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.60899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.232,"15min":1.232},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.252,"15min":1.252},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.52100000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.083,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.61499999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.03,"5min":1.198,"15min":1.198},"last":0.71099999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86699999999999999,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.117,"5min":4.008,"15min":4.008},"last":0.60099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.84899999999999998,"15min":0.871},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0529999999999999,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.87,"5min":0.997,"15min":0.997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.76000000000000001,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65600000000000003}]},{"osd":3,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69999999999999996,"15min":0.69499999999999995},"min":{"1min":0.46899999999999997,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.74299999999999999,"15min":0.73899999999999999},"min":{"1min":0.57999999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0649999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.47399999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.71999999999999997,"15min":0.73599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86499999999999999,"5min":1.048,"15min":1.048},"last":0.63200000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.42799999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0049999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.77800000000000002,"15min":0.79200000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.81000000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93700000000000006,"5min":1.151,"15min":1.151},"last":0.71699999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.79600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.66100000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.80900000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.70699999999999996,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.748},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70099999999999996,"15min":0.69899999999999995},"min":{"1min":0.5,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":1.056},"last":0.82599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.61399999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90900000000000003,"5min":0.998,"15min":0.998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93700000000000006,"5min":1.091,"15min":1.091},"last":0.93700000000000006}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70899999999999996,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89600000000000002,"5min":1.075,"15min":1.075},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.84099999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1298432,"data_stored":886759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72599999999999998,"15min":0.73799999999999999},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.83299999999999996,"15min":0.86299999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.98599999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.438,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.002,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.98599999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.94799999999999995}]},{"osd":2,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96999999999999997,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.79700000000000004,"15min":0.81599999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95299999999999996,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:17:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77300000000000002,"15min":0.78300000000000003},"min":{"1min":0.52700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.1459999999999999,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.57099999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0449999999999999,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.624}]},{"osd":6,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72199999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.748}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":704512,"data_stored":296391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.82799999999999996,"15min":0.89000000000000001},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98599999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.871,"15min":0.92900000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.875,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.702,"15min":1.702},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86899999999999999,"15min":0.93700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.47799999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94099999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.92700000000000005,"15min":0.996},"min":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.95399999999999996,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.92800000000000005},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.96699999999999997,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84199999999999997,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.93400000000000005,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95299999999999996,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:34.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T16:18:35.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.133+0000 7f7ca008c640 1 Processor -- start 2023-12-19T16:18:35.138 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.133+0000 7f7ca008c640 1 -- start start 2023-12-19T16:18:35.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7ca008c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c9815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.139 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7ca008c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c980cdc40 0x7f7c980ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7ca008c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9815ad00 con 0x7f7c980b40b0 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7ca008c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9815e110 con 0x7f7c980cdc40 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7ca008c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980ce2d0 con 0x7f7c98159830 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c980cdc40 0x7f7c980ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c980cdc40 0x7f7c980ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42796/0 (socket says 172.21.15.73:42796) 2023-12-19T16:18:35.140 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 -- 172.21.15.73:0/2999218333 learned_addr learned my addr 172.21.15.73:0/2999218333 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9de28640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c9815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 -- 172.21.15.73:0/2999218333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 msgr2=0x7f7c9815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c9815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 -- 172.21.15.73:0/2999218333 >> v1:172.21.15.162:6789/0 conn(0x7f7c980b40b0 legacy=0x7f7c980cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 -- 172.21.15.73:0/2999218333 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9815d490 con 0x7f7c980cdc40 2023-12-19T16:18:35.141 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9de28640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c9815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:35.142 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.137+0000 7f7c9e629640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c980ca080 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009e50 tx=0x7f7c9001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2c9c1fe2ca32e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9ce26640 1 -- 172.21.15.73:0/2999218333 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900a5790 con 0x7f7c980cdc40 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9ce26640 1 -- 172.21.15.73:0/2999218333 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900a58f0 con 0x7f7c980cdc40 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9ce26640 1 -- 172.21.15.73:0/2999218333 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900a5c80 con 0x7f7c980cdc40 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- 172.21.15.73:0/2999218333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 msgr2=0x7f7c980ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c980ca080 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009e50 tx=0x7f7c9001c910 comp rx=0 tx=0).stop 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- 172.21.15.73:0/2999218333 shutdown_connections 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c980ca080 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- 172.21.15.73:0/2999218333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c9815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- 172.21.15.73:0/2999218333 >> 172.21.15.73:0/2999218333 conn(0x7f7c980b0270 msgr2=0x7f7c980b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:35.144 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- 172.21.15.73:0/2999218333 shutdown_connections 2023-12-19T16:18:35.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- 172.21.15.73:0/2999218333 wait complete. 2023-12-19T16:18:35.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 Processor -- start 2023-12-19T16:18:35.145 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- start start 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c980b40b0 0x7f7c9814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c980c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98152a50 con 0x7f7c980cdc40 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98150610 con 0x7f7c980b40b0 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7ca008c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98150370 con 0x7f7c98159830 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9d627640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9d627640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42800/0 (socket says 172.21.15.73:42800) 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9d627640 1 -- 172.21.15.73:0/3442001679 learned_addr learned my addr 172.21.15.73:0/3442001679 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9de28640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c980b40b0 0x7f7c9814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.141+0000 7f7c9e629640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c980c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 -- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 msgr2=0x7f7c980c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:35.148 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c980c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 -- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c980b40b0 msgr2=0x7f7c9814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c980b40b0 0x7f7c9814e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 -- 172.21.15.73:0/3442001679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90009b30 con 0x7f7c980cdc40 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9d627640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c480 tx=0x7f7c8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88012830 con 0x7f7c980cdc40 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c880129b0 con 0x7f7c980cdc40 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88012d60 con 0x7f7c980cdc40 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c98152c90 con 0x7f7c980cdc40 2023-12-19T16:18:35.149 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c981534d0 con 0x7f7c980cdc40 2023-12-19T16:18:35.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c981536f0 con 0x7f7c980cdc40 2023-12-19T16:18:35.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c8801c460 con 0x7f7c980cdc40 2023-12-19T16:18:35.150 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 0x7f7c7c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:35.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7c88082c40 con 0x7f7c980cdc40 2023-12-19T16:18:35.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.145+0000 7f7c9de28640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 0x7f7c7c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:35.151 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.149+0000 7f7c9de28640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 0x7f7c7c067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c980af200 tx=0x7f7c94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:35.154 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.149+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c88050950 con 0x7f7c980cdc40 2023-12-19T16:18:35.307 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.301+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c98074050 con 0x7f7c980cdc40 2023-12-19T16:18:35.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7c8e7fc640 1 -- 172.21.15.73:0/3442001679 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12648 (secure 0 0 0) 0x7f7c88053f70 con 0x7f7c980cdc40 2023-12-19T16:18:35.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":61,"fsid":"90ec874a-c348-4a69-99d9-d4bef3b9261d","created":"2023-12-19T16:15:15.436835+0000","modified":"2023-12-19T16:18:31.893040+0000","last_up_change":"2023-12-19T16:15:27.913659+0000","last_in_change":"2023-12-19T16:15:18.007589+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T16:15:28.507124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5e1edd4e-229c-4b7d-8cfb-5075102516d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":38196},{"type":"v1","addr":"172.21.15.73:6825","nonce":38196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":38196},{"type":"v1","addr":"172.21.15.73:6827","nonce":38196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":38196},{"type":"v1","addr":"172.21.15.73:6831","nonce":38196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":38196},{"type":"v1","addr":"172.21.15.73:6829","nonce":38196}]},"public_addr":"172.21.15.73:6825/38196","cluster_addr":"172.21.15.73:6827/38196","heartbeat_back_addr":"172.21.15.73:6831/38196","heartbeat_front_addr":"172.21.15.73:6829/38196","state":["exists","up"]},{"osd":1,"uuid":"ac2e2657-a448-4653-a6c9-051df97c61a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":38195},{"type":"v1","addr":"172.21.15.73:6811","nonce":38195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":38195},{"type":"v1","addr":"172.21.15.73:6815","nonce":38195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":38195},{"type":"v1","addr":"172.21.15.73:6823","nonce":38195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":38195},{"type":"v1","addr":"172.21.15.73:6819","nonce":38195}]},"public_addr":"172.21.15.73:6811/38195","cluster_addr":"172.21.15.73:6815/38195","heartbeat_back_addr":"172.21.15.73:6823/38195","heartbeat_front_addr":"172.21.15.73:6819/38195","state":["exists","up"]},{"osd":2,"uuid":"db618c69-9779-4bc4-b930-8ddf3bf00197","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":38197},{"type":"v1","addr":"172.21.15.73:6801","nonce":38197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":38197},{"type":"v1","addr":"172.21.15.73:6803","nonce":38197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":38197},{"type":"v1","addr":"172.21.15.73:6807","nonce":38197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":38197},{"type":"v1","addr":"172.21.15.73:6805","nonce":38197}]},"public_addr":"172.21.15.73:6801/38197","cluster_addr":"172.21.15.73:6803/38197","heartbeat_back_addr":"172.21.15.73:6807/38197","heartbeat_front_addr":"172.21.15.73:6805/38197","state":["exists","up"]},{"osd":3,"uuid":"12ac8043-3e9b-4654-94d7-2cfb62775770","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":38198},{"type":"v1","addr":"172.21.15.73:6810","nonce":38198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":38198},{"type":"v1","addr":"172.21.15.73:6814","nonce":38198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":38198},{"type":"v1","addr":"172.21.15.73:6822","nonce":38198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":38198},{"type":"v1","addr":"172.21.15.73:6817","nonce":38198}]},"public_addr":"172.21.15.73:6810/38198","cluster_addr":"172.21.15.73:6814/38198","heartbeat_back_addr":"172.21.15.73:6822/38198","heartbeat_front_addr":"172.21.15.73:6817/38198","state":["exists","up"]},{"osd":4,"uuid":"496d81f4-3bcc-4ff7-8872-1c6fbfab5367","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":38388},{"type":"v1","addr":"172.21.15.162:6801","nonce":38388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":38388},{"type":"v1","addr":"172.21.15.162:6803","nonce":38388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":38388},{"type":"v1","addr":"172.21.15.162:6807","nonce":38388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":38388},{"type":"v1","addr":"172.21.15.162:6805","nonce":38388}]},"public_addr":"172.21.15.162:6801/38388","cluster_addr":"172.21.15.162:6803/38388","heartbeat_back_addr":"172.21.15.162:6807/38388","heartbeat_front_addr":"172.21.15.162:6805/38388","state":["exists","up"]},{"osd":5,"uuid":"35ff844f-d51a-46fc-84aa-a95e5a17c9b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":38389},{"type":"v1","addr":"172.21.15.162:6811","nonce":38389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":38389},{"type":"v1","addr":"172.21.15.162:6815","nonce":38389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6821","nonce":38389},{"type":"v1","addr":"172.21.15.162:6823","nonce":38389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6817","nonce":38389},{"type":"v1","addr":"172.21.15.162:6819","nonce":38389}]},"public_addr":"172.21.15.162:6811/38389","cluster_addr":"172.21.15.162:6815/38389","heartbeat_back_addr":"172.21.15.162:6823/38389","heartbeat_front_addr":"172.21.15.162:6819/38389","state":["exists","up"]},{"osd":6,"uuid":"04623184-554c-4798-b3a9-de2cff1e0da6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":38390},{"type":"v1","addr":"172.21.15.162:6825","nonce":38390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":38390},{"type":"v1","addr":"172.21.15.162:6827","nonce":38390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":38390},{"type":"v1","addr":"172.21.15.162:6831","nonce":38390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":38390},{"type":"v1","addr":"172.21.15.162:6829","nonce":38390}]},"public_addr":"172.21.15.162:6825/38390","cluster_addr":"172.21.15.162:6827/38390","heartbeat_back_addr":"172.21.15.162:6831/38390","heartbeat_front_addr":"172.21.15.162:6829/38390","state":["exists","up"]},{"osd":7,"uuid":"3d5c32d6-bdbb-4b1e-882f-c3894870308c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":38391},{"type":"v1","addr":"172.21.15.162:6810","nonce":38391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":38391},{"type":"v1","addr":"172.21.15.162:6814","nonce":38391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":38391},{"type":"v1","addr":"172.21.15.162:6822","nonce":38391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":38391},{"type":"v1","addr":"172.21.15.162:6818","nonce":38391}]},"public_addr":"172.21.15.162:6810/38391","cluster_addr":"172.21.15.162:6814/38391","heartbeat_back_addr":"172.21.15.162:6822/38391","heartbeat_front_addr":"172.21.15.162:6818/38391","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.717173+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.659066+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.566514+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.625000+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.395649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.607213+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.718290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T16:15:23.490954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6837/2814692317":"2023-12-20T16:18:28.880074+0000","172.21.15.73:6835/2814692317":"2023-12-20T16:18:28.880074+0000","172.21.15.73:6837/2630347924":"2023-12-20T16:17:33.785002+0000","172.21.15.73:6835/2630347924":"2023-12-20T16:17:33.785002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 msgr2=0x7f7c7c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 0x7f7c7c067f20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7c980af200 tx=0x7f7c94008040 comp rx=0 tx=0).stop 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 msgr2=0x7f7c9814fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c480 tx=0x7f7c8800c940 comp rx=0 tx=0).stop 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 shutdown_connections 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c98159830 0x7f7c980c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f7c7c065a60 0x7f7c7c067f20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c980cdc40 0x7f7c9814fe30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 --2- 172.21.15.73:0/3442001679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c980b40b0 0x7f7c9814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:35.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 >> 172.21.15.73:0/3442001679 conn(0x7f7c980b0270 msgr2=0x7f7c98070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:35.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 shutdown_connections 2023-12-19T16:18:35.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:35.305+0000 7f7ca008c640 1 -- 172.21.15.73:0/3442001679 wait complete. 2023-12-19T16:18:36.331 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T16:18:36.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:36.483 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.477+0000 7f510668c640 1 Processor -- start 2023-12-19T16:18:36.484 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 -- start start 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51001598c0 0x7f510006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f51000cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000cce80 con 0x7f510006d410 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510006cad0 con 0x7f51001598c0 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f510668c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51000cc270 con 0x7f51000b0830 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51001598c0 0x7f510006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f5104c29640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f51000cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51001598c0 0x7f510006c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:33852/0 (socket says 172.21.15.73:33852) 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 -- 172.21.15.73:0/2684882307 learned_addr learned my addr 172.21.15.73:0/2684882307 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50ff7fe640 1 --1- 172.21.15.73:0/2684882307 >> v1:172.21.15.162:6789/0 conn(0x7f510006d410 0x7f51000b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:54028/0 (socket says 172.21.15.73:54028) 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 -- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 msgr2=0x7f51000cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f51000cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 -- 172.21.15.73:0/2684882307 >> v1:172.21.15.162:6789/0 conn(0x7f510006d410 legacy=0x7f51000b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f50fffff640 1 -- 172.21.15.73:0/2684882307 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000cc550 con 0x7f51001598c0 2023-12-19T16:18:36.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.481+0000 7f5104c29640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f51000cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:36.488 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f50fffff640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51001598c0 0x7f510006c590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c30ffa418fd2cc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f50feffd640 1 -- 172.21.15.73:0/2684882307 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00aa670 con 0x7f51001598c0 2023-12-19T16:18:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f50feffd640 1 -- 172.21.15.73:0/2684882307 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00aa7d0 con 0x7f51001598c0 2023-12-19T16:18:36.489 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f50feffd640 1 -- 172.21.15.73:0/2684882307 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00aab60 con 0x7f51001598c0 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 -- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51001598c0 msgr2=0x7f510006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51001598c0 0x7f510006c590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f50f0009870 tx=0x7f50f001c510 comp rx=0 tx=0).stop 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 -- 172.21.15.73:0/2684882307 shutdown_connections 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f51000cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 --2- 172.21.15.73:0/2684882307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51001598c0 0x7f510006c590 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 -- 172.21.15.73:0/2684882307 >> 172.21.15.73:0/2684882307 conn(0x7f510006a570 msgr2=0x7f51000ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 -- 172.21.15.73:0/2684882307 shutdown_connections 2023-12-19T16:18:36.490 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 -- 172.21.15.73:0/2684882307 wait complete. 2023-12-19T16:18:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.485+0000 7f510668c640 1 Processor -- start 2023-12-19T16:18:36.491 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- start start 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510006d410 0x7f5100150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f5100153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 0x7f51001540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001512f0 con 0x7f51001598c0 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001671f0 con 0x7f510006d410 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51000ab8e0 con 0x7f51000b0830 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 0x7f51001540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 0x7f51001540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42814/0 (socket says 172.21.15.73:42814) 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 -- 172.21.15.73:0/793845579 learned_addr learned my addr 172.21.15.73:0/793845579 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50fffff640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510006d410 0x7f5100150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50ff7fe640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f5100153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 -- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 msgr2=0x7f5100153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.494 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f5100153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 -- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510006d410 msgr2=0x7f5100150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510006d410 0x7f5100150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009a70 con 0x7f51001598c0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50ff7fe640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51000b0830 0x7f5100153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f5104c29640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 0x7f51001540b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009f00 tx=0x7f50f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8009d70 con 0x7f51001598c0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f800f040 con 0x7f51001598c0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f00094d0 con 0x7f51001598c0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8003bc0 con 0x7f51001598c0 2023-12-19T16:18:36.495 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100167440 con 0x7f51001598c0 2023-12-19T16:18:36.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.489+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5100159ca0 con 0x7f51001598c0 2023-12-19T16:18:36.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50f8014480 con 0x7f51001598c0 2023-12-19T16:18:36.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f50ec065a90 0x7f50ec067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f50f8083bf0 con 0x7f51001598c0 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fffff640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f50ec065a90 0x7f50ec067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f50ec06b990 0x7f50ec06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50ec06e460 con 0x7f50ec06b990 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50f80882a0 con 0x7f51001598c0 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50ff7fe640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f50ec06b990 0x7f50ec06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fffff640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f50ec065a90 0x7f50ec067f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ae000 tx=0x7f50f00a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.497 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50ff7fe640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f50ec06b990 0x7f50ec06ddb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.493+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== osd.0 v2:172.21.15.73:6824/38196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f50ec06e460 con 0x7f50ec06b990 2023-12-19T16:18:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 --> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f510004e070 con 0x7f50ec06b990 2023-12-19T16:18:36.510 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f50fcff9640 1 -- 172.21.15.73:0/793845579 <== osd.0 v2:172.21.15.73:6824/38196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f510004e070 con 0x7f50ec06b990 2023-12-19T16:18:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:36.511 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:36.511 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:36.511 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f50ec06b990 msgr2=0x7f50ec06ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6824/38196,v1:172.21.15.73:6825/38196] conn(0x7f50ec06b990 0x7f50ec06ddb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f50ec065a90 msgr2=0x7f50ec067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f50ec065a90 0x7f50ec067f50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50f00ae000 tx=0x7f50f00a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 msgr2=0x7f51001540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f510668c640 1 --2- 172.21.15.73:0/793845579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51001598c0 0x7f51001540b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009f00 tx=0x7f50f800c490 comp rx=0 tx=0).stop 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.505+0000 7f5104c29640 1 -- 172.21.15.73:0/793845579 reap_dead start 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.509+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 shutdown_connections 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.509+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 >> 172.21.15.73:0/793845579 conn(0x7f510006a570 msgr2=0x7f5100070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.509+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 shutdown_connections 2023-12-19T16:18:36.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.509+0000 7f510668c640 1 -- 172.21.15.73:0/793845579 wait complete. 2023-12-19T16:18:36.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T16:18:36.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.661+0000 7f9127509640 1 Processor -- start 2023-12-19T16:18:36.666 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.661+0000 7f9127509640 1 -- start start 2023-12-19T16:18:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9127509640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9127509640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91200b40b0 0x7f91200cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9127509640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912015ad00 con 0x7f91200cda70 2023-12-19T16:18:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9127509640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912015e110 con 0x7f91200b40b0 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9127509640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200cdf00 con 0x7f9120159830 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91200b40b0 0x7f91200cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91200b40b0 0x7f91200cd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42816/0 (socket says 172.21.15.73:42816) 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 -- 172.21.15.73:0/3198616926 learned_addr learned my addr 172.21.15.73:0/3198616926 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f91252a5640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 -- 172.21.15.73:0/3198616926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 msgr2=0x7f912015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.670 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 -- 172.21.15.73:0/3198616926 >> v1:172.21.15.73:6789/0 conn(0x7f91200cda70 legacy=0x7f91200cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9124aa4640 1 -- 172.21.15.73:0/3198616926 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200ce2d0 con 0x7f91200b40b0 2023-12-19T16:18:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.665+0000 7f9117fff640 1 -- 172.21.15.73:0/3198616926 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952859950 0 0) 0x7f912015ad00 con 0x7f91200cda70 2023-12-19T16:18:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9124aa4640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200cd530 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9110009870 tx=0x7f911001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ebd9e25eae4432 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9117fff640 1 -- 172.21.15.73:0/3198616926 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100ab680 con 0x7f91200b40b0 2023-12-19T16:18:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9117fff640 1 -- 172.21.15.73:0/3198616926 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100ab7e0 con 0x7f91200b40b0 2023-12-19T16:18:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9117fff640 1 -- 172.21.15.73:0/3198616926 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100abb70 con 0x7f91200b40b0 2023-12-19T16:18:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- 172.21.15.73:0/3198616926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 msgr2=0x7f91200cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200cd530 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9110009870 tx=0x7f911001c480 comp rx=0 tx=0).stop 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- 172.21.15.73:0/3198616926 shutdown_connections 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200cd530 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- 172.21.15.73:0/3198616926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- 172.21.15.73:0/3198616926 >> 172.21.15.73:0/3198616926 conn(0x7f91200b0270 msgr2=0x7f91200b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- 172.21.15.73:0/3198616926 shutdown_connections 2023-12-19T16:18:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- 172.21.15.73:0/3198616926 wait complete. 2023-12-19T16:18:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 Processor -- start 2023-12-19T16:18:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- start start 2023-12-19T16:18:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 0x7f91200b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.678 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200b1fd0 con 0x7f91200b40b0 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91200b22b0 con 0x7f91200cda70 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f9127509640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200b2590 con 0x7f9120159830 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f91252a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.669+0000 7f91252a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42822/0 (socket says 172.21.15.73:42822) 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 -- 172.21.15.73:0/4088538670 learned_addr learned my addr 172.21.15.73:0/4088538670 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9124aa4640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 0x7f91200b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9125aa6640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 -- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 msgr2=0x7f912014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 -- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 msgr2=0x7f91200b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 0x7f91200b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 -- 172.21.15.73:0/4088538670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100094d0 con 0x7f91200b40b0 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9124aa4640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 0x7f91200b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:36.680 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9125aa6640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f91252a5640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f911c00d800 tx=0x7f911c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00b6c0 con 0x7f91200b40b0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00b820 con 0x7f91200b40b0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91200b2870 con 0x7f91200b40b0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00bb90 con 0x7f91200b40b0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200b1cc0 con 0x7f91200b40b0 2023-12-19T16:18:36.681 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120074050 con 0x7f91200b40b0 2023-12-19T16:18:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f911c00bcf0 con 0x7f91200b40b0 2023-12-19T16:18:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 0x7f9104067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.673+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f911c083520 con 0x7f91200b40b0 2023-12-19T16:18:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.677+0000 7f9124aa4640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 0x7f9104067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.677+0000 7f9124aa4640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 0x7f9104067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f91100af000 tx=0x7f91100a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:36.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.681+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f911c0510e0 con 0x7f91200b40b0 2023-12-19T16:18:36.831 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f912015dd30 con 0x7f9104065a60 2023-12-19T16:18:36.832 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9115ffb640 1 -- 172.21.15.73:0/4088538670 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91100ab480 con 0x7f9104065a60 2023-12-19T16:18:36.832 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 msgr2=0x7f9104067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 0x7f9104067f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f91100af000 tx=0x7f91100a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 msgr2=0x7f91200b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f911c00d800 tx=0x7f911c00dcc0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 shutdown_connections 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9120159830 0x7f912014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91200cda70 0x7f91200b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.834 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9104065a60 0x7f9104067f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 --2- 172.21.15.73:0/4088538670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91200b40b0 0x7f91200b3070 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 >> 172.21.15.73:0/4088538670 conn(0x7f91200b0270 msgr2=0x7f91200ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:36.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 shutdown_connections 2023-12-19T16:18:36.835 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.829+0000 7f9127509640 1 -- 172.21.15.73:0/4088538670 wait complete. 2023-12-19T16:18:36.852 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T16:18:36.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:36.994 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.989+0000 7f1824139640 1 Processor -- start 2023-12-19T16:18:36.995 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.989+0000 7f1824139640 1 -- start start 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1824139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f181c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1824139640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c06ffb0 con 0x7f181c158650 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1824139640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c15b730 con 0x7f181c15e4d0 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1824139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c15ba10 con 0x7f181c158270 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f18216d4640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f181c158650 0x7f181c070790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49680/0 (socket says 172.21.15.73:49680) 2023-12-19T16:18:36.996 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f18216d4640 1 -- 172.21.15.73:0/965213741 learned_addr learned my addr 172.21.15.73:0/965213741 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f181c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985468452 0 0) 0x7f181c06ffb0 con 0x7f181c158650 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1808003530 con 0x7f181c158650 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080103092 0 0) 0x7f181c15b730 con 0x7f181c15e4d0 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c06ffb0 con 0x7f181c15e4d0 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334680173 0 0) 0x7f1808003530 con 0x7f181c158650 2023-12-19T16:18:36.998 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 msgr2=0x7f181c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f181c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 >> v1:172.21.15.162:6789/0 conn(0x7f181c15e4d0 legacy=0x7f181c06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c15bcf0 con 0x7f181c158650 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f180c001680 con 0x7f181c158650 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f181c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 >> v1:172.21.15.73:6789/0 conn(0x7f181c158650 legacy=0x7f181c070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f1808003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f18080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1808004d10 0x7f1808005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c15ba10 con 0x7f1808003b40 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180800ba40 con 0x7f1808004d10 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180800bc00 con 0x7f181c158270 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f1808003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:36.999 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f18216d4640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f18080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f18226d6640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1808004d10 0x7f1808005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 -- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 msgr2=0x7f18080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c158270 0x7f18080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 -- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1808004d10 msgr2=0x7f1808005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1808004d10 0x7f1808005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.000 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.993+0000 7f1821ed5640 1 -- 172.21.15.73:0/965213741 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818009420 con 0x7f1808003b40 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1821ed5640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f1808003f40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1818009cb0 tx=0x7f181801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1aff6044800a2e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180a5880 con 0x7f1808003b40 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180a59e0 con 0x7f1808003b40 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1820ed3640 1 -- 172.21.15.73:0/965213741 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180a5d90 con 0x7f1808003b40 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- 172.21.15.73:0/965213741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 msgr2=0x7f1808003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 --2- 172.21.15.73:0/965213741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f1808003f40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1818009cb0 tx=0x7f181801cbc0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f18226d6640 1 -- 172.21.15.73:0/965213741 reap_dead start 2023-12-19T16:18:37.001 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- 172.21.15.73:0/965213741 shutdown_connections 2023-12-19T16:18:37.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- 172.21.15.73:0/965213741 >> 172.21.15.73:0/965213741 conn(0x7f181c06a570 msgr2=0x7f181c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- 172.21.15.73:0/965213741 shutdown_connections 2023-12-19T16:18:37.002 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- 172.21.15.73:0/965213741 wait complete. 2023-12-19T16:18:37.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 Processor -- start 2023-12-19T16:18:37.003 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:36.997+0000 7f1824139640 1 -- start start 2023-12-19T16:18:37.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f181c1e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c155f40 0x7f181c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f181c1e8090 0x7f181c1e8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.005 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1e8a50 con 0x7f1808003b40 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1e6910 con 0x7f181c1e8090 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c1e6bf0 con 0x7f181c155f40 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f181c1e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f181c1e79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42840/0 (socket says 172.21.15.73:42840) 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 -- 172.21.15.73:0/2098846889 learned_addr learned my addr 172.21.15.73:0/2098846889 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18216d4640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c155f40 0x7f181c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18226d6640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f181c1e8090 0x7f181c1e8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 -- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c155f40 msgr2=0x7f181c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c155f40 0x7f181c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 -- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f181c1e8090 msgr2=0x7f181c1e8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f181c1e8090 0x7f181c1e8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c1e6ed0 con 0x7f1808003b40 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18226d6640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f181c1e8090 0x7f181c1e8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:37.006 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18216d4640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f181c155f40 0x7f181c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1821ed5640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f181c1e79b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1818009cb0 tx=0x7f1808005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180ad640 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180ad7a0 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180adb30 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c1e71b0 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1e6550 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.001+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f181c15b2f0 con 0x7f1808003b40 2023-12-19T16:18:37.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f18180b4040 con 0x7f1808003b40 2023-12-19T16:18:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1800065ae0 0x7f1800067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f181811ca60 con 0x7f1808003b40 2023-12-19T16:18:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18216d4640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1800065ae0 0x7f1800067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f180006b9e0 0x7f180006de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.008 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f180006e4b0 con 0x7f180006b9e0 2023-12-19T16:18:37.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f181811cf00 con 0x7f1808003b40 2023-12-19T16:18:37.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18226d6640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f180006b9e0 0x7f180006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18216d4640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1800065ae0 0x7f1800067fa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f180c001b80 tx=0x7f180c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18226d6640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f180006b9e0 0x7f180006de00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.009 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.005+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== osd.1 v2:172.21.15.73:6809/38195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f180006e4b0 con 0x7f180006b9e0 2023-12-19T16:18:37.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 --> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f181c1e8a50 con 0x7f180006b9e0 2023-12-19T16:18:37.022 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f18127fc640 1 -- 172.21.15.73:0/2098846889 <== osd.1 v2:172.21.15.73:6809/38195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f181c1e8a50 con 0x7f180006b9e0 2023-12-19T16:18:37.022 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:37.023 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:37.023 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:37.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f180006b9e0 msgr2=0x7f180006de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6809/38195,v1:172.21.15.73:6811/38195] conn(0x7f180006b9e0 0x7f180006de00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1800065ae0 msgr2=0x7f1800067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1800065ae0 0x7f1800067fa0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f180c001b80 tx=0x7f180c009040 comp rx=0 tx=0).stop 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 msgr2=0x7f181c1e79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 --2- 172.21.15.73:0/2098846889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1808003b40 0x7f181c1e79b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1818009cb0 tx=0x7f1808005800 comp rx=0 tx=0).stop 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f18226d6640 1 -- 172.21.15.73:0/2098846889 reap_dead start 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 shutdown_connections 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 >> 172.21.15.73:0/2098846889 conn(0x7f181c06a570 msgr2=0x7f181c0ad980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 shutdown_connections 2023-12-19T16:18:37.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.017+0000 7f1824139640 1 -- 172.21.15.73:0/2098846889 wait complete. 2023-12-19T16:18:37.041 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T16:18:37.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 Processor -- start 2023-12-19T16:18:37.180 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 -- start start 2023-12-19T16:18:37.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15a00b40b0 0x7f15a00cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a015ad00 con 0x7f15a00cda70 2023-12-19T16:18:37.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a015e110 con 0x7f15a00b40b0 2023-12-19T16:18:37.181 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a8066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00cdf00 con 0x7f15a0159830 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5e02640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a6603640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f15a00cda70 0x7f15a00cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.73:54056/0 (socket says 172.21.15.73:54056) 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a6603640 1 -- 172.21.15.73:0/3291889902 learned_addr learned my addr 172.21.15.73:0/3291889902 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5601640 1 --2- 172.21.15.73:0/3291889902 >> v2:172.21.15.162:3300/0 conn(0x7f15a00b40b0 0x7f15a00cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5e02640 1 -- 172.21.15.73:0/3291889902 >> v2:172.21.15.162:3300/0 conn(0x7f15a00b40b0 msgr2=0x7f15a00cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5e02640 1 --2- 172.21.15.73:0/3291889902 >> v2:172.21.15.162:3300/0 conn(0x7f15a00b40b0 0x7f15a00cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.182 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5e02640 1 -- 172.21.15.73:0/3291889902 >> v1:172.21.15.162:6789/0 conn(0x7f15a00cda70 legacy=0x7f15a00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a5e02640 1 -- 172.21.15.73:0/3291889902 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00ce2d0 con 0x7f15a0159830 2023-12-19T16:18:37.183 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.177+0000 7f15a4e00640 1 -- 172.21.15.73:0/3291889902 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940082487 0 0) 0x7f15a015ad00 con 0x7f15a00cda70 2023-12-19T16:18:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a5e02640 1 --2- 172.21.15.73:0/3291889902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a015a7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299edfebd482ea90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a4e00640 1 -- 172.21.15.73:0/3291889902 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0ac620 con 0x7f15a0159830 2023-12-19T16:18:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a4e00640 1 -- 172.21.15.73:0/3291889902 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c0ac780 con 0x7f15a0159830 2023-12-19T16:18:37.186 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a4e00640 1 -- 172.21.15.73:0/3291889902 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0acb10 con 0x7f15a0159830 2023-12-19T16:18:37.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 -- 172.21.15.73:0/3291889902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 msgr2=0x7f15a015a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 --2- 172.21.15.73:0/3291889902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a015a7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f159c0097c0 tx=0x7f159c01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 -- 172.21.15.73:0/3291889902 shutdown_connections 2023-12-19T16:18:37.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 --2- 172.21.15.73:0/3291889902 >> v2:172.21.15.162:3300/0 conn(0x7f15a00b40b0 0x7f15a00cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.187 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 --2- 172.21.15.73:0/3291889902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a015a7c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 -- 172.21.15.73:0/3291889902 >> 172.21.15.73:0/3291889902 conn(0x7f15a00b0270 msgr2=0x7f15a00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 -- 172.21.15.73:0/3291889902 shutdown_connections 2023-12-19T16:18:37.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.181+0000 7f15a8066640 1 -- 172.21.15.73:0/3291889902 wait complete. 2023-12-19T16:18:37.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 Processor -- start 2023-12-19T16:18:37.188 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- start start 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15a00b40b0 0x7f15a01565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a00af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0159180 con 0x7f15a00cda70 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00c2270 con 0x7f15a00b40b0 2023-12-19T16:18:37.189 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00c2a80 con 0x7f15a0159830 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5e02640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15a00b40b0 0x7f15a01565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42856/0 (socket says 172.21.15.73:42856) 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 -- 172.21.15.73:0/3789171308 learned_addr learned my addr 172.21.15.73:0/3789171308 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a6603640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a00af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 -- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 msgr2=0x7f15a00af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a00af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 -- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15a00b40b0 msgr2=0x7f15a01565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15a00b40b0 0x7f15a01565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 -- 172.21.15.73:0/3789171308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009420 con 0x7f15a00cda70 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a5601640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f159000e930 tx=0x7f159000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590009690 con 0x7f15a00cda70 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000ca00 con 0x7f15a00cda70 2023-12-19T16:18:37.191 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000cd70 con 0x7f15a00cda70 2023-12-19T16:18:37.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a00c24c0 con 0x7f15a00cda70 2023-12-19T16:18:37.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.185+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a00c4b90 con 0x7f15a00cda70 2023-12-19T16:18:37.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00c49c0 con 0x7f15a00cda70 2023-12-19T16:18:37.192 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1590013470 con 0x7f15a00cda70 2023-12-19T16:18:37.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15967fc640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 0x7f1584067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.193 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f15900831d0 con 0x7f15a00cda70 2023-12-19T16:18:37.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15a5e02640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 0x7f1584067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.194 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.189+0000 7f15a5e02640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 0x7f1584067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f159c0ae000 tx=0x7f159c0a7000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.197 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.193+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1590050f00 con 0x7f15a00cda70 2023-12-19T16:18:37.348 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a015dd30 con 0x7f1584065a60 2023-12-19T16:18:37.349 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15967fc640 1 -- 172.21.15.73:0/3789171308 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f159c0ba070 con 0x7f1584065a60 2023-12-19T16:18:37.349 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 msgr2=0x7f1584067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 0x7f1584067f20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f159c0ae000 tx=0x7f159c0a7000 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 msgr2=0x7f15a0146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f159000e930 tx=0x7f159000edf0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 shutdown_connections 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15a0159830 0x7f15a00af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f1584065a60 0x7f1584067f20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15a00cda70 0x7f15a0146ae0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 --2- 172.21.15.73:0/3789171308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15a00b40b0 0x7f15a01565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 >> 172.21.15.73:0/3789171308 conn(0x7f15a00b0270 msgr2=0x7f15a00b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.351 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 shutdown_connections 2023-12-19T16:18:37.352 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.345+0000 7f15a8066640 1 -- 172.21.15.73:0/3789171308 wait complete. 2023-12-19T16:18:37.370 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T16:18:37.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 Processor -- start 2023-12-19T16:18:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 -- start start 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86b806d410 0x7f86b80b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80cce80 con 0x7f86b81598c0 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80cc270 con 0x7f86b80b0660 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86bde2d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80b0b10 con 0x7f86b806d410 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86b806d410 0x7f86b80b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f86b81598c0 0x7f86b806c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49684/0 (socket says 172.21.15.73:49684) 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86b806d410 0x7f86b80b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42864/0 (socket says 172.21.15.73:42864) 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b77fe640 1 -- 172.21.15.73:0/1781972397 learned_addr learned my addr 172.21.15.73:0/1781972397 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b6ffd640 1 -- 172.21.15.73:0/1781972397 >> v1:172.21.15.162:6789/0 conn(0x7f86b80b0660 legacy=0x7f86b80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b6ffd640 1 -- 172.21.15.73:0/1781972397 >> v1:172.21.15.73:6789/0 conn(0x7f86b81598c0 legacy=0x7f86b806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.514 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b6ffd640 1 -- 172.21.15.73:0/1781972397 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80cc550 con 0x7f86b806d410 2023-12-19T16:18:37.515 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.509+0000 7f86b67fc640 1 -- 172.21.15.73:0/1781972397 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322580019 0 0) 0x7f86b80cce80 con 0x7f86b81598c0 2023-12-19T16:18:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/1781972397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806d410 0x7f86b80b0120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ba60 tx=0x7f86ac01eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87110538c0d3333 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86b67fc640 1 -- 172.21.15.73:0/1781972397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0a7bb0 con 0x7f86b806d410 2023-12-19T16:18:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86b67fc640 1 -- 172.21.15.73:0/1781972397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0a7d10 con 0x7f86b806d410 2023-12-19T16:18:37.517 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86b67fc640 1 -- 172.21.15.73:0/1781972397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0af660 con 0x7f86b806d410 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 -- 172.21.15.73:0/1781972397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806d410 msgr2=0x7f86b80b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 --2- 172.21.15.73:0/1781972397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806d410 0x7f86b80b0120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ba60 tx=0x7f86ac01eae0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 -- 172.21.15.73:0/1781972397 shutdown_connections 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 --2- 172.21.15.73:0/1781972397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b806d410 0x7f86b80b0120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 -- 172.21.15.73:0/1781972397 >> 172.21.15.73:0/1781972397 conn(0x7f86b806a570 msgr2=0x7f86b80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 -- 172.21.15.73:0/1781972397 shutdown_connections 2023-12-19T16:18:37.518 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.513+0000 7f86bde2d640 1 -- 172.21.15.73:0/1781972397 wait complete. 2023-12-19T16:18:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 Processor -- start 2023-12-19T16:18:37.519 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- start start 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86b806d410 0x7f86b80c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86b80b0660 0x7f86b80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 0x7f86b81547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8154ce0 con 0x7f86b81598c0 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80b0e90 con 0x7f86b80b0660 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80b1170 con 0x7f86b806d410 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 0x7f86b81547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 0x7f86b81547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42866/0 (socket says 172.21.15.73:42866) 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 -- 172.21.15.73:0/1908261297 learned_addr learned my addr 172.21.15.73:0/1908261297 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86b80b0660 0x7f86b80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.522 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b77fe640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86b806d410 0x7f86b80c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 -- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86b806d410 msgr2=0x7f86b80c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f86b806d410 0x7f86b80c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 -- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86b80b0660 msgr2=0x7f86b80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86b80b0660 0x7f86b80b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac00b6c0 con 0x7f86b81598c0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86b7fff640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 0x7f86b81547a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c780 tx=0x7f86b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0003d90 con 0x7f86b81598c0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000ce90 con 0x7f86b81598c0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b80b1450 con 0x7f86b81598c0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00052b0 con 0x7f86b81598c0 2023-12-19T16:18:37.523 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b80c6790 con 0x7f86b81598c0 2023-12-19T16:18:37.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.517+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86b8159ca0 con 0x7f86b81598c0 2023-12-19T16:18:37.524 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86b0005410 con 0x7f86b81598c0 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86a4065a60 0x7f86a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f86b00826c0 con 0x7f86b81598c0 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f86a406b960 0x7f86a406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f86b77fe640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86a4065a60 0x7f86a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86a406e430 con 0x7f86a406b960 2023-12-19T16:18:37.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b0084d80 con 0x7f86b81598c0 2023-12-19T16:18:37.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f86a406b960 0x7f86a406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f86b77fe640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86a4065a60 0x7f86a4067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f86a8000f70 tx=0x7f86a8007df0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f86b6ffd640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f86a406b960 0x7f86a406dd80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.521+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== osd.2 v2:172.21.15.73:6800/38197 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f86a406e430 con 0x7f86a406b960 2023-12-19T16:18:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.533+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 --> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86b804e070 con 0x7f86a406b960 2023-12-19T16:18:37.539 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.533+0000 7f869ffff640 1 -- 172.21.15.73:0/1908261297 <== osd.2 v2:172.21.15.73:6800/38197 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86b804e070 con 0x7f86a406b960 2023-12-19T16:18:37.539 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:37.539 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:37.539 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f86a406b960 msgr2=0x7f86a406dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6800/38197,v1:172.21.15.73:6801/38197] conn(0x7f86a406b960 0x7f86a406dd80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.540 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86a4065a60 msgr2=0x7f86a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f86a4065a60 0x7f86a4067f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f86a8000f70 tx=0x7f86a8007df0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 msgr2=0x7f86b81547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 --2- 172.21.15.73:0/1908261297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86b81598c0 0x7f86b81547a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c780 tx=0x7f86b000cc40 comp rx=0 tx=0).stop 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86b7fff640 1 -- 172.21.15.73:0/1908261297 reap_dead start 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 shutdown_connections 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 >> 172.21.15.73:0/1908261297 conn(0x7f86b806a570 msgr2=0x7f86b80cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 shutdown_connections 2023-12-19T16:18:37.541 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.537+0000 7f86bde2d640 1 -- 172.21.15.73:0/1908261297 wait complete. 2023-12-19T16:18:37.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T16:18:37.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 Processor -- start 2023-12-19T16:18:37.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 -- start start 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efdf80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efdf80b1690 0x7efdf80b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80c9940 con 0x7efdf815dfc0 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf806d720 con 0x7efdf80b1690 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdffdbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815e3a0 con 0x7efdf80c8fa0 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfdb58640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efdf815dfc0 0x7efdf80cbac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49690/0 (socket says 172.21.15.73:49690) 2023-12-19T16:18:37.697 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfdb58640 1 -- 172.21.15.73:0/620517121 learned_addr learned my addr 172.21.15.73:0/620517121 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:37.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efdf80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfe359640 1 --2- 172.21.15.73:0/620517121 >> v2:172.21.15.162:3300/0 conn(0x7efdf80b1690 0x7efdf80b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595183698 0 0) 0x7efdf80c9940 con 0x7efdf815dfc0 2023-12-19T16:18:37.699 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde4003530 con 0x7efdf815dfc0 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675489817 0 0) 0x7efde4003530 con 0x7efdf815dfc0 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 msgr2=0x7efdf80c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efdf80c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 >> v2:172.21.15.162:3300/0 conn(0x7efdf80b1690 msgr2=0x7efdf80b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 --2- 172.21.15.73:0/620517121 >> v2:172.21.15.162:3300/0 conn(0x7efdf80b1690 0x7efdf80b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf806c3a0 con 0x7efdf815dfc0 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7efdf4001680 con 0x7efdf815dfc0 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 >> v1:172.21.15.73:6789/0 conn(0x7efdf815dfc0 legacy=0x7efdf80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde4003980 0x7efde4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde40047d0 0x7efde4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efde4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.700 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf806d720 con 0x7efde40047d0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815e3a0 con 0x7efde4003980 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde400b990 con 0x7efdf80c8fa0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde40047d0 0x7efde4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfdb58640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde4003980 0x7efde4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfe359640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efde4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 -- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 msgr2=0x7efde4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c8fa0 0x7efde4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 -- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde4003980 msgr2=0x7efde4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde4003980 0x7efde4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfd357640 1 -- 172.21.15.73:0/620517121 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde4003530 con 0x7efde40047d0 2023-12-19T16:18:37.701 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.693+0000 7efdfdb58640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde4003980 0x7efde4003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:37.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdfd357640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde40047d0 0x7efde4004c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efde8009ae0 tx=0x7efde801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca2f163c8a2f2e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.702 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5560 con 0x7efde40047d0 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde80a56c0 con 0x7efde40047d0 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdfcb56640 1 -- 172.21.15.73:0/620517121 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5a70 con 0x7efde40047d0 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 -- 172.21.15.73:0/620517121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde40047d0 msgr2=0x7efde4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 --2- 172.21.15.73:0/620517121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efde40047d0 0x7efde4004c50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efde8009ae0 tx=0x7efde801ca50 comp rx=0 tx=0).stop 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdfe359640 1 -- 172.21.15.73:0/620517121 reap_dead start 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 -- 172.21.15.73:0/620517121 shutdown_connections 2023-12-19T16:18:37.703 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 -- 172.21.15.73:0/620517121 >> 172.21.15.73:0/620517121 conn(0x7efdf80b0270 msgr2=0x7efdf80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 -- 172.21.15.73:0/620517121 shutdown_connections 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.697+0000 7efdffdbc640 1 -- 172.21.15.73:0/620517121 wait complete. 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 Processor -- start 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- start start 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde40047d0 0x7efdf80a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c65e0 0x7efdf80c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c7350 con 0x7efdf814d300 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c7630 con 0x7efde40047d0 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c7910 con 0x7efdf80c65e0 2023-12-19T16:18:37.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42890/0 (socket says 172.21.15.73:42890) 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfdb58640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde40047d0 0x7efdf80a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 -- 172.21.15.73:0/3499386406 learned_addr learned my addr 172.21.15.73:0/3499386406 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfe359640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c65e0 0x7efdf80c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 -- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c65e0 msgr2=0x7efdf80c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c65e0 0x7efdf80c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 -- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde40047d0 msgr2=0x7efdf80a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde40047d0 0x7efdf80a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 -- 172.21.15.73:0/3499386406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80c7bf0 con 0x7efdf814d300 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdfd357640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efde8009ae0 tx=0x7efde4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8004220 con 0x7efdf814d300 2023-12-19T16:18:37.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8004380 con 0x7efdf814d300 2023-12-19T16:18:37.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde80ad850 con 0x7efdf814d300 2023-12-19T16:18:37.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf80c7ed0 con 0x7efdf814d300 2023-12-19T16:18:37.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.701+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf80c83f0 con 0x7efdf814d300 2023-12-19T16:18:37.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf80c8060 con 0x7efdf814d300 2023-12-19T16:18:37.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efde80b4040 con 0x7efdf814d300 2023-12-19T16:18:37.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdee7fc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 0x7efddc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:37.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7efde811d530 con 0x7efdf814d300 2023-12-19T16:18:37.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdfdb58640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 0x7efddc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:37.710 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.705+0000 7efdfdb58640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 0x7efddc067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000fc0 tx=0x7efdf4001e50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:37.713 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.709+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efde80eb2c0 con 0x7efdf814d300 2023-12-19T16:18:37.867 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf806c960 con 0x7efddc065a60 2023-12-19T16:18:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdee7fc640 1 -- 172.21.15.73:0/3499386406 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdf40149f0 con 0x7efddc065a60 2023-12-19T16:18:37.868 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 msgr2=0x7efddc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 0x7efddc067f20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000fc0 tx=0x7efdf4001e50 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 msgr2=0x7efdf80a8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efde8009ae0 tx=0x7efde4005800 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 shutdown_connections 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efdf80c65e0 0x7efdf80c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7efddc065a60 0x7efddc067f20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdf814d300 0x7efdf80a8a50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 --2- 172.21.15.73:0/3499386406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efde40047d0 0x7efdf80a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 >> 172.21.15.73:0/3499386406 conn(0x7efdf80b0270 msgr2=0x7efdf8070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:37.870 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 shutdown_connections 2023-12-19T16:18:37.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:37.865+0000 7efdffdbc640 1 -- 172.21.15.73:0/3499386406 wait complete. 2023-12-19T16:18:37.888 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T16:18:37.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:38.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 Processor -- start 2023-12-19T16:18:38.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 -- start start 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4b806bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b806ffb0 con 0x7ff4b8158270 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b815b730 con 0x7ff4b8158650 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.025+0000 7ff4bdcdf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815ba10 con 0x7ff4b815e4d0 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff4b8158270 0x7ff4b815aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49704/0 (socket says 172.21.15.73:49704) 2023-12-19T16:18:38.031 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b77fe640 1 -- 172.21.15.73:0/2622317030 learned_addr learned my addr 172.21.15.73:0/2622317030 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b7fff640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4b806bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056526337 0 0) 0x7ff4b806ffb0 con 0x7ff4b8158270 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a0003530 con 0x7ff4b8158270 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044651669 0 0) 0x7ff4a0003530 con 0x7ff4b8158270 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 msgr2=0x7ff4b806bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4b806bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 >> v1:172.21.15.162:6789/0 conn(0x7ff4b8158650 legacy=0x7ff4b8070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b815bcf0 con 0x7ff4b8158270 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7ff4a8001680 con 0x7ff4b8158270 2023-12-19T16:18:38.034 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 >> v1:172.21.15.73:6789/0 conn(0x7ff4b8158270 legacy=0x7ff4b815aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a00039b0 0x7ff4a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a00047d0 0x7ff4a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815ba10 con 0x7ff4a00047d0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000ba40 con 0x7ff4a00039b0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a000bc00 con 0x7ff4b815e4d0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a00047d0 0x7ff4a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b77fe640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a00039b0 0x7ff4a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b7fff640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 -- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 msgr2=0x7ff4a0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4b815e4d0 0x7ff4a0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 -- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a00039b0 msgr2=0x7ff4a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.035 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4a00039b0 0x7ff4a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.036 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.029+0000 7ff4b6ffd640 1 -- 172.21.15.73:0/2622317030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a0003530 con 0x7ff4a00047d0 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a00047d0 0x7ff4a0004c50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac001750 tx=0x7ff4ac01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3591b9ef0e71e1e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0052d0 con 0x7ff4a00047d0 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0a7050 con 0x7ff4a00047d0 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4b67fc640 1 -- 172.21.15.73:0/2622317030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003600 con 0x7ff4a00047d0 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/2622317030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a00047d0 msgr2=0x7ff4a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 --2- 172.21.15.73:0/2622317030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4a00047d0 0x7ff4a0004c50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac001750 tx=0x7ff4ac01c3a0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.038 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4b7fff640 1 -- 172.21.15.73:0/2622317030 reap_dead start 2023-12-19T16:18:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/2622317030 shutdown_connections 2023-12-19T16:18:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/2622317030 >> 172.21.15.73:0/2622317030 conn(0x7ff4b806a570 msgr2=0x7ff4b80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/2622317030 shutdown_connections 2023-12-19T16:18:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/2622317030 wait complete. 2023-12-19T16:18:38.039 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 Processor -- start 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.033+0000 7ff4bdcdf640 1 -- start start 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a00047d0 0x7ff4b81f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4b8144f90 0x7ff4b80c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 0x7ff4b80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c2a70 con 0x7ff4b80c25e0 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8144220 con 0x7ff4b8144f90 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c4d60 con 0x7ff4a00047d0 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 0x7ff4b80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.041 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 0x7ff4b80c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42902/0 (socket says 172.21.15.73:42902) 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 -- 172.21.15.73:0/180080779 learned_addr learned my addr 172.21.15.73:0/180080779 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4b8144f90 0x7ff4b80c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b77fe640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a00047d0 0x7ff4b81f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 -- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a00047d0 msgr2=0x7ff4b81f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a00047d0 0x7ff4b81f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 -- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4b8144f90 msgr2=0x7ff4b80c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4b8144f90 0x7ff4b80c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b81444b0 con 0x7ff4b80c25e0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b77fe640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4a00047d0 0x7ff4b81f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4b7fff640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 0x7ff4b80c3fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806e3b0 tx=0x7ff4b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000e040 con 0x7ff4b80c25e0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000f040 con 0x7ff4b80c25e0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b8144790 con 0x7ff4b80c25e0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0015670 con 0x7ff4b80c25e0 2023-12-19T16:18:38.042 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b81f1e60 con 0x7ff4b80c25e0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4b8070270 con 0x7ff4b80c25e0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.037+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4b00157d0 con 0x7ff4b80c25e0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff4a4065a60 0x7ff4a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff4b0084390 con 0x7ff4b80c25e0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff4b77fe640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff4a4065a60 0x7ff4a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7ff4a406b960 0x7ff4a406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4a406e430 con 0x7ff4a406b960 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b00847e0 con 0x7ff4b80c25e0 2023-12-19T16:18:38.044 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7ff4a406b960 0x7ff4a406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff4b77fe640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff4a4065a60 0x7ff4a4067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8001060 tx=0x7ff4a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff4b6ffd640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7ff4a406b960 0x7ff4a406dd80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.045 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.041+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== osd.3 v2:172.21.15.73:6808/38198 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff4a406e430 con 0x7ff4a406b960 2023-12-19T16:18:38.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 --> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4b804e070 con 0x7ff4a406b960 2023-12-19T16:18:38.058 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff49ffff640 1 -- 172.21.15.73:0/180080779 <== osd.3 v2:172.21.15.73:6808/38198 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff4b804e070 con 0x7ff4a406b960 2023-12-19T16:18:38.058 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:38.058 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:38.058 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:38.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7ff4a406b960 msgr2=0x7ff4a406dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6808/38198,v1:172.21.15.73:6810/38198] conn(0x7ff4a406b960 0x7ff4a406dd80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff4a4065a60 msgr2=0x7ff4a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff4a4065a60 0x7ff4a4067f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8001060 tx=0x7ff4a8009040 comp rx=0 tx=0).stop 2023-12-19T16:18:38.059 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 msgr2=0x7ff4b80c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 --2- 172.21.15.73:0/180080779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80c25e0 0x7ff4b80c3fe0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806e3b0 tx=0x7ff4b000f580 comp rx=0 tx=0).stop 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4b7fff640 1 -- 172.21.15.73:0/180080779 reap_dead start 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 shutdown_connections 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 >> 172.21.15.73:0/180080779 conn(0x7ff4b806a570 msgr2=0x7ff4b815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 shutdown_connections 2023-12-19T16:18:38.060 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.053+0000 7ff4bdcdf640 1 -- 172.21.15.73:0/180080779 wait complete. 2023-12-19T16:18:38.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T16:18:38.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 Processor -- start 2023-12-19T16:18:38.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 -- start start 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f603c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f603c0c8fa0 0x7f603c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0c9940 con 0x7f603c070130 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c06d720 con 0x7f603c0c8fa0 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f6043c20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c15e3a0 con 0x7f603c15dfc0 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60421bd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f603c070130 0x7f603c0705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49720/0 (socket says 172.21.15.73:49720) 2023-12-19T16:18:38.217 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60421bd640 1 -- 172.21.15.73:0/3355914104 learned_addr learned my addr 172.21.15.73:0/3355914104 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60411bb640 1 --2- 172.21.15.73:0/3355914104 >> v2:172.21.15.162:3300/0 conn(0x7f603c0c8fa0 0x7f603c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f603c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350709946 0 0) 0x7f603c0c9940 con 0x7f603c070130 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6028003530 con 0x7f603c070130 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3284576423 0 0) 0x7f6028003530 con 0x7f603c070130 2023-12-19T16:18:38.219 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 msgr2=0x7f603c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f603c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 >> v2:172.21.15.162:3300/0 conn(0x7f603c0c8fa0 msgr2=0x7f603c0c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 --2- 172.21.15.73:0/3355914104 >> v2:172.21.15.162:3300/0 conn(0x7f603c0c8fa0 0x7f603c0c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c06c3a0 con 0x7f603c070130 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2404873183 0 0) 0x7f6034001a00 con 0x7f603c070130 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60411bb640 1 --2- 172.21.15.73:0/3355914104 >> v2:172.21.15.162:3300/0 conn(0x7f603c0c8fa0 0x7f603c0c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 >> v1:172.21.15.73:6789/0 conn(0x7f603c070130 legacy=0x7f603c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6028003980 0x7f6028003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f60280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028004d10 0x7f6028005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c06d720 con 0x7f6028003980 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c15e3a0 con 0x7f6028004d10 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602800b990 con 0x7f603c15dfc0 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6028003980 0x7f6028003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.220 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60411bb640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f60280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60421bd640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028004d10 0x7f6028005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 -- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 msgr2=0x7f60280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15dfc0 0x7f60280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 -- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028004d10 msgr2=0x7f6028005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028004d10 0x7f6028005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.213+0000 7f60419bc640 1 -- 172.21.15.73:0/3355914104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028003530 con 0x7f6028003980 2023-12-19T16:18:38.221 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f60419bc640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6028003980 0x7f6028003da0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6038009ae0 tx=0x7f603801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a407b074598712f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380a55f0 con 0x7f6028003980 2023-12-19T16:18:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380a5750 con 0x7f6028003980 2023-12-19T16:18:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f60409ba640 1 -- 172.21.15.73:0/3355914104 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380a5b00 con 0x7f6028003980 2023-12-19T16:18:38.222 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 -- 172.21.15.73:0/3355914104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6028003980 msgr2=0x7f6028003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 --2- 172.21.15.73:0/3355914104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6028003980 0x7f6028003da0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6038009ae0 tx=0x7f603801ca20 comp rx=0 tx=0).stop 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f60421bd640 1 -- 172.21.15.73:0/3355914104 reap_dead start 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 -- 172.21.15.73:0/3355914104 shutdown_connections 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 -- 172.21.15.73:0/3355914104 >> 172.21.15.73:0/3355914104 conn(0x7f603c0b0270 msgr2=0x7f603c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 -- 172.21.15.73:0/3355914104 shutdown_connections 2023-12-19T16:18:38.223 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.217+0000 7f6043c20640 1 -- 172.21.15.73:0/3355914104 wait complete. 2023-12-19T16:18:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 Processor -- start 2023-12-19T16:18:38.224 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- start start 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028003980 0x7f603c154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15ab70 0x7f603c15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c15b530 con 0x7f603c0ac670 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c15ca20 con 0x7f6028003980 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c0ad130 con 0x7f603c15ab70 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42918/0 (socket says 172.21.15.73:42918) 2023-12-19T16:18:38.226 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 -- 172.21.15.73:0/2744794013 learned_addr learned my addr 172.21.15.73:0/2744794013 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60419bc640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028003980 0x7f603c154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60421bd640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15ab70 0x7f603c15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 -- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15ab70 msgr2=0x7f603c15aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15ab70 0x7f603c15aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 -- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028003980 msgr2=0x7f603c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028003980 0x7f603c154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 -- 172.21.15.73:0/2744794013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c15cce0 con 0x7f603c0ac670 2023-12-19T16:18:38.227 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60411bb640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f602c011cd0 tx=0x7f602c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c011d00 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c011e60 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c15cfc0 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c004240 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.221+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c1550e0 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c074050 con 0x7f603c0ac670 2023-12-19T16:18:38.228 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f602c0043a0 con 0x7f603c0ac670 2023-12-19T16:18:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f60327fc640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 0x7f6020067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f602c083590 con 0x7f603c0ac670 2023-12-19T16:18:38.229 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f60419bc640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 0x7f6020067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.230 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.225+0000 7f60419bc640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 0x7f6020067f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f60380af000 tx=0x7f60380046d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.233 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.229+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f602c051290 con 0x7f603c0ac670 2023-12-19T16:18:38.384 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f603c15c8a0 con 0x7f6020065a90 2023-12-19T16:18:38.385 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f60327fc640 1 -- 172.21.15.73:0/2744794013 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6038004020 con 0x7f6020065a90 2023-12-19T16:18:38.385 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T16:18:38.386 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 msgr2=0x7f6020067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 0x7f6020067f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f60380af000 tx=0x7f60380046d0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 msgr2=0x7f603c0acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f602c011cd0 tx=0x7f602c00f610 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 shutdown_connections 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f603c15ab70 0x7f603c15aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f6020065a90 0x7f6020067f50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f603c0ac670 0x7f603c0acaf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 --2- 172.21.15.73:0/2744794013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6028003980 0x7f603c154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 >> 172.21.15.73:0/2744794013 conn(0x7f603c0b0270 msgr2=0x7f603c158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 shutdown_connections 2023-12-19T16:18:38.387 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.381+0000 7f6043c20640 1 -- 172.21.15.73:0/2744794013 wait complete. 2023-12-19T16:18:38.406 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T16:18:38.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:38.548 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 Processor -- start 2023-12-19T16:18:38.549 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 -- start start 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 0x7feba40cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40cf3b0 con 0x7feba40cd910 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40b03a0 con 0x7feba415ab30 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febac1c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40b0a20 con 0x7feba40cde10 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba975b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feba40cd910 0x7feba40b0e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49728/0 (socket says 172.21.15.73:49728) 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba975b640 1 -- 172.21.15.73:0/3548093574 learned_addr learned my addr 172.21.15.73:0/3548093574 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:38.550 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febaa75d640 1 --2- 172.21.15.73:0/3548093574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 0x7feba40cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269985325 0 0) 0x7feba40cf3b0 con 0x7feba40cd910 2023-12-19T16:18:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90003530 con 0x7feba40cd910 2023-12-19T16:18:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107635787 0 0) 0x7feba40b03a0 con 0x7feba415ab30 2023-12-19T16:18:38.551 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba40cf3b0 con 0x7feba415ab30 2023-12-19T16:18:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febaa75d640 1 -- 172.21.15.73:0/3548093574 >> v1:172.21.15.162:6789/0 conn(0x7feba415ab30 legacy=0x7feba40cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febaa75d640 1 -- 172.21.15.73:0/3548093574 >> v1:172.21.15.73:6789/0 conn(0x7feba40cd910 legacy=0x7feba40b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.552 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.545+0000 7febaa75d640 1 -- 172.21.15.73:0/3548093574 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40cf8f0 con 0x7feba40cde10 2023-12-19T16:18:38.553 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febaa75d640 1 --2- 172.21.15.73:0/3548093574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 0x7feba40cee70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009dc0 tx=0x7feb9c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32cc59e3c1125f50 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0a5a30 con 0x7feba40cde10 2023-12-19T16:18:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0a5b90 con 0x7feba40cde10 2023-12-19T16:18:38.554 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7feba8f5a640 1 -- 172.21.15.73:0/3548093574 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0ad440 con 0x7feba40cde10 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febac1c0640 1 -- 172.21.15.73:0/3548093574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 msgr2=0x7feba40cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febac1c0640 1 --2- 172.21.15.73:0/3548093574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 0x7feba40cee70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009dc0 tx=0x7feb9c01c970 comp rx=0 tx=0).stop 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febac1c0640 1 -- 172.21.15.73:0/3548093574 shutdown_connections 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febac1c0640 1 --2- 172.21.15.73:0/3548093574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba40cde10 0x7feba40cee70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.549+0000 7febac1c0640 1 -- 172.21.15.73:0/3548093574 >> 172.21.15.73:0/3548093574 conn(0x7feba4099c30 msgr2=0x7feba40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- 172.21.15.73:0/3548093574 shutdown_connections 2023-12-19T16:18:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- 172.21.15.73:0/3548093574 wait complete. 2023-12-19T16:18:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 Processor -- start 2023-12-19T16:18:38.557 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- start start 2023-12-19T16:18:38.558 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba40cd910 0x7feba40adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 0x7feba41513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba415ab30 0x7feba414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4150a30 con 0x7feba40cde10 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba414fdb0 con 0x7feba40cd910 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febac1c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba4150090 con 0x7feba415ab30 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 0x7feba41513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 0x7feba41513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42928/0 (socket says 172.21.15.73:42928) 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 -- 172.21.15.73:0/248151177 learned_addr learned my addr 172.21.15.73:0/248151177 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba9f5c640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba40cd910 0x7feba40adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febaa75d640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba415ab30 0x7feba414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 -- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba415ab30 msgr2=0x7feba414b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba415ab30 0x7feba414b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 -- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba40cd910 msgr2=0x7feba40adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.559 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba40cd910 0x7feba40adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009a70 con 0x7feba40cde10 2023-12-19T16:18:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7febaa75d640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feba415ab30 0x7feba414b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba9f5c640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feba40cd910 0x7feba40adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.553+0000 7feba975b640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 0x7feba41513d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c4d0 tx=0x7feb9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94005cf0 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94005e50 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4150370 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94007270 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4150e50 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba415af10 con 0x7feba40cde10 2023-12-19T16:18:38.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb940073d0 con 0x7feba40cde10 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb88065a60 0x7feb88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7feb94082500 con 0x7feba40cde10 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feba9f5c640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb88065a60 0x7feb88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7feb8806b960 0x7feb8806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8806e430 con 0x7feb8806b960 2023-12-19T16:18:38.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb94084ae0 con 0x7feba40cde10 2023-12-19T16:18:38.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7febaa75d640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7feb8806b960 0x7feb8806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.557+0000 7feba9f5c640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb88065a60 0x7feb88067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feba0000fc0 tx=0x7feba0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.563 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.561+0000 7febaa75d640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7feb8806b960 0x7feb8806dd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.564 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.561+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== osd.4 v2:172.21.15.162:6800/38388 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7feb8806e430 con 0x7feb8806b960 2023-12-19T16:18:38.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 --> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feba40b0640 con 0x7feb8806b960 2023-12-19T16:18:38.577 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7feb9a7fc640 1 -- 172.21.15.73:0/248151177 <== osd.4 v2:172.21.15.162:6800/38388 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7feb9c0ae450 con 0x7feb8806b960 2023-12-19T16:18:38.577 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:38.577 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:38.577 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7feb8806b960 msgr2=0x7feb8806dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.162:6800/38388,v1:172.21.15.162:6801/38388] conn(0x7feb8806b960 0x7feb8806dd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.578 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb88065a60 msgr2=0x7feb88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7feb88065a60 0x7feb88067f20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feba0000fc0 tx=0x7feba0009040 comp rx=0 tx=0).stop 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 msgr2=0x7feba41513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 --2- 172.21.15.73:0/248151177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba40cde10 0x7feba41513d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7feb9400c4d0 tx=0x7feb9400c990 comp rx=0 tx=0).stop 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febaa75d640 1 -- 172.21.15.73:0/248151177 reap_dead start 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 shutdown_connections 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 >> 172.21.15.73:0/248151177 conn(0x7feba4099c30 msgr2=0x7feba40aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 shutdown_connections 2023-12-19T16:18:38.579 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.573+0000 7febac1c0640 1 -- 172.21.15.73:0/248151177 wait complete. 2023-12-19T16:18:38.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T16:18:38.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.729+0000 7f4aa9a1f640 1 Processor -- start 2023-12-19T16:18:38.734 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.729+0000 7f4aa9a1f640 1 -- start start 2023-12-19T16:18:38.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.729+0000 7f4aa9a1f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4aa415cbe0 0x7f4aa4161270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.729+0000 7f4aa9a1f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.729+0000 7f4aa9a1f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa41607d0 con 0x7f4aa40b1970 2023-12-19T16:18:38.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa9a1f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40cd620 con 0x7f4aa415cbe0 2023-12-19T16:18:38.735 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa9a1f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40ae9e0 con 0x7f4aa40b1ec0 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4aa415cbe0 0x7f4aa4161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.73:47228/0 (socket says 172.21.15.73:47228) 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4aa415cbe0 0x7f4aa4161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.73:33986/0 (socket says 172.21.15.73:33986) 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa37fe640 1 -- 172.21.15.73:0/4016473482 learned_addr learned my addr 172.21.15.73:0/4016473482 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:38.736 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 -- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 msgr2=0x7f4aa40c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 -- 172.21.15.73:0/4016473482 >> v1:172.21.15.162:6789/0 conn(0x7f4aa40b1970 legacy=0x7f4aa40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa2ffd640 1 -- 172.21.15.73:0/4016473482 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4160a70 con 0x7f4aa415cbe0 2023-12-19T16:18:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa27fc640 1 -- 172.21.15.73:0/4016473482 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018588063 0 0) 0x7f4aa41607d0 con 0x7f4aa40b1970 2023-12-19T16:18:38.737 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.733+0000 7f4aa37fe640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:38.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa2ffd640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa415cbe0 0x7f4aa4161270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097a0 tx=0x7f4a9401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c40432c6cf58bc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa27fc640 1 -- 172.21.15.73:0/4016473482 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ab600 con 0x7f4aa415cbe0 2023-12-19T16:18:38.739 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa27fc640 1 -- 172.21.15.73:0/4016473482 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a940a7050 con 0x7f4aa415cbe0 2023-12-19T16:18:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa27fc640 1 -- 172.21.15.73:0/4016473482 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940ab980 con 0x7f4aa415cbe0 2023-12-19T16:18:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa415cbe0 msgr2=0x7f4aa4161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa415cbe0 0x7f4aa4161270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4a940097a0 tx=0x7f4a9401c310 comp rx=0 tx=0).stop 2023-12-19T16:18:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/4016473482 shutdown_connections 2023-12-19T16:18:38.740 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1ec0 0x7f4aa40c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/4016473482 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa415cbe0 0x7f4aa4161270 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/4016473482 >> 172.21.15.73:0/4016473482 conn(0x7f4aa4071780 msgr2=0x7f4aa4098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/4016473482 shutdown_connections 2023-12-19T16:18:38.741 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/4016473482 wait complete. 2023-12-19T16:18:38.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 Processor -- start 2023-12-19T16:18:38.742 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- start start 2023-12-19T16:18:38.744 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 0x7f4aa4154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa40b1ec0 0x7f4aa415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40c3250 con 0x7f4aa415cbe0 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4157e20 con 0x7f4aa40b1ec0 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.737+0000 7f4aa9a1f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4158100 con 0x7f4aa40b1970 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42930/0 (socket says 172.21.15.73:42930) 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa2ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 0x7f4aa4154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 -- 172.21.15.73:0/306571439 learned_addr learned my addr 172.21.15.73:0/306571439 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4a9bfff640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa40b1ec0 0x7f4aa415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 -- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 msgr2=0x7f4aa4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 0x7f4aa4154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.745 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 -- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa40b1ec0 msgr2=0x7f4aa415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa40b1ec0 0x7f4aa415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 -- 172.21.15.73:0/306571439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c009b30 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa2ffd640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 0x7f4aa4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa37fe640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00efc0 tx=0x7f4a9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c018070 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00f040 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00ce00 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a940093b0 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa41586c0 con 0x7f4aa415cbe0 2023-12-19T16:18:38.746 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa40c33c0 con 0x7f4aa415cbe0 2023-12-19T16:18:38.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.741+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a9c014480 con 0x7f4aa415cbe0 2023-12-19T16:18:38.747 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.745+0000 7f4aa0ff9640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 0x7f4a84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:38.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.745+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4a9c083000 con 0x7f4aa415cbe0 2023-12-19T16:18:38.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.745+0000 7f4aa2ffd640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 0x7f4a84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:38.748 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.745+0000 7f4aa2ffd640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 0x7f4a84067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4a940ad000 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:38.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.749+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4aa40c33c0 con 0x7f4aa415cbe0 2023-12-19T16:18:38.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:38.790 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:38.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.897+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa415cfc0 con 0x7f4a84065a60 2023-12-19T16:18:38.903 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa0ff9640 1 -- 172.21.15.73:0/306571439 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4a940abb70 con 0x7f4a84065a60 2023-12-19T16:18:38.904 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T16:18:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 msgr2=0x7f4a84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 0x7f4a84067f20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4a940ad000 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 msgr2=0x7f4aa415dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00efc0 tx=0x7f4a9c00c490 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 shutdown_connections 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4a84065a60 0x7f4a84067f20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa415cbe0 0x7f4aa415dc60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4aa40b1ec0 0x7f4aa415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 --2- 172.21.15.73:0/306571439 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4aa40b1970 0x7f4aa4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 >> 172.21.15.73:0/306571439 conn(0x7f4aa4071780 msgr2=0x7f4aa4073190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 shutdown_connections 2023-12-19T16:18:38.906 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:38.901+0000 7f4aa9a1f640 1 -- 172.21.15.73:0/306571439 wait complete. 2023-12-19T16:18:38.924 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T16:18:38.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:39.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 Processor -- start 2023-12-19T16:18:39.067 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 -- start start 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f869015aaf0 0x7f869015e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869015aed0 con 0x7f86900cb8d0 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869015f580 con 0x7f869015aaf0 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868f59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86900cbce0 con 0x7f869015eb40 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f869015aaf0 0x7f869015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f869015aaf0 0x7f869015e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42934/0 (socket says 172.21.15.73:42934) 2023-12-19T16:18:39.069 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 -- 172.21.15.73:0/3671403904 learned_addr learned my addr 172.21.15.73:0/3671403904 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868dd9b640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 -- 172.21.15.73:0/3671403904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 msgr2=0x7f86900cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:39.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 -- 172.21.15.73:0/3671403904 >> v1:172.21.15.162:6789/0 conn(0x7f86900cb8d0 legacy=0x7f86900aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:39.070 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.065+0000 7f868e59c640 1 -- 172.21.15.73:0/3671403904 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869015efc0 con 0x7f869015aaf0 2023-12-19T16:18:39.072 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868e59c640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f869015aaf0 0x7f869015e600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8680006fd0 tx=0x7f868001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa0f0b50db29049 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868d59a640 1 -- 172.21.15.73:0/3671403904 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800ab670 con 0x7f869015aaf0 2023-12-19T16:18:39.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868d59a640 1 -- 172.21.15.73:0/3671403904 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800ab7d0 con 0x7f869015aaf0 2023-12-19T16:18:39.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868d59a640 1 -- 172.21.15.73:0/3671403904 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800abb60 con 0x7f869015aaf0 2023-12-19T16:18:39.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 -- 172.21.15.73:0/3671403904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f869015aaf0 msgr2=0x7f869015e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.073 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f869015aaf0 0x7f869015e600 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8680006fd0 tx=0x7f868001c4b0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 -- 172.21.15.73:0/3671403904 shutdown_connections 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 --2- 172.21.15.73:0/3671403904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f869015aaf0 0x7f869015e600 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 -- 172.21.15.73:0/3671403904 >> 172.21.15.73:0/3671403904 conn(0x7f869006a120 msgr2=0x7f869006a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 -- 172.21.15.73:0/3671403904 shutdown_connections 2023-12-19T16:18:39.074 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.069+0000 7f868f59e640 1 -- 172.21.15.73:0/3671403904 wait complete. 2023-12-19T16:18:39.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 Processor -- start 2023-12-19T16:18:39.075 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- start start 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 0x7f8690159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869015aaf0 0x7f86900c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c74e0 con 0x7f86900cb8d0 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c68d0 con 0x7f869015aaf0 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c6bb0 con 0x7f869015eb40 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 0x7f8690159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 0x7f8690159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42938/0 (socket says 172.21.15.73:42938) 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 -- 172.21.15.73:0/598744645 learned_addr learned my addr 172.21.15.73:0/598744645 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.077 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868dd9b640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869015aaf0 0x7f86900c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868ed9d640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 -- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 msgr2=0x7f86900c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f869015eb40 0x7f86900c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 -- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869015aaf0 msgr2=0x7f86900c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f869015aaf0 0x7f86900c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009480 con 0x7f86900cb8d0 2023-12-19T16:18:39.078 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868e59c640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 0x7f8690159b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8680000c10 tx=0x7f8680019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800abb40 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800abcc0 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680003860 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86900c6e90 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86900a7620 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.073+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86900cc800 con 0x7f86900cb8d0 2023-12-19T16:18:39.079 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86800039c0 con 0x7f86900cb8d0 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8670065a60 0x7f8670067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f868011e200 con 0x7f86900cb8d0 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f868dd9b640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8670065a60 0x7f8670067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f867006b960 0x7f867006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f867006e430 con 0x7f867006b960 2023-12-19T16:18:39.080 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868011e570 con 0x7f86900cb8d0 2023-12-19T16:18:39.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f868dd9b640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8670065a60 0x7f8670067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f86900b32d0 tx=0x7f8684008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f868ed9d640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f867006b960 0x7f867006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.081 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f868ed9d640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f867006b960 0x7f867006dd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.082 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.077+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== osd.5 v2:172.21.15.162:6809/38389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f867006e430 con 0x7f867006b960 2023-12-19T16:18:39.094 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.089+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 --> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f86900c7620 con 0x7f867006b960 2023-12-19T16:18:39.095 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f867effd640 1 -- 172.21.15.73:0/598744645 <== osd.5 v2:172.21.15.162:6809/38389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f86900c7620 con 0x7f867006b960 2023-12-19T16:18:39.095 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:39.095 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:39.095 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:39.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f867006b960 msgr2=0x7f867006dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.162:6809/38389,v1:172.21.15.162:6811/38389] conn(0x7f867006b960 0x7f867006dd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8670065a60 msgr2=0x7f8670067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.096 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8670065a60 0x7f8670067f20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f86900b32d0 tx=0x7f8684008040 comp rx=0 tx=0).stop 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 msgr2=0x7f8690159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 --2- 172.21.15.73:0/598744645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86900cb8d0 0x7f8690159b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8680000c10 tx=0x7f8680019250 comp rx=0 tx=0).stop 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868ed9d640 1 -- 172.21.15.73:0/598744645 reap_dead start 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 shutdown_connections 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 >> 172.21.15.73:0/598744645 conn(0x7f869006a120 msgr2=0x7f869006ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 shutdown_connections 2023-12-19T16:18:39.097 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.093+0000 7f868f59e640 1 -- 172.21.15.73:0/598744645 wait complete. 2023-12-19T16:18:39.114 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T16:18:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 Processor -- start 2023-12-19T16:18:39.252 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 -- start start 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f907c159830 0x7f907c15a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f907c0b40b0 0x7f907c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907c15ad00 con 0x7f907c0cda70 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c15e110 con 0x7f907c159830 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f9081dbc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c0cdf00 con 0x7f907c0b40b0 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f907c159830 0x7f907c15a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f907c159830 0x7f907c15a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42954/0 (socket says 172.21.15.73:42954) 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f907c0cda70 0x7f907c0cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49734/0 (socket says 172.21.15.73:49734) 2023-12-19T16:18:39.254 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 -- 172.21.15.73:0/1188689569 learned_addr learned my addr 172.21.15.73:0/1188689569 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907affd640 1 --2- 172.21.15.73:0/1188689569 >> v2:172.21.15.162:3300/0 conn(0x7f907c0b40b0 0x7f907c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 -- 172.21.15.73:0/1188689569 >> v2:172.21.15.162:3300/0 conn(0x7f907c0b40b0 msgr2=0x7f907c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 --2- 172.21.15.73:0/1188689569 >> v2:172.21.15.162:3300/0 conn(0x7f907c0b40b0 0x7f907c0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 -- 172.21.15.73:0/1188689569 >> v1:172.21.15.73:6789/0 conn(0x7f907c0cda70 legacy=0x7f907c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907b7fe640 1 -- 172.21.15.73:0/1188689569 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0ce2d0 con 0x7f907c159830 2023-12-19T16:18:39.255 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.249+0000 7f907a7fc640 1 -- 172.21.15.73:0/1188689569 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507744827 0 0) 0x7f907c15ad00 con 0x7f907c0cda70 2023-12-19T16:18:39.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f907b7fe640 1 --2- 172.21.15.73:0/1188689569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c159830 0x7f907c15a7c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b4520 tx=0x7f906c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaf4ee5aa0fa24f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f907a7fc640 1 -- 172.21.15.73:0/1188689569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0ab640 con 0x7f907c159830 2023-12-19T16:18:39.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f907a7fc640 1 -- 172.21.15.73:0/1188689569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0a7070 con 0x7f907c159830 2023-12-19T16:18:39.257 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f907a7fc640 1 -- 172.21.15.73:0/1188689569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0ab9c0 con 0x7f907c159830 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 -- 172.21.15.73:0/1188689569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c159830 msgr2=0x7f907c15a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 --2- 172.21.15.73:0/1188689569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c159830 0x7f907c15a7c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f907c0b4520 tx=0x7f906c01c440 comp rx=0 tx=0).stop 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 -- 172.21.15.73:0/1188689569 shutdown_connections 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 --2- 172.21.15.73:0/1188689569 >> v2:172.21.15.162:3300/0 conn(0x7f907c0b40b0 0x7f907c0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 --2- 172.21.15.73:0/1188689569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c159830 0x7f907c15a7c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.258 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 -- 172.21.15.73:0/1188689569 >> 172.21.15.73:0/1188689569 conn(0x7f907c0b0270 msgr2=0x7f907c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 -- 172.21.15.73:0/1188689569 shutdown_connections 2023-12-19T16:18:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.253+0000 7f9081dbc640 1 -- 172.21.15.73:0/1188689569 wait complete. 2023-12-19T16:18:39.259 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 Processor -- start 2023-12-19T16:18:39.260 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- start start 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f907c0cda70 0x7f907c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f907c159830 0x7f907c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c4480 con 0x7f907c0b40b0 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c5000 con 0x7f907c0cda70 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0c46d0 con 0x7f907c159830 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42962/0 (socket says 172.21.15.73:42962) 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 -- 172.21.15.73:0/2615778890 learned_addr learned my addr 172.21.15.73:0/2615778890 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907affd640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f907c0cda70 0x7f907c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907bfff640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f907c159830 0x7f907c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.263 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 -- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f907c159830 msgr2=0x7f907c0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f907c159830 0x7f907c0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 -- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f907c0cda70 msgr2=0x7f907c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f907c0cda70 0x7f907c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 -- 172.21.15.73:0/2615778890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0094d0 con 0x7f907c0b40b0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f907b7fe640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f906c01a070 tx=0x7f906c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0be3f0 con 0x7f907c0b40b0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0be570 con 0x7f907c0b40b0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0be920 con 0x7f907c0b40b0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c0c49b0 con 0x7f907c0b40b0 2023-12-19T16:18:39.264 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.257+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c0c2300 con 0x7f907c0b40b0 2023-12-19T16:18:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c074050 con 0x7f907c0b40b0 2023-12-19T16:18:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f906c0b43f0 con 0x7f907c0b40b0 2023-12-19T16:18:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f9063fff640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 0x7f9068067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.265 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f906c11d080 con 0x7f907c0b40b0 2023-12-19T16:18:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f907affd640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 0x7f9068067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.261+0000 7f907affd640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 0x7f9068067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f907c0cb790 tx=0x7f9070008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.269 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.265+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f906c0eacf0 con 0x7f907c0b40b0 2023-12-19T16:18:39.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f907c15dd30 con 0x7f9068065a90 2023-12-19T16:18:39.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9063fff640 1 -- 172.21.15.73:0/2615778890 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9070010960 con 0x7f9068065a90 2023-12-19T16:18:39.420 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 msgr2=0x7f9068067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 0x7f9068067f50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f907c0cb790 tx=0x7f9070008040 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 msgr2=0x7f907c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f906c01a070 tx=0x7f906c01ac80 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 shutdown_connections 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f907c159830 0x7f907c0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f907c0cda70 0x7f907c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f9068065a90 0x7f9068067f50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 --2- 172.21.15.73:0/2615778890 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f907c0b40b0 0x7f907c0c5810 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 >> 172.21.15.73:0/2615778890 conn(0x7f907c0b0270 msgr2=0x7f907c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 shutdown_connections 2023-12-19T16:18:39.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.417+0000 7f9081dbc640 1 -- 172.21.15.73:0/2615778890 wait complete. 2023-12-19T16:18:39.441 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T16:18:39.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:39.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.577+0000 7ffa11473640 1 Processor -- start 2023-12-19T16:18:39.583 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.577+0000 7ffa11473640 1 -- start start 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa11473640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c1598c0 0x7ffa0c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa11473640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa0c0b0830 0x7ffa0c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa11473640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0cce80 con 0x7ffa0c06d410 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa11473640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c06cad0 con 0x7ffa0c0b0830 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa11473640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0cc270 con 0x7ffa0c1598c0 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa0c0b0830 0x7ffa0c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa0c0b0830 0x7ffa0c0cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42964/0 (socket says 172.21.15.73:42964) 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 -- 172.21.15.73:0/246627856 learned_addr learned my addr 172.21.15.73:0/246627856 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa03fff640 1 --1- 172.21.15.73:0/246627856 >> v1:172.21.15.73:6789/0 conn(0x7ffa0c06d410 0x7ffa0c0b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49736/0 (socket says 172.21.15.73:49736) 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0affd640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c1598c0 0x7ffa0c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 -- 172.21.15.73:0/246627856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c1598c0 msgr2=0x7ffa0c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c1598c0 0x7ffa0c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.585 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 -- 172.21.15.73:0/246627856 >> v1:172.21.15.73:6789/0 conn(0x7ffa0c06d410 legacy=0x7ffa0c0b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0b7fe640 1 -- 172.21.15.73:0/246627856 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0cc550 con 0x7ffa0c0b0830 2023-12-19T16:18:39.586 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.581+0000 7ffa0a7fc640 1 -- 172.21.15.73:0/246627856 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485519887 0 0) 0x7ffa0c0cce80 con 0x7ffa0c06d410 2023-12-19T16:18:39.587 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c0b0830 0x7ffa0c0cd310 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d150 tx=0x7ffa0401ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502665be512b3d61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa0a7fc640 1 -- 172.21.15.73:0/246627856 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400b2d0 con 0x7ffa0c0b0830 2023-12-19T16:18:39.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa0a7fc640 1 -- 172.21.15.73:0/246627856 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0400b430 con 0x7ffa0c0b0830 2023-12-19T16:18:39.588 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa0a7fc640 1 -- 172.21.15.73:0/246627856 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040a7cd0 con 0x7ffa0c0b0830 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- 172.21.15.73:0/246627856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c0b0830 msgr2=0x7ffa0c0cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c0b0830 0x7ffa0c0cd310 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ffa0400d150 tx=0x7ffa0401ebe0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- 172.21.15.73:0/246627856 shutdown_connections 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c0b0830 0x7ffa0c0cd310 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 --2- 172.21.15.73:0/246627856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c1598c0 0x7ffa0c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- 172.21.15.73:0/246627856 >> 172.21.15.73:0/246627856 conn(0x7ffa0c06a570 msgr2=0x7ffa0c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- 172.21.15.73:0/246627856 shutdown_connections 2023-12-19T16:18:39.589 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- 172.21.15.73:0/246627856 wait complete. 2023-12-19T16:18:39.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 Processor -- start 2023-12-19T16:18:39.590 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.585+0000 7ffa11473640 1 -- start start 2023-12-19T16:18:39.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 0x7ffa0c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c0b0830 0x7ffa0c0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.592 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa0c1598c0 0x7ffa0c1f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c6a20 con 0x7ffa0c06d410 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c6d00 con 0x7ffa0c1598c0 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c0c6fe0 con 0x7ffa0c0b0830 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 0x7ffa0c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 0x7ffa0c0c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42972/0 (socket says 172.21.15.73:42972) 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 -- 172.21.15.73:0/2231443901 learned_addr learned my addr 172.21.15.73:0/2231443901 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa03fff640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c0b0830 0x7ffa0c0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa0c1598c0 0x7ffa0c1f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 -- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c0b0830 msgr2=0x7ffa0c0c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c0b0830 0x7ffa0c0c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 -- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa0c1598c0 msgr2=0x7ffa0c1f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa0c1598c0 0x7ffa0c1f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0400bd40 con 0x7ffa0c06d410 2023-12-19T16:18:39.593 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa0c1598c0 0x7ffa0c1f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa03fff640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffa0c0b0830 0x7ffa0c0c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa0affd640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 0x7ffa0c0c7ac0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00e870 tx=0x7ff9fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc009510 con 0x7ffa0c06d410 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00eec0 con 0x7ffa0c06d410 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0c72c0 con 0x7ffa0c06d410 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00cb40 con 0x7ffa0c06d410 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c0a76a0 con 0x7ffa0c06d410 2023-12-19T16:18:39.594 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa0c159ca0 con 0x7ffa0c06d410 2023-12-19T16:18:39.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9fc00cca0 con 0x7ffa0c06d410 2023-12-19T16:18:39.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.589+0000 7ffa037fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9ec065a60 0x7ff9ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.595 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff9fc083070 con 0x7ffa0c06d410 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa03fff640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9ec065a60 0x7ff9ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa037fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7ff9ec06b960 0x7ff9ec06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9ec06e430 con 0x7ff9ec06b960 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9fc085730 con 0x7ffa0c06d410 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7ff9ec06b960 0x7ff9ec06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa03fff640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9ec065a60 0x7ff9ec067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ada20 tx=0x7ff9f4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa0b7fe640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7ff9ec06b960 0x7ff9ec06dd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.593+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== osd.6 v2:172.21.15.162:6824/38390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff9ec06e430 con 0x7ff9ec06b960 2023-12-19T16:18:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 --> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa0c0c7770 con 0x7ff9ec06b960 2023-12-19T16:18:39.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa037fe640 1 -- 172.21.15.73:0/2231443901 <== osd.6 v2:172.21.15.162:6824/38390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffa0400b250 con 0x7ff9ec06b960 2023-12-19T16:18:39.610 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:39.610 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:39.611 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:39.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7ff9ec06b960 msgr2=0x7ff9ec06dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.162:6824/38390,v1:172.21.15.162:6825/38390] conn(0x7ff9ec06b960 0x7ff9ec06dd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9ec065a60 msgr2=0x7ff9ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7ff9ec065a60 0x7ff9ec067f20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0ada20 tx=0x7ff9f4009040 comp rx=0 tx=0).stop 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 msgr2=0x7ffa0c0c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 --2- 172.21.15.73:0/2231443901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa0c06d410 0x7ffa0c0c7ac0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc00e870 tx=0x7ff9fc00ec70 comp rx=0 tx=0).stop 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa0b7fe640 1 -- 172.21.15.73:0/2231443901 reap_dead start 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 shutdown_connections 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 >> 172.21.15.73:0/2231443901 conn(0x7ffa0c06a570 msgr2=0x7ffa0c0c27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.605+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 shutdown_connections 2023-12-19T16:18:39.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.609+0000 7ffa11473640 1 -- 172.21.15.73:0/2231443901 wait complete. 2023-12-19T16:18:39.629 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T16:18:39.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.761+0000 7f70bdbbc640 1 Processor -- start 2023-12-19T16:18:39.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.761+0000 7f70bdbbc640 1 -- start start 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70bdbbc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f70b80c9400 0x7f70b80b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70bdbbc640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b806d720 con 0x7f70b80c8fa0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70bdbbc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b815e3a0 con 0x7f70b815dfc0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70bdbbc640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b806c3a0 con 0x7f70b80c9400 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f70b80c8fa0 0x7f70b80b1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49750/0 (socket says 172.21.15.73:49750) 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b6ffd640 1 -- 172.21.15.73:0/2786472457 learned_addr learned my addr 172.21.15.73:0/2786472457 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b7fff640 1 --2- 172.21.15.73:0/2786472457 >> v2:172.21.15.162:3300/0 conn(0x7f70b80c9400 0x7f70b80b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149519721 0 0) 0x7f70b806d720 con 0x7f70b80c8fa0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a0003530 con 0x7f70b80c8fa0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b7fff640 1 -- 172.21.15.73:0/2786472457 >> v1:172.21.15.162:6789/0 conn(0x7f70b815dfc0 legacy=0x7f70b80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921471130 0 0) 0x7f70b815e3a0 con 0x7f70b815dfc0 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b7fff640 1 -- 172.21.15.73:0/2786472457 >> v1:172.21.15.73:6789/0 conn(0x7f70b80c8fa0 legacy=0x7f70b80b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.765+0000 7f70b7fff640 1 -- 172.21.15.73:0/2786472457 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b806c680 con 0x7f70b80c9400 2023-12-19T16:18:39.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70b7fff640 1 --2- 172.21.15.73:0/2786472457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b80c9400 0x7f70b80b1da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009d90 tx=0x7f70b001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16ae4adabeb00d39 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00a59e0 con 0x7f70b80c9400 2023-12-19T16:18:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00a5b40 con 0x7f70b80c9400 2023-12-19T16:18:39.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70b67fc640 1 -- 172.21.15.73:0/2786472457 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00ad440 con 0x7f70b80c9400 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- 172.21.15.73:0/2786472457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b80c9400 msgr2=0x7f70b80b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/2786472457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b80c9400 0x7f70b80b1da0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009d90 tx=0x7f70b001c920 comp rx=0 tx=0).stop 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- 172.21.15.73:0/2786472457 shutdown_connections 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/2786472457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b80c9400 0x7f70b80b1da0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- 172.21.15.73:0/2786472457 >> 172.21.15.73:0/2786472457 conn(0x7f70b80b0270 msgr2=0x7f70b80b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- 172.21.15.73:0/2786472457 shutdown_connections 2023-12-19T16:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- 172.21.15.73:0/2786472457 wait complete. 2023-12-19T16:18:39.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 Processor -- start 2023-12-19T16:18:39.774 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.769+0000 7f70bdbbc640 1 -- start start 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 0x7f70b814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 0x7f70b8155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8154f00 con 0x7f70b80c9400 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b814cf50 con 0x7f70b815dfc0 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81f9310 con 0x7f70b80c8fa0 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42982/0 (socket says 172.21.15.73:42982) 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 -- 172.21.15.73:0/697912940 learned_addr learned my addr 172.21.15.73:0/697912940 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b7fff640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 0x7f70b8155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b77fe640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 0x7f70b814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 -- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 msgr2=0x7f70b814ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 0x7f70b814ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 -- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 msgr2=0x7f70b8155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 0x7f70b8155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 -- 172.21.15.73:0/697912940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b0009a70 con 0x7f70b80c9400 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b7fff640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 0x7f70b8155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b77fe640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 0x7f70b814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70b6ffd640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0010f0 tx=0x7f70ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac005cf0 con 0x7f70b80c9400 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac005e70 con 0x7f70b80c9400 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b81f95f0 con 0x7f70b80c9400 2023-12-19T16:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac0072d0 con 0x7f70b80c9400 2023-12-19T16:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b81f9000 con 0x7f70b80c9400 2023-12-19T16:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b81550b0 con 0x7f70b80c9400 2023-12-19T16:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.773+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70ac007430 con 0x7f70b80c9400 2023-12-19T16:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.777+0000 7f709ffff640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 0x7f70a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.777+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f70ac082550 con 0x7f70b80c9400 2023-12-19T16:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.777+0000 7f70b77fe640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 0x7f70a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.777+0000 7f70b77fe640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 0x7f70a4067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f70 tx=0x7f70a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:39.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.781+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f70ac050110 con 0x7f70b80c9400 2023-12-19T16:18:39.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.929+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b806d200 con 0x7f70a4065a60 2023-12-19T16:18:39.934 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.929+0000 7f709ffff640 1 -- 172.21.15.73:0/697912940 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70a80013e0 con 0x7f70a4065a60 2023-12-19T16:18:39.934 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T16:18:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 msgr2=0x7f70a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 0x7f70a4067f20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000f70 tx=0x7f70a8009040 comp rx=0 tx=0).stop 2023-12-19T16:18:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 msgr2=0x7f70b81f8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:39.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0010f0 tx=0x7f70ac00c890 comp rx=0 tx=0).stop 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 shutdown_connections 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70b815dfc0 0x7f70b8155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f70a4065a60 0x7f70a4067f20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70b80c9400 0x7f70b81f8ac0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 --2- 172.21.15.73:0/697912940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70b80c8fa0 0x7f70b814ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 >> 172.21.15.73:0/697912940 conn(0x7f70b80b0270 msgr2=0x7f70b8070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 shutdown_connections 2023-12-19T16:18:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:39.933+0000 7f70bdbbc640 1 -- 172.21.15.73:0/697912940 wait complete. 2023-12-19T16:18:39.957 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T16:18:39.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T16:18:40.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.093+0000 7f8c398f2640 1 Processor -- start 2023-12-19T16:18:40.099 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.093+0000 7f8c398f2640 1 -- start start 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c398f2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c34159230 0x7f8c340ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c398f2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340ca9f0 con 0x7f8c340cd520 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c398f2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340c9760 con 0x7f8c340cc160 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c398f2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c340c99d0 con 0x7f8c34159230 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c337fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8c340cd520 0x7f8c3406bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49752/0 (socket says 172.21.15.73:49752) 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c337fe640 1 -- 172.21.15.73:0/3855385644 learned_addr learned my addr 172.21.15.73:0/3855385644 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:18:40.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c32ffd640 1 --2- 172.21.15.73:0/3855385644 >> v2:172.21.15.162:3300/0 conn(0x7f8c34159230 0x7f8c340ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107162911 0 0) 0x7f8c2c0014a0 con 0x7f8c340cd520 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c1c003450 con 0x7f8c340cd520 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081123987 0 0) 0x7f8c340c9760 con 0x7f8c340cc160 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c0014a0 con 0x7f8c340cc160 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2526854151 0 0) 0x7f8c1c003450 con 0x7f8c340cd520 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c32ffd640 1 -- 172.21.15.73:0/3855385644 >> v1:172.21.15.162:6789/0 conn(0x7f8c340cc160 legacy=0x7f8c340cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c32ffd640 1 -- 172.21.15.73:0/3855385644 >> v1:172.21.15.73:6789/0 conn(0x7f8c340cd520 legacy=0x7f8c3406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.103 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.097+0000 7f8c32ffd640 1 -- 172.21.15.73:0/3855385644 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c340c9cb0 con 0x7f8c34159230 2023-12-19T16:18:40.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c32ffd640 1 --2- 172.21.15.73:0/3855385644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c34159230 0x7f8c340ca4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c240097c0 tx=0x7f8c2401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b668bb8e52572d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c001b90 con 0x7f8c34159230 2023-12-19T16:18:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240a7050 con 0x7f8c34159230 2023-12-19T16:18:40.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c31ffb640 1 -- 172.21.15.73:0/3855385644 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240ab620 con 0x7f8c34159230 2023-12-19T16:18:40.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- 172.21.15.73:0/3855385644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c34159230 msgr2=0x7f8c340ca4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 --2- 172.21.15.73:0/3855385644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c34159230 0x7f8c340ca4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8c240097c0 tx=0x7f8c2401c370 comp rx=0 tx=0).stop 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- 172.21.15.73:0/3855385644 shutdown_connections 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 --2- 172.21.15.73:0/3855385644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c34159230 0x7f8c340ca4b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- 172.21.15.73:0/3855385644 >> 172.21.15.73:0/3855385644 conn(0x7f8c3406a570 msgr2=0x7f8c340ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- 172.21.15.73:0/3855385644 shutdown_connections 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- 172.21.15.73:0/3855385644 wait complete. 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 Processor -- start 2023-12-19T16:18:40.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.101+0000 7f8c398f2640 1 -- start start 2023-12-19T16:18:40.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c340cc160 0x7f8c340c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 0x7f8c340af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340af9a0 0x7f8c341f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340b3600 con 0x7f8c340cd520 2023-12-19T16:18:40.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340afe50 con 0x7f8c340cc160 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340b2980 con 0x7f8c340af9a0 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 0x7f8c340af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 0x7f8c340af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42984/0 (socket says 172.21.15.73:42984) 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 -- 172.21.15.73:0/590880543 learned_addr learned my addr 172.21.15.73:0/590880543 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c32ffd640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c340cc160 0x7f8c340c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c337fe640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340af9a0 0x7f8c341f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 -- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340af9a0 msgr2=0x7f8c341f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340af9a0 0x7f8c341f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 -- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c340cc160 msgr2=0x7f8c340c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c340cc160 0x7f8c340c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009420 con 0x7f8c340cd520 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c337fe640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c340af9a0 0x7f8c341f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c327fc640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 0x7f8c340af460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c430 tx=0x7f8c2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.113 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280052d0 con 0x7f8c340cd520 2023-12-19T16:18:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28005450 con 0x7f8c340cd520 2023-12-19T16:18:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28003840 con 0x7f8c340cd520 2023-12-19T16:18:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c340b2c60 con 0x7f8c340cd520 2023-12-19T16:18:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c340b3220 con 0x7f8c340cd520 2023-12-19T16:18:40.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.105+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c3406c6a0 con 0x7f8c340cd520 2023-12-19T16:18:40.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8c280039a0 con 0x7f8c340cd520 2023-12-19T16:18:40.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8c20065a60 0x7f8c20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8c280824a0 con 0x7f8c340cd520 2023-12-19T16:18:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c32ffd640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8c20065a60 0x7f8c20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f8c2006b960 0x7f8c2006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c2006e430 con 0x7f8c2006b960 2023-12-19T16:18:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c28084a80 con 0x7f8c340cd520 2023-12-19T16:18:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c337fe640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f8c2006b960 0x7f8c2006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c32ffd640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8c20065a60 0x7f8c20067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c240ad000 tx=0x7f8c240a6000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c337fe640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f8c2006b960 0x7f8c2006dd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.109+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== osd.7 v2:172.21.15.162:6808/38391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8c2006e430 con 0x7f8c2006b960 2023-12-19T16:18:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.121+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 --> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c340b3740 con 0x7f8c2006b960 2023-12-19T16:18:40.127 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.121+0000 7f8c1bfff640 1 -- 172.21.15.73:0/590880543 <== osd.7 v2:172.21.15.162:6808/38391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8c340b3740 con 0x7f8c2006b960 2023-12-19T16:18:40.127 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T16:18:40.127 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T16:18:40.127 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f8c2006b960 msgr2=0x7f8c2006dd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.162:6808/38391,v1:172.21.15.162:6810/38391] conn(0x7f8c2006b960 0x7f8c2006dd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8c20065a60 msgr2=0x7f8c20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f8c20065a60 0x7f8c20067f20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8c240ad000 tx=0x7f8c240a6000 comp rx=0 tx=0).stop 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 msgr2=0x7f8c340af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 --2- 172.21.15.73:0/590880543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8c340cd520 0x7f8c340af460 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c430 tx=0x7f8c2800c8f0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c337fe640 1 -- 172.21.15.73:0/590880543 reap_dead start 2023-12-19T16:18:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 shutdown_connections 2023-12-19T16:18:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 >> 172.21.15.73:0/590880543 conn(0x7f8c3406a570 msgr2=0x7f8c340ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 shutdown_connections 2023-12-19T16:18:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.125+0000 7f8c398f2640 1 -- 172.21.15.73:0/590880543 wait complete. 2023-12-19T16:18:40.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T16:18:40.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 Processor -- start 2023-12-19T16:18:40.284 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 -- start start 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0580cd7b0 0x7fa05806b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580b1a40 con 0x7fa0580b0920 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580d1760 con 0x7fa05806bf50 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05f109640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580b0e30 con 0x7fa0580cd7b0 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0580cd7b0 0x7fa05806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa0580cd7b0 0x7fa05806b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42990/0 (socket says 172.21.15.73:42990) 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 -- 172.21.15.73:0/2712742495 learned_addr learned my addr 172.21.15.73:0/2712742495 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa04ffff640 1 --1- 172.21.15.73:0/2712742495 >> v1:172.21.15.73:6789/0 conn(0x7fa0580b0920 0x7fa05806b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49764/0 (socket says 172.21.15.73:49764) 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 -- 172.21.15.73:0/2712742495 >> v1:172.21.15.162:6789/0 conn(0x7fa05806bf50 legacy=0x7fa0580ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:40.286 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 -- 172.21.15.73:0/2712742495 >> v1:172.21.15.73:6789/0 conn(0x7fa0580b0920 legacy=0x7fa05806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.287 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.281+0000 7fa05cea5640 1 -- 172.21.15.73:0/2712742495 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0580b1110 con 0x7fa0580cd7b0 2023-12-19T16:18:40.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05cea5640 1 --2- 172.21.15.73:0/2712742495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580cd7b0 0x7fa05806b160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa0580ae3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e805a35bf44fc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa04f7fe640 1 -- 172.21.15.73:0/2712742495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540ab5f0 con 0x7fa0580cd7b0 2023-12-19T16:18:40.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa04f7fe640 1 -- 172.21.15.73:0/2712742495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540ab750 con 0x7fa0580cd7b0 2023-12-19T16:18:40.289 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa04f7fe640 1 -- 172.21.15.73:0/2712742495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540abae0 con 0x7fa0580cd7b0 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 -- 172.21.15.73:0/2712742495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580cd7b0 msgr2=0x7fa05806b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 --2- 172.21.15.73:0/2712742495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580cd7b0 0x7fa05806b160 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa054009870 tx=0x7fa0580ae3a0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 -- 172.21.15.73:0/2712742495 shutdown_connections 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 --2- 172.21.15.73:0/2712742495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580cd7b0 0x7fa05806b160 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 -- 172.21.15.73:0/2712742495 >> 172.21.15.73:0/2712742495 conn(0x7fa0580d08f0 msgr2=0x7fa0580d0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.290 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 -- 172.21.15.73:0/2712742495 shutdown_connections 2023-12-19T16:18:40.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.285+0000 7fa05f109640 1 -- 172.21.15.73:0/2712742495 wait complete. 2023-12-19T16:18:40.291 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 Processor -- start 2023-12-19T16:18:40.292 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- start start 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 0x7fa0581f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0580cd7b0 0x7fa05814ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058151770 con 0x7fa0580b0920 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580c8d10 con 0x7fa0580cd7b0 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580c8470 con 0x7fa05806bf50 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42992/0 (socket says 172.21.15.73:42992) 2023-12-19T16:18:40.294 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 -- 172.21.15.73:0/3602180618 learned_addr learned my addr 172.21.15.73:0/3602180618 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05cea5640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 0x7fa0581f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05d6a6640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0580cd7b0 0x7fa05814ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 -- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 msgr2=0x7fa0581f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 0x7fa0581f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 -- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0580cd7b0 msgr2=0x7fa05814ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0580cd7b0 0x7fa05814ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 -- 172.21.15.73:0/3602180618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540094d0 con 0x7fa0580b0920 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05cea5640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 0x7fa0581f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04ffff640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c4c0 tx=0x7fa04800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048007480 con 0x7fa0580b0920 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0480075e0 con 0x7fa0580b0920 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa048004a10 con 0x7fa0580b0920 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580cdd10 con 0x7fa0580b0920 2023-12-19T16:18:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580c8a30 con 0x7fa0580b0920 2023-12-19T16:18:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.289+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058151920 con 0x7fa0580b0920 2023-12-19T16:18:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.293+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa048004b70 con 0x7fa0580b0920 2023-12-19T16:18:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.293+0000 7fa04d7fa640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 0x7fa044067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.293+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa048082030 con 0x7fa0580b0920 2023-12-19T16:18:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.293+0000 7fa05cea5640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 0x7fa044067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.293+0000 7fa05cea5640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 0x7fa044067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa054004740 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.297+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa058151920 con 0x7fa0580b0920 2023-12-19T16:18:40.451 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0580cdb90 con 0x7fa044065a60 2023-12-19T16:18:40.452 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa04d7fa640 1 -- 172.21.15.73:0/3602180618 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0540ab9c0 con 0x7fa044065a60 2023-12-19T16:18:40.452 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 msgr2=0x7fa044067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 0x7fa044067f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa054004740 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 msgr2=0x7fa058153c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c4c0 tx=0x7fa04800c980 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 shutdown_connections 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0580cd7b0 0x7fa05814ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa044065a60 0x7fa044067f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0580b0920 0x7fa058153c50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 --2- 172.21.15.73:0/3602180618 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa05806bf50 0x7fa0581f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 >> 172.21.15.73:0/3602180618 conn(0x7fa0580d08f0 msgr2=0x7fa0580afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 shutdown_connections 2023-12-19T16:18:40.454 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.449+0000 7fa05f109640 1 -- 172.21.15.73:0/3602180618 wait complete. 2023-12-19T16:18:40.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:18:40.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.605+0000 7fa79c6b6640 1 Processor -- start 2023-12-19T16:18:40.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.605+0000 7fa79c6b6640 1 -- start start 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79c6b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa79406ddf0 0x7fa7940cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79c6b6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940ca6f0 con 0x7fa79406d1a0 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79c6b6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa794070f50 con 0x7fa7940cbe90 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79c6b6640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940cccb0 con 0x7fa79406ddf0 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa79406ddf0 0x7fa7940cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa79406ddf0 0x7fa7940cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43006/0 (socket says 172.21.15.73:43006) 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79ac53640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa79406d1a0 0x7fa794070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49774/0 (socket says 172.21.15.73:49774) 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 -- 172.21.15.73:0/1920889686 learned_addr learned my addr 172.21.15.73:0/1920889686 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 -- 172.21.15.73:0/1920889686 >> v1:172.21.15.162:6789/0 conn(0x7fa7940cbe90 legacy=0x7fa794070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 -- 172.21.15.73:0/1920889686 >> v1:172.21.15.73:6789/0 conn(0x7fa79406d1a0 legacy=0x7fa794070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.613 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 -- 172.21.15.73:0/1920889686 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794159530 con 0x7fa79406ddf0 2023-12-19T16:18:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.609+0000 7fa79a452640 1 --2- 172.21.15.73:0/1920889686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa79406ddf0 0x7fa7940cce70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa79000aa10 tx=0x7fa79001e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a117092d5af093 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa799450640 1 -- 172.21.15.73:0/1920889686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900a7a80 con 0x7fa79406ddf0 2023-12-19T16:18:40.615 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa799450640 1 -- 172.21.15.73:0/1920889686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900a7be0 con 0x7fa79406ddf0 2023-12-19T16:18:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa799450640 1 -- 172.21.15.73:0/1920889686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900af440 con 0x7fa79406ddf0 2023-12-19T16:18:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- 172.21.15.73:0/1920889686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa79406ddf0 msgr2=0x7fa7940cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.616 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/1920889686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa79406ddf0 0x7fa7940cce70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa79000aa10 tx=0x7fa79001e9b0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- 172.21.15.73:0/1920889686 shutdown_connections 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/1920889686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa79406ddf0 0x7fa7940cce70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- 172.21.15.73:0/1920889686 >> 172.21.15.73:0/1920889686 conn(0x7fa7940b0270 msgr2=0x7fa7940b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- 172.21.15.73:0/1920889686 shutdown_connections 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- 172.21.15.73:0/1920889686 wait complete. 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 Processor -- start 2023-12-19T16:18:40.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- start start 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa79406d1a0 0x7fa7940c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa79406ddf0 0x7fa794153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c2d50 con 0x7fa7940cbe90 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c3030 con 0x7fa79406d1a0 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79c6b6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c3310 con 0x7fa79406ddf0 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79ac53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79ac53640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43020/0 (socket says 172.21.15.73:43020) 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79ac53640 1 -- 172.21.15.73:0/3917719373 learned_addr learned my addr 172.21.15.73:0/3917719373 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:18:40.620 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa799c51640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa79406ddf0 0x7fa794153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.613+0000 7fa79a452640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa79406d1a0 0x7fa7940c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 -- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa79406ddf0 msgr2=0x7fa794153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa79406ddf0 0x7fa794153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 -- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa79406d1a0 msgr2=0x7fa7940c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa79406d1a0 0x7fa7940c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 -- 172.21.15.73:0/3917719373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79000a670 con 0x7fa7940cbe90 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79ac53640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c7a0 tx=0x7fa78c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00a640 con 0x7fa7940cbe90 2023-12-19T16:18:40.621 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00a7a0 con 0x7fa7940cbe90 2023-12-19T16:18:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00ab10 con 0x7fa7940cbe90 2023-12-19T16:18:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7940c35f0 con 0x7fa7940cbe90 2023-12-19T16:18:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa794153b60 con 0x7fa7940cbe90 2023-12-19T16:18:40.622 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7940c3b10 con 0x7fa7940cbe90 2023-12-19T16:18:40.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa78c00ac70 con 0x7fa7940cbe90 2023-12-19T16:18:40.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:18:40.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa78c082640 con 0x7fa7940cbe90 2023-12-19T16:18:40.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.617+0000 7fa79a452640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:18:40.623 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.621+0000 7fa79a452640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 0x7fa778067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b1000 tx=0x7fa7900a9070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:18:40.627 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.621+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa7940c3b10 con 0x7fa7940cbe90 2023-12-19T16:18:40.776 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.768+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7940ca0a0 con 0x7fa778065a60 2023-12-19T16:18:40.777 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.772+0000 7fa78affd640 1 -- 172.21.15.73:0/3917719373 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50648 (secure 0 0 0) 0x7fa7900bd070 con 0x7fa778065a60 2023-12-19T16:18:40.778 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:18:40.778 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:18:40.779 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 msgr2=0x7fa778067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 0x7fa778067f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa7900b1000 tx=0x7fa7900a9070 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 msgr2=0x7fa7940c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00c7a0 tx=0x7fa78c00cc60 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 shutdown_connections 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7940cbe90 0x7fa7940c2250 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa79406ddf0 0x7fa794153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 --2- 172.21.15.73:0/3917719373 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa79406d1a0 0x7fa7940c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 >> 172.21.15.73:0/3917719373 conn(0x7fa7940b0270 msgr2=0x7fa794159740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 shutdown_connections 2023-12-19T16:18:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:18:40.776+0000 7fa79c6b6640 1 -- 172.21.15.73:0/3917719373 wait complete. 2023-12-19T16:18:40.798 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2023-12-19T16:18:40.486094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":226504,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754748216,"statfs":{"total":773094113280,"available":772862173184,"internally_reserved":0,"allocated":6955008,"data_stored":3597752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-7,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.592297"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":194,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-19T16:18:32.897677+0000","last_change":"2023-12-19T16:15:30.146771+0000","last_active":"2023-12-19T16:18:32.897677+0000","last_peered":"2023-12-19T16:18:32.897677+0000","last_clean":"2023-12-19T16:18:32.897677+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:18:32.897677+0000","last_undegraded":"2023-12-19T16:18:32.897677+0000","last_fullsized":"2023-12-19T16:18:32.897677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T16:15:28.916864+0000","last_clean_scrub_stamp":"2023-12-19T16:15:28.916864+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41099999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58599999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.372},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.997,"15min":0.997},"last":0.70599999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.67400000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.47899999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88300000000000001,"5min":1.542,"15min":1.542},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.272,"15min":1.272},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89300000000000002,"5min":1.581,"15min":1.581},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0780000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.61499999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476778,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54200000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.376},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.495,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":2.395,"15min":2.395},"last":0.34499999999999997}]},{"osd":1,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.55500000000000005,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.441},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48499999999999999}]},{"osd":3,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72199999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.41099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.872},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":3.407,"15min":3.407},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.94199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.056,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.88500000000000001}]},{"osd":5,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.84499999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.1679999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88500000000000001,"15min":0.93700000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1419999999999999,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.036,"5min":1.758,"15min":1.758},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.872,"15min":0.91000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86499999999999999,"15min":0.90300000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80700000000000005,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.119,"5min":1.835,"15min":1.835},"last":0.75800000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476778,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.625,"15min":0.66400000000000003},"min":{"1min":0.28000000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52900000000000003,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.83199999999999996,"15min":0.89100000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":4.593,"15min":4.593},"last":0.39800000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.54800000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63900000000000001,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.627,"15min":0.65200000000000002},"min":{"1min":0.35299999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63800000000000001,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.52200000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.72099999999999997,"15min":0.751},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73499999999999999,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.496},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.72399999999999998,"15min":0.75900000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77900000000000003,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.88600000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91300000000000003,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.88},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.89900000000000002,"15min":0.91500000000000004},"min":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.97999999999999998,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.86099999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.94799999999999995,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.92100000000000004,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.87,"15min":0.88400000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.093,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.88100000000000001,"15min":0.90200000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":0.94099999999999995,"5min":3.052,"15min":3.052},"last":0.79800000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.93799999999999994,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94899999999999995,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.90200000000000002,"15min":0.92200000000000004},"min":{"1min":0.56499999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.96299999999999997,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.81899999999999995}]}]},{"osd":0,"up_from":16,"seq":68719476777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72799999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46400000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":1.026,"15min":1.026},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.60899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.232,"15min":1.232},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.252,"15min":1.252},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.52100000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.083,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.80900000000000005}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.61499999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.03,"5min":1.198,"15min":1.198},"last":0.71099999999999997}]}]},{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.68999999999999995},"min":{"1min":0.55400000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.878,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91600000000000004,"5min":4.008,"15min":4.008},"last":0.65800000000000003}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.80200000000000005,"15min":0.85499999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.625}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.036,"15min":1.036},"last":0.69699999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.59999999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86199999999999999,"5min":1.048,"15min":1.048},"last":0.56299999999999994}]},{"osd":5,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.72699999999999998,"15min":0.77300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91200000000000003,"5min":1.085,"15min":1.085},"last":0.50800000000000001}]},{"osd":6,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.84799999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.752,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.66800000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.51400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.628},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86899999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.59699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.68100000000000005}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70599999999999996},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95299999999999996,"5min":1.056,"15min":1.056},"last":0.72199999999999998}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.52500000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90900000000000003,"5min":0.998,"15min":0.998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93700000000000006,"5min":1.091,"15min":1.091},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70899999999999996,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89600000000000002,"5min":1.075,"15min":1.075},"last":0.747},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73499999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88600000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.78900000000000003,"15min":0.84799999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98599999999999999,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94799999999999995,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.64700000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.79100000000000004},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90400000000000003,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.755},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53400000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.90600000000000003,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.67200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.74099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31752,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.82799999999999996,"15min":0.89000000000000001},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.504}]},{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98599999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.871,"15min":0.92900000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.875,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.702,"15min":1.702},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86899999999999999,"15min":0.93700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94099999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.92700000000000005,"15min":0.996},"min":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.95399999999999996,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.92800000000000005},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.96699999999999997,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84199999999999997,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.93400000000000005,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95299999999999996,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:18:40.802 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T16:15:28.916864+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=16, tm_min=15, tm_sec=28, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=16, tm_min=18, tm_sec=35, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T16:18:40.802 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T16:19:00.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T16:19:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.936+0000 7f4454d25640 1 Processor -- start 2023-12-19T16:19:00.943 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 -- start start 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4450159830 0x7f445015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44500cdc40 0x7f44500ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f445015ad00 con 0x7f44500b40b0 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445015e110 con 0x7f44500cdc40 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f4454d25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500ce2d0 con 0x7f4450159830 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44500cdc40 0x7f44500ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f44500cdc40 0x7f44500ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48866/0 (socket says 172.21.15.73:48866) 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444dd9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f44500b40b0 0x7f44500cd530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57480/0 (socket says 172.21.15.73:57480) 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 -- 172.21.15.73:0/3829277580 learned_addr learned my addr 172.21.15.73:0/3829277580 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:19:00.945 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444e59c640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4450159830 0x7f445015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 -- 172.21.15.73:0/3829277580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4450159830 msgr2=0x7f445015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:19:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4450159830 0x7f445015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 -- 172.21.15.73:0/3829277580 >> v1:172.21.15.73:6789/0 conn(0x7f44500b40b0 legacy=0x7f44500cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444ed9d640 1 -- 172.21.15.73:0/3829277580 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445015d490 con 0x7f44500cdc40 2023-12-19T16:19:00.946 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.940+0000 7f444d59a640 1 -- 172.21.15.73:0/3829277580 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903100104 0 0) 0x7f445015ad00 con 0x7f44500b40b0 2023-12-19T16:19:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f444ed9d640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500cdc40 0x7f44500ca080 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6736d306e63df7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f444d59a640 1 -- 172.21.15.73:0/3829277580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480a5810 con 0x7f44500cdc40 2023-12-19T16:19:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f444d59a640 1 -- 172.21.15.73:0/3829277580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44480a5970 con 0x7f44500cdc40 2023-12-19T16:19:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f444d59a640 1 -- 172.21.15.73:0/3829277580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480a5d00 con 0x7f44500cdc40 2023-12-19T16:19:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 -- 172.21.15.73:0/3829277580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500cdc40 msgr2=0x7f44500ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500cdc40 0x7f44500ca080 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4448009e50 tx=0x7f444801c950 comp rx=0 tx=0).stop 2023-12-19T16:19:00.949 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 -- 172.21.15.73:0/3829277580 shutdown_connections 2023-12-19T16:19:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f44500cdc40 0x7f44500ca080 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 --2- 172.21.15.73:0/3829277580 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4450159830 0x7f445015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 -- 172.21.15.73:0/3829277580 >> 172.21.15.73:0/3829277580 conn(0x7f44500b0270 msgr2=0x7f44500b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 -- 172.21.15.73:0/3829277580 shutdown_connections 2023-12-19T16:19:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 -- 172.21.15.73:0/3829277580 wait complete. 2023-12-19T16:19:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.944+0000 7f4454d25640 1 Processor -- start 2023-12-19T16:19:00.951 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- start start 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44500b40b0 0x7f4450158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 0x7f44500c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4450153660 con 0x7f4450159830 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501575f0 con 0x7f44500cdc40 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44501578b0 con 0x7f44500b40b0 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48878/0 (socket says 172.21.15.73:48878) 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 -- 172.21.15.73:0/3265102797 learned_addr learned my addr 172.21.15.73:0/3265102797 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:19:00.953 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444e59c640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44500b40b0 0x7f4450158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444dd9b640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 0x7f44500c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 -- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44500b40b0 msgr2=0x7f4450158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44500b40b0 0x7f4450158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 -- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 msgr2=0x7f44500c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 0x7f44500c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 -- 172.21.15.73:0/3265102797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448009b30 con 0x7f4450159830 2023-12-19T16:19:00.954 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444dd9b640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 0x7f44500c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f444ed9d640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f44480af040 tx=0x7f44480196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480b8470 con 0x7f4450159830 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44480b85d0 con 0x7f4450159830 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480b8960 con 0x7f4450159830 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44501538b0 con 0x7f4450159830 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4450151c70 con 0x7f4450159830 2023-12-19T16:19:00.955 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.948+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450074050 con 0x7f4450159830 2023-12-19T16:19:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.952+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f44480b8ac0 con 0x7f4450159830 2023-12-19T16:19:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.952+0000 7f443effd640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 0x7f4430067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.952+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f444811de80 con 0x7f4450159830 2023-12-19T16:19:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.952+0000 7f444e59c640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 0x7f4430067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:00.957 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.952+0000 7f444e59c640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 0x7f4430067f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4440009ac0 tx=0x7f4440009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:00.960 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:00.956+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f44480eba40 con 0x7f4450159830 2023-12-19T16:19:01.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.100+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 --> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4450159c10 con 0x7f4430065a90 2023-12-19T16:19:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f443effd640 1 -- 172.21.15.73:0/3265102797 <== mgr.4109 v2:172.21.15.73:6832/38117 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50497 (secure 0 0 0) 0x7f44400119e0 con 0x7f4430065a90 2023-12-19T16:19:01.108 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:19:01.109 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 msgr2=0x7f4430067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 0x7f4430067f50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4440009ac0 tx=0x7f4440009190 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 msgr2=0x7f4450152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f44480af040 tx=0x7f44480196f0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 shutdown_connections 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4430065a90 0x7f4430067f50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4450159830 0x7f4450152a20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44500cdc40 0x7f44500c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 --2- 172.21.15.73:0/3265102797 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44500b40b0 0x7f4450158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 >> 172.21.15.73:0/3265102797 conn(0x7f44500b0270 msgr2=0x7f4450070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 shutdown_connections 2023-12-19T16:19:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.104+0000 7f4454d25640 1 -- 172.21.15.73:0/3265102797 wait complete. 2023-12-19T16:19:01.128 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2023-12-19T16:19:00.490471+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":230600,"kb_used_data":6792,"kb_used_omap":0,"kb_used_meta":223744,"kb_avail":754744120,"statfs":{"total":773094113280,"available":772857978880,"internally_reserved":0,"allocated":6955008,"data_stored":3597752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":229113856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003036"},"pg_stats":[{"pgid":"1.0","version":"61'119","reported_seq":207,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-12-19T16:18:41.256328+0000","last_change":"2023-12-19T16:18:41.256456+0000","last_active":"2023-12-19T16:18:41.256328+0000","last_peered":"2023-12-19T16:18:41.256328+0000","last_clean":"2023-12-19T16:18:41.256328+0000","last_became_active":"2023-12-19T16:15:30.145692+0000","last_became_peered":"2023-12-19T16:15:30.145692+0000","last_unstale":"2023-12-19T16:18:41.256328+0000","last_undegraded":"2023-12-19T16:18:41.256328+0000","last_fullsized":"2023-12-19T16:18:41.256328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'119","last_scrub_stamp":"2023-12-19T16:18:41.256309+0000","last_deep_scrub":"61'119","last_deep_scrub_stamp":"2023-12-19T16:18:41.256309+0000","last_clean_scrub_stamp":"2023-12-19T16:18:41.256309+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:49:27.625383+0000","scrub_duration":0.0069937660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.42099999999999999,"15min":0.437},"min":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.69999999999999996,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58599999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73499999999999999,"5min":0.997,"15min":0.997},"last":0.64600000000000002}]},{"osd":2,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.53800000000000003},"min":{"1min":0.39100000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.04,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89500000000000002,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.754}]},{"osd":5,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.75700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53500000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88300000000000001,"5min":1.542,"15min":1.542},"last":0.80800000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.99399999999999999,"5min":1.272,"15min":1.272},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.98299999999999998,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.66900000000000004}]},{"osd":7,"last update":"Tue Dec 19 16:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55900000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89300000000000002,"5min":1.581,"15min":1.581},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82199999999999995,"15min":0.83999999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0780000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.73699999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.432,"15min":0.439},"min":{"1min":0.29699999999999999,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.54200000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.502},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.495,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":2.395,"15min":2.395},"last":0.63900000000000001}]},{"osd":1,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.55500000000000005,"15min":0.58399999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.63,"15min":0.67300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72199999999999998,"5min":2.9089999999999998,"15min":2.9089999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.41099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.378}]},{"osd":4,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.872},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":3.407,"15min":3.407},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.88200000000000001,"15min":0.94199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.056,"5min":3.5670000000000002,"15min":3.5670000000000002},"last":0.70799999999999996}]},{"osd":5,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82399999999999995,"15min":0.84499999999999997},"min":{"1min":0.59499999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.1679999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.62},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.88500000000000001,"15min":0.93700000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1419999999999999,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.036,"5min":1.758,"15min":1.758},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.872,"15min":0.91000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.081,"5min":3.9729999999999999,"15min":3.9729999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Tue Dec 19 16:18:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.86499999999999999,"15min":0.90300000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0169999999999999,"5min":3.2309999999999999,"15min":3.2309999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.80700000000000005,"15min":0.83399999999999996},"min":{"1min":0.54300000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.119,"5min":1.835,"15min":1.835},"last":0.66900000000000004}]}]},{"osd":1,"up_from":16,"seq":68719476782,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.57499999999999996,"15min":0.64700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56799999999999995,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.73899999999999999,"15min":0.85999999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.59799999999999998,"5min":4.593,"15min":4.593},"last":0.38700000000000001}]},{"osd":2,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.52000000000000002,"15min":0.55300000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57599999999999996,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59199999999999997,"15min":0.64000000000000001},"min":{"1min":0.38500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.623,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.67600000000000005,"15min":0.73599999999999999},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.66300000000000003,"5min":4.3170000000000002,"15min":4.3170000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.66900000000000004,"15min":0.74099999999999999},"min":{"1min":0.40200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.75800000000000001,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":0.436}]},{"osd":4,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.86599999999999999,"15min":0.90000000000000002},"min":{"1min":0.63600000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.026,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.877,"15min":0.90800000000000003},"min":{"1min":0.64000000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.01,"5min":3.0059999999999998,"15min":3.0059999999999998},"last":0.97799999999999998}]},{"osd":5,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.90300000000000002,"15min":0.96599999999999997},"min":{"1min":0.60399999999999998,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95999999999999996,"5min":4.3659999999999997,"15min":4.3659999999999997},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.84199999999999997,"15min":0.875},"min":{"1min":0.59599999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":2.8879999999999999,"15min":2.8879999999999999},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.85699999999999998,"15min":0.89400000000000002},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.004,"5min":2.9860000000000002,"15min":2.9860000000000002},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.84699999999999998,"15min":0.89000000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.92800000000000005,"5min":3.052,"15min":3.052},"last":0.95399999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:18:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.89100000000000001,"15min":0.95499999999999996},"min":{"1min":0.54100000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.998,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.877,"15min":0.91300000000000003},"min":{"1min":0.66200000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0289999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.80600000000000005}]}]},{"osd":0,"up_from":16,"seq":68719476781,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.42799999999999999,"15min":0.44},"min":{"1min":0.25800000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60099999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.72799999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57799999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72299999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.437},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.499,"15min":0.51100000000000001},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.68100000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47999999999999998}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.33100000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.65300000000000002,"5min":1.026,"15min":1.026},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.60899999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.232,"15min":1.232},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72199999999999998,"15min":0.71299999999999997},"min":{"1min":0.57399999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0309999999999999,"5min":1.252,"15min":1.252},"last":0.79900000000000004}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76300000000000001,"15min":0.747},"min":{"1min":0.52100000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.083,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.83399999999999996}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.56899999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.73799999999999999},"min":{"1min":0.59299999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.73399999999999999,"15min":0.71999999999999997},"min":{"1min":0.61499999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.03,"5min":1.198,"15min":1.198},"last":0.872}]}]},{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.68999999999999995},"min":{"1min":0.55400000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.878,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.82199999999999995,"15min":0.877},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91600000000000004,"5min":4.008,"15min":4.008},"last":0.66600000000000004}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.80200000000000005,"15min":0.85499999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89000000000000001,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70599999999999996,"15min":0.71599999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94899999999999995,"5min":1.036,"15min":1.036},"last":0.749}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90300000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.69399999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.88900000000000001,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.69099999999999995,"15min":0.72699999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86199999999999999,"5min":1.048,"15min":1.048},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.72699999999999998,"15min":0.77300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88200000000000001,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.502},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.748,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91200000000000003,"5min":1.085,"15min":1.085},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.80500000000000005,"15min":0.83499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.84799999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.625},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.752,"15min":0.78000000000000003},"min":{"1min":0.51000000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.57499999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27656,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344184,"statfs":{"total":96636764160,"available":96608444416,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.61799999999999999,"15min":0.59799999999999998},"min":{"1min":0.51400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66000000000000003,"15min":0.65000000000000002},"min":{"1min":0.53500000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86899999999999999,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67200000000000004,"15min":0.66400000000000003},"min":{"1min":0.59699999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.58999999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.90700000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63800000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.70099999999999996,"15min":0.70599999999999996},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70999999999999996,"15min":0.70199999999999996},"min":{"1min":0.57499999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95299999999999996,"5min":1.056,"15min":1.056},"last":0.69499999999999995}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.64400000000000002,"15min":0.65200000000000002},"min":{"1min":0.438,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.874,"5min":1.018,"15min":1.018},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.61299999999999999,"15min":0.627},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.623}]},{"osd":5,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90900000000000003,"5min":0.998,"15min":0.998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69899999999999995,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93700000000000006,"5min":1.091,"15min":1.091},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.70899999999999996,"15min":0.73499999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89600000000000002,"5min":1.075,"15min":1.075},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.80700000000000005},"min":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.91300000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.754}]}]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1314816,"data_stored":892495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88600000000000001,"5min":3.3860000000000001,"15min":3.3860000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.78900000000000003,"15min":0.84799999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98599999999999999,"5min":4.1959999999999997,"15min":4.1959999999999997},"last":0.81399999999999995}]},{"osd":1,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.76700000000000002},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96799999999999997,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.439,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94799999999999995,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.83099999999999996}]},{"osd":2,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":0.79100000000000004},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90400000000000003,"5min":3.5259999999999998,"15min":3.5259999999999998},"last":0.751},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.877,"5min":3.8820000000000001,"15min":3.8820000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Tue Dec 19 16:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.77900000000000003},"min":{"1min":0.53400000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.90600000000000003,"5min":3.3940000000000001,"15min":3.3940000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93899999999999995,"5min":3.5609999999999999,"15min":3.5609999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.622,"15min":0.63800000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79300000000000004,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.65700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.90100000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68899999999999995,"15min":0.69199999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58299999999999996}]},{"osd":7,"last update":"Tue Dec 19 16:18:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70699999999999996,"15min":0.71099999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95899999999999996,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.026,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.70999999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31752,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":720896,"data_stored":302127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.82799999999999996,"15min":0.89000000000000001},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":5.6769999999999996,"15min":5.6769999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71299999999999997,"15min":0.71199999999999997},"min":{"1min":0.47999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85599999999999998,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.98599999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.871,"15min":0.92900000000000005},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.875,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.73999999999999999,"15min":0.745},"min":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.702,"15min":1.702},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.86899999999999999,"15min":0.93700000000000006},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92900000000000005,"5min":5.7919999999999998,"15min":5.7919999999999998},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.76000000000000001},"min":{"1min":0.52200000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.94099999999999995,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.92700000000000005,"15min":0.996},"min":{"1min":0.622,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.95399999999999996,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.71799999999999997}]},{"osd":5,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.83499999999999996,"15min":0.92800000000000005},"min":{"1min":0.51300000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":5.7610000000000001,"15min":5.7610000000000001},"last":0.497},{"interface":"front","average":{"1min":0.625,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88500000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.62}]},{"osd":6,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.96699999999999997,"15min":1.091},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.84199999999999997,"5min":8.4329999999999998,"15min":8.4329999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.046,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Tue Dec 19 16:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.85399999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.753},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.93400000000000005,"15min":1.022},"min":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95299999999999996,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T16:19:01.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T16:19:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 Processor -- start 2023-12-19T16:19:01.266 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 -- start start 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f478006d410 0x7f47800b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800cce80 con 0x7f47801598c0 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47800cc270 con 0x7f47800b0660 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.260+0000 7f4787ed1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47800b0b10 con 0x7f478006d410 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4785c6d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47801598c0 0x7f478006c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57484/0 (socket says 172.21.15.73:57484) 2023-12-19T16:19:01.267 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4785c6d640 1 -- 172.21.15.73:0/3914318706 learned_addr learned my addr 172.21.15.73:0/3914318706 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f478546c640 1 --2- 172.21.15.73:0/3914318706 >> v2:172.21.15.73:3300/0 conn(0x7f478006d410 0x7f47800b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4784c6b640 1 -- 172.21.15.73:0/3914318706 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818266370 0 0) 0x7f47800cce80 con 0x7f47801598c0 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4784c6b640 1 -- 172.21.15.73:0/3914318706 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f476c003530 con 0x7f47801598c0 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f478546c640 1 -- 172.21.15.73:0/3914318706 >> v1:172.21.15.162:6789/0 conn(0x7f47800b0660 legacy=0x7f47800cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f478546c640 1 -- 172.21.15.73:0/3914318706 >> v1:172.21.15.73:6789/0 conn(0x7f47801598c0 legacy=0x7f478006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.268 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f478546c640 1 -- 172.21.15.73:0/3914318706 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47800cc550 con 0x7f478006d410 2023-12-19T16:19:01.270 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f478546c640 1 --2- 172.21.15.73:0/3914318706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f47800b0120 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f47700097c0 tx=0x7f477001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f17333e7c6df3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4784c6b640 1 -- 172.21.15.73:0/3914318706 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700ab610 con 0x7f478006d410 2023-12-19T16:19:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4784c6b640 1 -- 172.21.15.73:0/3914318706 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47700ab770 con 0x7f478006d410 2023-12-19T16:19:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.264+0000 7f4784c6b640 1 -- 172.21.15.73:0/3914318706 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700abb00 con 0x7f478006d410 2023-12-19T16:19:01.271 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- 172.21.15.73:0/3914318706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 msgr2=0x7f47800b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3914318706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f47800b0120 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f47700097c0 tx=0x7f477001c410 comp rx=0 tx=0).stop 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- 172.21.15.73:0/3914318706 shutdown_connections 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3914318706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f47800b0120 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- 172.21.15.73:0/3914318706 >> 172.21.15.73:0/3914318706 conn(0x7f478006a570 msgr2=0x7f47800ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- 172.21.15.73:0/3914318706 shutdown_connections 2023-12-19T16:19:01.272 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- 172.21.15.73:0/3914318706 wait complete. 2023-12-19T16:19:01.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 Processor -- start 2023-12-19T16:19:01.273 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- start start 2023-12-19T16:19:01.274 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 0x7f47800abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 0x7f4780157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801519a0 con 0x7f478006d410 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47800b2930 con 0x7f47801598c0 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4787ed1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47800b2bd0 con 0x7f47800b0660 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4785c6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4785c6d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48888/0 (socket says 172.21.15.73:48888) 2023-12-19T16:19:01.275 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f4785c6d640 1 -- 172.21.15.73:0/3623010461 learned_addr learned my addr 172.21.15.73:0/3623010461 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 -- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 msgr2=0x7f47800abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.268+0000 7f478646e640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 0x7f4780157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f478546c640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 0x7f47800abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 0x7f47800abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 -- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 msgr2=0x7f4780157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 0x7f4780157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 -- 172.21.15.73:0/3623010461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770009420 con 0x7f478006d410 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f478546c640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 0x7f47800abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f478646e640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 0x7f4780157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4785c6d640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c3c0 tx=0x7f477c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.277 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c005cf0 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c005e50 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47800b2eb0 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0072f0 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47800b3470 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478004e070 con 0x7f478006d410 2023-12-19T16:19:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f477c007450 con 0x7f478006d410 2023-12-19T16:19:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 0x7f4764067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f477c0824c0 con 0x7f478006d410 2023-12-19T16:19:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.272+0000 7f478546c640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 0x7f4764067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.276+0000 7f478546c640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 0x7f4764067f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f47700af000 tx=0x7f4770008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.276+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f477c050100 con 0x7f478006d410 2023-12-19T16:19:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.428+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f47800b3990 con 0x7f478006d410 2023-12-19T16:19:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.432+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f477c050100 con 0x7f478006d410 2023-12-19T16:19:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.432+0000 7f47767fc640 1 -- 172.21.15.73:0/3623010461 <== mon.0 v2:172.21.15.73:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f477c017020 con 0x7f478006d410 2023-12-19T16:19:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 msgr2=0x7f4764067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 0x7f4764067f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f47700af000 tx=0x7f4770008040 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 msgr2=0x7f4780151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c3c0 tx=0x7f477c00c880 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 shutdown_connections 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47801598c0 0x7f4780157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47800b0660 0x7f47800abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7f4764065a90 0x7f4764067f50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 --2- 172.21.15.73:0/3623010461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f478006d410 0x7f4780151460 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 >> 172.21.15.73:0/3623010461 conn(0x7f478006a570 msgr2=0x7f47800cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 shutdown_connections 2023-12-19T16:19:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.436+0000 7f4787ed1640 1 -- 172.21.15.73:0/3623010461 wait complete. 2023-12-19T16:19:01.459 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T16:19:01.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T16:19:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 Processor -- start 2023-12-19T16:19:01.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 -- start start 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9000cd0e0 0x7fd9000cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000b3500 con 0x7fd90015aa60 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000d0420 con 0x7fd9000ce680 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9069a2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cda00 con 0x7fd9000cd0e0 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.592+0000 7fd9059a0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9000cd0e0 0x7fd9000cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90519f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd90015aa60 0x7fd9000cfd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57486/0 (socket says 172.21.15.73:57486) 2023-12-19T16:19:01.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90519f640 1 -- 172.21.15.73:0/1318248080 learned_addr learned my addr 172.21.15.73:0/1318248080 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T16:19:01.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd9059a0640 1 -- 172.21.15.73:0/1318248080 >> v1:172.21.15.162:6789/0 conn(0x7fd9000ce680 legacy=0x7fd9000b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd9059a0640 1 -- 172.21.15.73:0/1318248080 >> v1:172.21.15.73:6789/0 conn(0x7fd90015aa60 legacy=0x7fd9000cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd9059a0640 1 -- 172.21.15.73:0/1318248080 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000ceb80 con 0x7fd9000cd0e0 2023-12-19T16:19:01.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90499e640 1 -- 172.21.15.73:0/1318248080 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561012030 0 0) 0x7fd9000b3500 con 0x7fd90015aa60 2023-12-19T16:19:01.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd9059a0640 1 --2- 172.21.15.73:0/1318248080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000cd0e0 0x7fd9000cd4c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0097c0 tx=0x7fd8fc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3131d96ebaad1b33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90499e640 1 -- 172.21.15.73:0/1318248080 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0ac620 con 0x7fd9000cd0e0 2023-12-19T16:19:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90499e640 1 -- 172.21.15.73:0/1318248080 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8fc0ac780 con 0x7fd9000cd0e0 2023-12-19T16:19:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.596+0000 7fd90499e640 1 -- 172.21.15.73:0/1318248080 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0acb30 con 0x7fd9000cd0e0 2023-12-19T16:19:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- 172.21.15.73:0/1318248080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000cd0e0 msgr2=0x7fd9000cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1318248080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000cd0e0 0x7fd9000cd4c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0097c0 tx=0x7fd8fc01c3c0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- 172.21.15.73:0/1318248080 shutdown_connections 2023-12-19T16:19:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1318248080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000cd0e0 0x7fd9000cd4c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- 172.21.15.73:0/1318248080 >> 172.21.15.73:0/1318248080 conn(0x7fd9000658e0 msgr2=0x7fd900065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- 172.21.15.73:0/1318248080 shutdown_connections 2023-12-19T16:19:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- 172.21.15.73:0/1318248080 wait complete. 2023-12-19T16:19:01.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 Processor -- start 2023-12-19T16:19:01.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- start start 2023-12-19T16:19:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000cd0e0 0x7fd900165e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.607 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 0x7fd900148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c78d0 con 0x7fd9000ce680 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c7b70 con 0x7fd90015aa60 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9069a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000c7e50 con 0x7fd9000cd0e0 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48904/0 (socket says 172.21.15.73:48904) 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 -- 172.21.15.73:0/1905471056 learned_addr learned my addr 172.21.15.73:0/1905471056 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9061a1640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 0x7fd900148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9059a0640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000cd0e0 0x7fd900165e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 -- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000cd0e0 msgr2=0x7fd900165e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000cd0e0 0x7fd900165e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 -- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 msgr2=0x7fd900148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 0x7fd900148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd90519f640 1 -- 172.21.15.73:0/1905471056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc009420 con 0x7fd9000ce680 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.600+0000 7fd9061a1640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 0x7fd900148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd90519f640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c410 tx=0x7fd8f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00074e0 con 0x7fd9000ce680 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8f0007640 con 0x7fd9000ce680 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004a50 con 0x7fd9000ce680 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9000c8130 con 0x7fd9000ce680 2023-12-19T16:19:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9000c46d0 con 0x7fd9000ce680 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9000c4920 con 0x7fd9000ce680 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8f0004bb0 con 0x7fd9000ce680 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 0x7fd8e4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd8f0082dd0 con 0x7fd9000ce680 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd9059a0640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 0x7fd8e4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T16:19:01.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.604+0000 7fd9059a0640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 0x7fd8e4067f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ae000 tx=0x7fd8fc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T16:19:01.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.608+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8f0050900 con 0x7fd9000ce680 2023-12-19T16:19:01.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.788+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90004e000 con 0x7fd9000ce680 2023-12-19T16:19:01.794 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.788+0000 7fd8f67fc640 1 -- 172.21.15.73:0/1905471056 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fd8f0004e60 con 0x7fd9000ce680 2023-12-19T16:19:01.795 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T16:19:01.795 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5234,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3046854250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3046854250},{"type":"v1","addr":"172.21.15.162:6833","nonce":3046854250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":5237,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/3416709488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3416709488},{"type":"v1","addr":"172.21.15.162:6835","nonce":3416709488}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1442417252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1442417252},{"type":"v1","addr":"172.21.15.73:6836","nonce":1442417252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/546822047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":546822047},{"type":"v1","addr":"172.21.15.73:6837","nonce":546822047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[]} 2023-12-19T16:19:01.795 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 38 2023-12-19T16:19:01.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 msgr2=0x7fd8e4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.796 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 0x7fd8e4067f50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ae000 tx=0x7fd8fc008040 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 msgr2=0x7fd900148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c410 tx=0x7fd8f000c8d0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 shutdown_connections 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd90015aa60 0x7fd900148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:6832/38117,v1:172.21.15.73:6833/38117] conn(0x7fd8e4065a90 0x7fd8e4067f50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ce680 0x7fd900148750 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 --2- 172.21.15.73:0/1905471056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd9000cd0e0 0x7fd900165e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 >> 172.21.15.73:0/1905471056 conn(0x7fd9000658e0 msgr2=0x7fd900155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 shutdown_connections 2023-12-19T16:19:01.797 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T16:19:01.792+0000 7fd9069a2640 1 -- 172.21.15.73:0/1905471056 wait complete. 2023-12-19T16:19:01.815 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T16:19:01.816 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T16:19:01.816 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T16:19:01.816 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:01.828 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T16:19:01.828 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T16:19:01.829 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:01.883 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T16:19:01.883 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T16:19:01.883 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:01.899 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T16:19:01.899 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T16:19:01.899 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:01.961 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T16:19:01.961 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T16:19:01.962 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T16:19:01.962 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:02.050 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T16:19:02.051 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T16:19:02.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:02.131 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T16:19:02.132 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T16:19:02.132 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:02.226 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T16:19:02.226 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T16:19:02.227 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:02.295 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T16:19:02.295 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T16:19:02.295 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:02.384 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T16:19:02.384 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T16:19:02.385 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:06.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-19T16:19:08.486 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T16:19:08.487 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T16:19:08.487 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.550 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T16:19:08.550 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T16:19:08.550 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.647 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T16:19:08.647 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T16:19:08.648 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T16:19:08.648 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.705 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T16:19:08.706 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T16:19:08.706 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.757 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T16:19:08.757 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T16:19:08.757 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T16:19:08.758 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.778 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T16:19:08.778 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T16:19:08.778 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.794 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T16:19:08.795 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T16:19:08.795 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T16:19:08.854 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T16:19:08.855 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T16:19:08.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T16:19:08.886 INFO:teuthology.orchestra.run.smithi073.stdout:2023-12-19T16:18:23.330939+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-12-19T16:19:08.887 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-19T16:19:08.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T16:19:08.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:08.936 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:08.963 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T16:19:09.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T16:19:09.135 INFO:teuthology.orchestra.run.smithi073.stdout:2023-12-19T16:18:23.330939+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2023-12-19T16:19:09.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:19:09.136 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T16:19:09.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:19:09.450 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T16:19:09.637 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:19:09.637 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T16:19:09.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:19:09.821 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T16:19:10.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:19:10.016 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T16:19:10.181 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:19:10.181 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T16:19:10.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:19:10.357 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T16:19:10.507 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:19:10.507 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T16:19:10.641 INFO:tasks.ceph:Archiving mon data... 2023-12-19T16:19:10.642 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/data/mon.a.tgz 2023-12-19T16:19:10.643 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-19T16:19:10.654 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ZJKbBcq5Sk 2023-12-19T16:19:10.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZJKbBcq5Sk 2023-12-19T16:19:10.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ZJKbBcq5Sk 2023-12-19T16:19:10.864 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ZJKbBcq5Sk is 354KB 2023-12-19T16:19:10.933 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ZJKbBcq5Sk 2023-12-19T16:19:10.941 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/data/mon.b.tgz 2023-12-19T16:19:10.942 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2023-12-19T16:19:10.950 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.yvaB2hkTpe 2023-12-19T16:19:10.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yvaB2hkTpe 2023-12-19T16:19:11.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.yvaB2hkTpe 2023-12-19T16:19:11.190 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.yvaB2hkTpe is 466KB 2023-12-19T16:19:11.257 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.yvaB2hkTpe 2023-12-19T16:19:11.265 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/data/mon.c.tgz 2023-12-19T16:19:11.266 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2023-12-19T16:19:11.319 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.EkXJtODrQe 2023-12-19T16:19:11.319 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.EkXJtODrQe 2023-12-19T16:19:11.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.EkXJtODrQe 2023-12-19T16:19:11.552 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.EkXJtODrQe is 466KB 2023-12-19T16:19:11.621 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.EkXJtODrQe 2023-12-19T16:19:11.630 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T16:19:11.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T16:19:11.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T16:19:11.694 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T16:19:11.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T16:19:11.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T16:19:11.732 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T16:19:11.775 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T16:19:11.782 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T16:19:11.783 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi073/crash 2023-12-19T16:19:11.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T16:19:11.808 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi162/crash 2023-12-19T16:19:11.809 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T16:19:11.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-19T16:19:11.845 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T16:19:11.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:11.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:11.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:11.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:11.982 INFO:tasks.ceph:Compressing logs... 2023-12-19T16:19:11.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:12.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:13.217 INFO:tasks.ceph:Archiving logs... 2023-12-19T16:19:13.218 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi073/log 2023-12-19T16:19:13.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T16:19:13.553 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi162/log 2023-12-19T16:19:13.554 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T16:19:13.699 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T16:19:13.724 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T16:19:13.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T16:19:13.728 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T16:19:13.798 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T16:19:13.807 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T16:19:13.807 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:19:13.811 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T16:19:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:19:13.822 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-12-19T16:19:13.823 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 44.4.53.2 2 u 58 64 177 0.255 -1.013 0.711 2023-12-19T16:19:13.823 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 177 0.134 -0.720 0.712 2023-12-19T16:19:13.823 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 60 64 177 0.111 -1.429 0.806 2023-12-19T16:19:13.823 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:19:13.825 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T16:19:13.825 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2023-12-19T16:19:13.826 INFO:teuthology.orchestra.run.smithi162.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 64 177 0.126 -0.767 0.524 2023-12-19T16:19:13.826 INFO:teuthology.orchestra.run.smithi162.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 177 0.093 -0.555 0.422 2023-12-19T16:19:13.826 INFO:teuthology.orchestra.run.smithi162.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 177 0.163 -1.236 0.438 2023-12-19T16:19:13.826 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T16:19:13.827 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T16:19:13.838 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T16:19:13.838 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T16:19:13.848 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T16:19:13.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T16:19:13.867 INFO:teuthology.task.internal:Duration was 985.806141 seconds 2023-12-19T16:19:13.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T16:19:13.878 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T16:19:13.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T16:19:13.882 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T16:19:13.972 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T16:19:13.972 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T16:19:13.972 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T16:19:13.994 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2023-12-19T16:19:13.994 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T16:19:14.016 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T16:19:14.016 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:14.038 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T16:19:14.095 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T16:19:14.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T16:19:14.114 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T16:19:14.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T16:19:14.221 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T16:19:14.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T16:19:14.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T16:19:14.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T16:19:14.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:14.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:14.304 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-12-19T16:19:14.326 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2023-12-19T16:19:14.343 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:14.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:19:14.374 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T16:19:14.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T16:19:14.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T16:19:14.405 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T16:19:14.405 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi073 2023-12-19T16:19:14.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T16:19:14.439 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085/remote/smithi162 2023-12-19T16:19:14.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T16:19:14.464 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T16:19:14.464 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T16:19:14.485 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T16:19:14.515 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T16:19:14.532 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T16:19:14.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T16:19:14.542 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T16:19:14.542 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T16:19:14.546 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T16:19:14.558 INFO:teuthology.orchestra.run.smithi073.stdout: 658065 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 16:19 /home/ubuntu/cephtest 2023-12-19T16:19:14.566 INFO:teuthology.orchestra.run.smithi162.stdout: 658054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 16:19 /home/ubuntu/cephtest 2023-12-19T16:19:14.568 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T16:19:14.579 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T16:19:14.604 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T16:19:14.631 DEBUG:teuthology.nuke:shortname: smithi073 2023-12-19T16:19:14.631 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:19:14.655 DEBUG:teuthology.nuke:shortname: smithi162 2023-12-19T16:19:14.655 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T16:19:14.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:51:29.076250', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInDLi1AFFTt3MoUz8HB1H03wHVWr3R8Ptq8tUF5pl9TNvdp8tSsW5kO1j+yiA3X9JWfS1DBTbfv/aYV41/wuM0='} 2023-12-19T16:19:14.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497085', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:51:29.077568', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPFLXSm6+i1LOeP5iPKcIiRuNcrfZzkykShcP7JpKo5zy4wU5MSBjoDIqe6dgc1t7ynLPQO+ib6nTonicoy9aw='} 2023-12-19T16:19:14.714 INFO:teuthology.orchestra.console.smithi073:Power off 2023-12-19T16:19:14.714 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:19:14.743 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-12-19T16:19:14.743 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:14.767 INFO:teuthology.orchestra.console.smithi162:Power off 2023-12-19T16:19:14.767 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T16:19:14.781 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-19T16:19:14.797 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-12-19T16:19:14.797 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:14.823 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-12-19T16:19:18.783 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:18.824 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:18.895 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-19T16:19:18.935 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-12-19T16:19:22.897 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:22.937 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:23.009 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-12-19T16:19:23.048 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-12-19T16:19:23.111 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-12-19T16:19:27.049 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T16:19:27.160 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-12-19T16:19:27.260 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-12-19T16:19:27.365 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} duration: 985.8061406612396 failure_reason: '"2023-12-19T16:18:23.330939+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-12-19T16:19:27.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T16:19:27.447 INFO:teuthology.run:FAIL